It is not only Article VI's Supremacy Clause which establishes the federal appelate power over state courts, but also the beginning of Article III, Section 2:
The judicial Power shall extend to all Cases, in Law and Equity, arising under this Constitution, the Laws of the United States, and...