You can restrict graduate transfers, but the NCAA can grant an exception for academic reasons. In practice you just write a letter stating that you want to study X and one of the top researchers in the nation studies that there. Then you take whatever course of study you actually wanted to pursue because nobody can prove you didn't change your mind.