Double check that you have everything removed. Bolts (don't forget the small bolt or bolts depending on what year you have in the center), caliper, rotor, parking brake, disconnect the reverse fork linkage. and remove the collar with the set screw. If you are positive you have everything removed give it a GENTLE tap with a rubber mallet.
Good luck.