I put a few hundred miles on with the transfer blocks removed. Didn't damage anything at all. It just gives tons of weight transfer, the skis never touch the ground. Works great for ditch banging or off trail riding, but makes going through the woods quickly difficult.
They're easy enough to remove and put back in. Give it a try. Its fun!