That's the Cat quality, right there...
I had mine off last winter to replace the tri-hub but didn't see any issues.
That said, don't think that's an issue tho. The adjuster bolt will be pushing against the axle, so once you get the track tension the bolt will most likely pop right back in there. The bolt will prevent the axle to move forward, and once the axle nuts are tightened the axle will stay in place.
Sent from my iPhone using Tapatalk