The brains I picked late at night in cheap motels at AMSRA races told me some horizontal movement is OK (shaft is slightly smaller than the hole), but wobble is not.
I strive for that.
One thing's for sure - if you just slap one of these tight spacers on, button down the nut and race, it could cause the flag to be inconsistent regarding ride height and free rotation.
