There's certainly good reason to ensure a horn fits snugly inside its case. A common cause of damage is when the case cops a whack and transmits the impact to the horn via a sort of slide hammer action. In effect, the energy gets transmitted into the horn - and because the horn isn't snug, the energy has nowhere to go...so the horn takes the strain.
However, if you consider the keywork you'll note that there are lots of moveable parts that are held in a state of tension. It requires energy to move these keys against the force of that tension - which is pretty much exactly how a shock absorber works.
Granted, the figures are likely to be small - but nevertheless there's a scientific principle at work which suggests that the horn is likely to be better off if the keys are free to move.