There are many and varied reasons for gelding a colt other the obvious ones and ones mentioned above. I train on a public track where each trainer has a paddock or two in the centre of the track and obviously colts aren't allowed out there. We used to have colt yards near the track but the city council didn't renew the lease therefore if we train a colt it basically has to be boxed.
I have never had a real problem with any colts that I have trained. I have transported them with fillies to the races and never had a problem.
Mostly all my colts were gelded on the wishes of the owners. It did make training at the track easier.