Wayne, I prefer not to have to go and get a pass from the secretaries office every time I go to watch my horse, and when my horse isn't racing I still visit trainers in the stable area. And do they allow your friends to go with you ? It's frustrating when you do the right thing and follow the rules but the rules aren't being policed very often.
I believe the signs say " Licenced (or authorized) persons only past this point" , or something similar to that. I'm sure owners cannot enter without a pass or stablehands licence.