I don't know if you should be able to use a mount in the Guard's Outpost. It makes it very easy to get past the guards once they're all in a certain position.