usually its better to be riding the mount. but, loose is also powerful.
Riding does a few things:
mainly, it uses the mounts movement to move. so, when you now, get into melee, can do a "Full attack action". if you move then attack, you only attack once. while stationary, lets you do that...