I think most of it has to do with speed, (but clearly also trajectory), the higher the orbit, the tinier the recovery area possible because as that video shows - you really are just trying to go sideways really fucking fast to stay in orbit. That's 99% of the task almost, getting to altitude...