Literally carrying us on their backs

I could be wrong about this but I'm fairly sure dogs have been with man for A LOT longer. Like 40,000 years ago, and I think, just from a quick Google, horses are like 4000 years...