I was thinking more in terms of the sheer weight and size involved in picking up the horses' feet (and handling the shoes), rather than the idea that a lot of muscle would be needed to control the horse -- that's a matter of personality rather than force, I think, given the relative masses of a man and even a small pony!