Would knights and lords be taught hand-to-hand fighting like wrestling or boxing, or was that consigned to the lower orders as beneath them?

Wrestling yes, boxing had sort of fallen off after the classical period. 

But honestly, when you carry swords and knives all the time, hand-to-hand is less relevant.