Do you think Horn Hill in the show is too big of a castle for a second-tier (albeit powerful) lord?

Not too big – too ornamental. Horn Hill is the castle of a prominent marcher lord. That thing should look like a fortress capable of resisting a siege for years at a time, because it needs to be.