No, I don’t think they do look down on them for borrowing money, after all a lord has to maintain the standard of magnificence of a lord, and is supposed to be open-handed rather than copper-counting.
Their prejudice would be against the money-lender for taking advantage of the lord borrowing money, especially if that money-lender uses repayment to exert dominion over his social better.
And the Crown’s debts seem to have been an open secret at court.