We really aren’t told why, and it doesn’t make a lot of sense given political and cultural considerations.
My only guess is the spread of the Common Tongue across the south meant that it was too useful as a lingua franca not to learn, but that’s not a great solution.