Why did the glover people not living in deepwood motte never try to harm the ironborn ? Asha travelled to winterfell with no problems

It takes time to mobilize, and even more time when the people who are supposed to be leading the mobilization are locked up. 

It’s a very different story when Stannis shows up…