It is, but A. even 200 men would inflict significant casualties on an enemy before losing, B. Tywin couldn’t afford to leave a bigger garrison behind and fight a western campaign, and C. trying to escort large numbers of prisoners on a forced march through enemy territory is a great way to lose prisoners.