Maybe maybe his plan is to bank shot off that to try to get a rising in the Riverlands in Sansa Stark’s name, but no LF has stayed away because A. he doesn’t have the manpower to subdue it, B. he’s a known Lannister loyalist so gaining their loyalty would be extremely difficult, and C. even he can’t be in two places at once and the Vale is more important.