It was more than just the weather:
“Peremore…had an insatiable curiosity about the world beyond his window, so he turned to wise men, priests, healers, and singers, along with a certain number of wizards, alchemists, and sorcerors…”
The Citadel’s original purpose seems to have been “questing after truth” in matters secular, religious, and occult.