Do you think the vow of celibacy among the Night’s Watch might be some magical sacrifice that maintains the wall so long as some remain true?

No, I think it it’s a rather straightforward case of not wanting to create rival houses who might compete for power amongst themselves and/or against their neighbors – as actually happened in Westerosi history.