Just stand in front of the door blocking their path to the flag. They can't do anything about it. If they harm you in any way, they're vulnerable. This isn't a big deal unless you aren't that great of a defender. Also, why would you send your entire battalion against 2-3 saints in the flag room? They can't even do anything until they regrouped. Just shoot a few arrows up the ass and they'll leave.