Caligus is relatively a medium size realm. It is not a large realm. Just Perdan and Eponllyn togehter should easily take care of Caligus.
The game is about having more nobles even more so than before. Even having 5 more nobles can change the size of your army significantly these days.
Caligus is just buying itself more time with militia but gold eventually will run out.