The solution could be introducing a new guild position having demote/booting powers.
This way u can have as many officers n recruiters as u want but only a bunch of very trusted "guild managers".