Announce the problem in guild chat so everyone will aware about the problem, the reason is everyone will invite him always if you don't announced the problem.