I have the option "Make my house public" selected but when a person who is not in my friends list/guild/party tries to /visit me they get error that my house is only allowed to friends, guild mates or party members.

Please fix it, thanks.