What's up with players in my ignore list being able to come into my home?

Just wrong :\