If you're concerned with getting tokens or the title, you're better off getting a group with your friends or guildmates.
With pugs, there is no way to avoid this. There will always be new people trying out the map who have never been there before.

I've only done random Hauntlet group once or twice and when it passed the 30 sec mark and we were still in the first room, I left.