How does the displacement work with boss spawning? Could 4 people pop their arcane deary in different spots, have 16 mobs 'poof' for a moment, and have the boss spawn?

Or will the 'counter' not be affected while mobs are in another dimension?