Agreed. Now, I think it's probably just best to make it so the ultimate is fully charged when you join a map. That's fair - and is the most reasonable solution.