I think you can manage to use a different town for the remaining day of the cooldown.