Yes, ranged mobs can take you out really quickly even if they're trapped in the time sphere, which is why I recommend using ice or fire to freeze/stun as many ranged mobs as you can and then dropping the clock and getting some distance before attacking again.

And if you drop a Clock and use Gale they will be pushed out even if you charged your clock to pin them.

It's best that you use gale directly after a fireball when they're stunned for maximum damage and no scattering.