pretty sure it's either just lag (only registers client side?) or you're pressing the skill button too fast after using another skill.

i know for a fact if you have high ping, the skills will fail to register frequently. it's not just a delay, they will not be cast.
it also seems if you try to use a skill too quickly after another, it will not register.