This happens when you do not meet the requirements for the weapon you have equipped. Select it in your inventory and you should see a requirement marked in red that you don't meet (level or str/dex/int generally).