Example: you're level 10, you put 5 points in a skill, it does 50 damage. You level up to 45. That skill still does 50 damage, but now your weapon does 5x as much damage, making effective skill use less and less significant as you level.