You're a dex mage now. It'll be hard to adapt to pally when going from dex or pure int Mage since it's a huge damage cut. I say don't care about KD, just play whatever spec you have the most fun with