Other factors besides connection speed come into play with ping times, I'm on an 80mbit connection but I will never see a ping time below 100 because there's a small puddle that gets in the way between me and the main server called the atlantic ocean