It doesn't seem to happen to 'boss' like characters. i had one follow me for ages. Fortunetly I beat it before it beat me XD