Oddly enough, I seem to have the hardest time with Jarl. At L15 I can solo him, but it seems like even with other 15s in the party he keys in on me.

Could be that a tank wasn't good at holding aggro, like you said.