Fetching details from the dictionary...
a thorn in one's side; a pain in the butt (often someone higher in rank, ability, etc.); nuisance; something in the way