Fetching details from the dictionary...
a thorn in one's side; a pain in the butt (often someone higher in rank, ability, etc.); a person standing in one's way; a superior who obstructs one's freedom of action