Fetching details from the dictionary...
to have a guilty conscience; to have (something) lie heavy on one's conscience