Fetching details from the dictionary...
to be one's ruin; to do harm; to cause trouble; to have negative consequences; to bring about a bad outcome