粋が身を食う

too much pleasure ruins a man (esp. in reference to spending too much time with geisha and prostitutes); playing the dandy ruins a man