遠のく

to move off (into the distance); to become distant; to recede; to fade away; to die away

to drift away (from a person, activity, etc.); to distance oneself (from); to become less frequent (e.g. of visits); to fall away (e.g. of customers)