と言ってしまえばそれまで

it is certain true that ... (but); you can't argue that it's not ... (but)