'Life has moved on' since Brexit, the British leader said