The chat show host mocked Walliams at an awards ceremony back in 2004.