Alan Grayson insists he is not “a piece of nose slime”