The comedian's distaste for the figure was only heightened when Today brought Buddy the Elf out ... Never miss a story — sign up for PEOPLE's free daily newsletter to stay up-to-date on ...