Can AI master the art of humor? | Bob Mankoff

0:06You're listening to TED Talks Daily, where we bring you new ideas to spark your curiosity every day. I'm your host, Elise Hume. There's a lot that AI is capable of these days, but can it match human creativity when it comes to humor? Former New Yorker cartoons editor Bob Mankoff put the machines to the test when it comes to cartooning and quips. In his 2024 talk, he shares what he learned from trying to get AI to make jokes.

0:37Whether you're thrilled by what AI can do for us or terrified by what AI is going to do to us, whether it can be funny is probably not top of mind for you. It is for me. I don't care if it turns all of us into paperclips, as long as they're funny paperclips. And the fact that it makes stuff up, hallucinates, For me, that's not a bug, that's a feature. My entire career was making stuff up that are called cartoons. There is no algorithm for humor, but now with the rapid pace of AI, I have to wonder, could there be a bot Mankoff? You might think my reflexive answer to this would be, how about never?

1:32but while I don't want to be replaced by a bot I'm not above being helped by it Steve Jobs famously said that computers are a bicycle for the mind if that's the case what's AI? a rocket ship and at my age you know what I'd settle for a walker laughter

1:56The fears of machines replacing humans are not new when the goals of machines and humans go horribly awry at least for one of the parties cartoons don't happen in a cultural vacuum they're part of the zeitgeist the guy who invented cybernetics, Norbert Wiener, who said thinking machines were putting us on the eve of destruction. Now, sadly and tragically, Norbert Wiener died, but not by a thinking machine, but by an unthinking one. He was run over by a bus. That's not true. I made that up. I hallucinated it because it's funny. So these fears are not new, not novel, but now, in the immortal words of Nigel Tufnell of Spinal Tap, they go to 11.

3:05They're cranked to the max, and here is one of the maximum cranksters of all time, Elon Musk saying, AI is one of the biggest threats to humanity, but certainly not as big as Elon Musk.

3:29People like Elon have a P-Doom number. That's the probability AI is going to wipe us out. I think P-Doom is P-Dumb. I'm interested in P-Funny, and I've been using the New Yorker caption contest to look into the probability of that. Every week since 2005, the New Yorker has presented a cartoon without a caption and challenged its readers to come up with the winning caption in the caption contest. And for that, they get the glory of being in the New Yorker magazine a huge amount of money, a house in the Bahamas that Sam Bankman freed. Actually, it's just the glory. On the page of the New Yorker, there's a contest you enter, the finalists from a few weeks before, three finalists, and a winning caption.

4:32So it's staggered in that way. Each one of these images are funny. They're in Congress. You certainly think they're humorous, but they're not funny in a way that you get. They're not mentally funny. To make it that, of course, you need the right caption. Okay, but with up to 10 ,000 captions every week, how do you select that? Now, from 2005 to early 2016, that burden fell on me and my assistants, but mainly my assistants to try to cull the good captions from what we uncharitably call the craptions.

5:20But then, in early 2016, for the benefit of all humanity, but mainly for me and my assistants. We switched to crowdsourcing. So now for every contest, you vote online, and a funniness score from over a million judgments is given for all the captions. Now, overall, I'm against mob rule, but actually in this case, the mob does a pretty good job. Usually the finalists, almost certainly, almost all the time really, the finalists come from the top 200 captions. Well, this is popular not only with the New Yorker, but it's caught the eye of data scientists, creativity searchers, cognitive scientists, and AI, of course, and everything adjacent to AI.

6:18But I wasn't really surprised when Vincent Van Hook, then the chief data scientist for Google's DeepMind, now the head of robotics, sent me this email indicating that winning the caption contest, which was actually somewhat of the sine qua non of human creativity and intelligence. And I was also flattered by that, of course, but I didn't think they had any chance at all of doing it. And it turned out that was the case. All of the AI juju circa 2016 wasn't up to the task. It really couldn't even decode the image. So for the sine qua non of the human mind, deep mind was non-compos mentis and out of its depth.

7:11But time and AI marched on. AI marching quadruple time. Vincent gets back to me and says, while human creativity might still be out of reach, we think we have understanding well in hand. He sends me this ridiculous uber nerd example of explaining humor, and I said, you know what? Let me give you a cartoon I did in 1997 at this other watershed moment when IBM's DeepMind defeated Garry Kasparov, the world's chess champion. And here's the cartoon I did then. And it says, no, I don't want to play chess. I just want you to re-eat the lasagna. I rate this explanation a solid B minus. But so what if it was an A?

8:08Is there ever going to be a beautiful New Yorker cartoon anthology of explanations? I don't think so. But the idea that understanding humor could be a stepping stone to creating it sort of made sense. this paper I was involved in tried to look at compared to smart humans what were the best AIs do on three tasks could they from winning captions from different contests match to the right image could they between two captions one that won and the one was pretty good pick the right one and could they explain the humor now for all of them you know what yay humans we're still ahead but AI is closing the gap.

9:00The most interesting thing about this paper for me was it showed a pathway for which you could create cartoon humor. And that was how we trained the contest. For 653 contests, the AI was trained fine-tuned on these examples which humans annotated. A description of the cartoon, explanation of the humor. Okay, if you use ChatGPT, you sort of get the idea now. Put a number of examples like this. Put it in the prompt window. Rinse and repeat. And you get new cartoons. Well, Jack Hessel, the chief author of the paper, did something more sophisticated. and what he did was create 50 synthetic new cartoons generated from this old data in which there were five options for captions.

10:01I picked four of them and I gave them to cartoonist Shannon Wheeler to draw up. Now, Shannon said, well, these are weird. They don't really seem like... It's sort of an uncanny valley of cartoons. They're not quite there. But it is interesting. All of these are new cartoons that never appeared anywhere that are an idea of computer creativity. But I do see this now as a tool for brainstorming for cartoonists, in that we played this completely straight. Shannon wasn't able to manipulate the description of the picture or the caption. Had he done that, it could have been better. Also, we could have asked it to make more.

10:50We could have put in the rankings for the humor. We could do all this to improve it. So quality comes out of quantity. You can get an awful lot of quantity here. You can have a human being in the loop to do this. but I would not go so far to give AI a true human sense of humor. A human sense of humor is not about making a joke or getting it. It's rooted in our vulnerability. It's the blessing we get for the curse of mortality. Mark Twain said, the true source of humor is not joy, but sorrow. If we gave AI the thousand natural shocks that flesh is heir to, that would be cruel. If we did that, it might very well want to wipe us out.

12:00And if they did, all I ask is that they take Elon first. Thank you.

12:16That was Bob Mankoff speaking at TEDxU of M in 2024. If you're curious about TED's curation, find out more at ted.com slash curation guidelines. And that's it for today. TED Talks Daily is part of the TED Audio Collective. This episode was produced and edited by our team, Martha Estefanos, Oliver Friedman, Brian Green, Autumn Thompson, and Alejandra Salazar. It was mixed by Christopher Faze Bogan. Additional support from Emma Taubner and Daniela Balarezo. I'm Elise Hu. I'll be back tomorrow with a fresh idea for your feet. Thanks for listening.