[Link] AI advances: computers can be almost as funny as people
post by Shmi (shminux) · 2013-08-02T18:41:08.410Z · LW · GW · Legacy · 16 commentsContents
Unsupervised joke generation from big data Sasa Petrovic and David Matthews Abstract None 16 comments
"Our model significantly outperforms a competitive baseline and generates funny jokes 16% of the time, compared to 33% for human-generated jokes."
From this paper:
Unsupervised joke generation from big data
Sasa Petrovic and David Matthews
The 51st Annual Meeting of the Association for Computational Linguistics - Short Papers (ACL Short Papers 2013)
Sofia, Bulgaria, August 4-9, 2013
Abstract
Humor generation is a very hard problem. It is difficult to say exactly what makes a joke funny, and solving this problem algorithmically is assumed to require deep semantic understanding, as well as cultural and other contextual cues. We depart from previous work that tries to model this knowledge using ad-hoc manually created databases and labeled training examples. Instead we present a model that uses large amounts of unannotated data to generate I like my X like I like my Y, Z jokes, where X, Y, and Z are variables to be filled in. This is, to the best of our knowledge, the first fully unsupervised humor generation system. Our model significantly outperforms a competitive baseline and generates funny jokes 16% of the time, compared to 33% for human-generated jokes.
From The Register:
It uses 2,000,000 noun-adjective pairs of words to draw up jokes "with an element of surprise", something the creators claim is key to good comedy.
...
jokes calculated by the software include:
- I like my relationships like I like my source code... open
16 comments
Comments sorted by top scores.
comment by calef · 2013-08-02T18:44:42.254Z · LW(p) · GW(p)
The link to the actual paper is http://homepages.inf.ed.ac.uk/s0894589/petrovic13unsupervised.pdf
comment by sediment · 2013-08-03T20:52:33.236Z · LW(p) · GW(p)
Two comments, one trivial and one more important:
trivial: personally, I don't think any of the jokes are really very funny. Then again, I never really liked the particular formula they're using, and I'm willing to accept that my taste in humour might be a little idiosyncratic.
important: I might be stating the obvious here, but I don't think it's really that enlightening to compare this with human joke-making, as I think they're mostly doing different things. Although the computer can do a passable job at filling in the variables for a given formula, that's a far cry from coming up with the formula in the first place. That's the impressive act of creativity, and after-the-fact mimicry of the same is much less impressive. When a computer gag program is flexible enough to come up with less stereotyped, formulaic gags, then I'll be impressed.
I'm reminded of, for example, EMI, Experiments In Musical Intelligence, David Cope's computer program capable of writing startlingly good pieces in the style of dead composers - but, of course, unable to come up with a distinctive, expressive style of its own.
Replies from: Vladimir_Nesov↑ comment by Vladimir_Nesov · 2013-08-03T21:08:45.603Z · LW(p) · GW(p)
That's the impressive act of creativity, and after-the-fact mimicry of the same is much less impressive.
This reminds me of the following articles, which probably don't reflect your intended sentiment, but might help some readers:
Replies from: sedimentcomment by [deleted] · 2013-08-04T16:10:04.107Z · LW(p) · GW(p)
There's another abstract on this topic here: http://acl2013.org/site/short/2316.html
I'm not sure how to find the actual paper link, though someone posted this one below.
comment by Document · 2013-08-03T07:50:55.400Z · LW(p) · GW(p)
I haven't read the article or the paper, but in fairness, humans are also pretty good at finding humor in things (there are older examples).
comment by Shmi (shminux) · 2013-08-02T20:56:11.878Z · LW(p) · GW(p)
Humor generation is a very hard problem.
Unfortunately computers can't tell which of the jokes they generate are actually funny, which is an even harder problem. I wonder if there is any research in that direction.
EDIT: apparently they can.
Replies from: buybuydandavis↑ comment by buybuydandavis · 2013-08-03T08:08:58.710Z · LW(p) · GW(p)
Use joke evaluator to filter output of joke generator. Bam! Massive improvement on joke hit rate.
comment by Lumifer · 2013-08-02T19:19:04.401Z · LW(p) · GW(p)
In other words, the paper's authors consider funny 16% of random combinations of X, Y, and Z inserted into the pattern of "I like my X like l like my Y, Z".
Replies from: thomblake↑ comment by thomblake · 2013-08-02T19:37:21.193Z · LW(p) · GW(p)
No, the completely random baseline generated funny jokes 3.7% of the time.
Replies from: Lumifer, sediment↑ comment by sediment · 2013-08-03T20:48:34.301Z · LW(p) · GW(p)
I actually quite like the idea of completely random gags in this formula. I feel like I might even prefer them to the lame ones given by the ostensibly smarter algorithm. It could be a rich vein of absurdist, non-sequitur laughs.
Replies from: ikrase