UR-FUNNY and humor-aware transformers
UR-FUNNY pairs each punchline with the setup before it. Building on it, M-BERT injected multimodal information into pretrained language models (ACL 2020), and the Humor Knowledge Enriched Transformer added external humor knowledge (AAAI 2021).
-
UR-FUNNY: A Multimodal Language Dataset for Understanding Humor
UR-FUNNY: a multimodal dataset of words, voice and gestures from TED talks for teaching AI to understand humor.
-
Integrating Multimodal Information in Large Pretrained Transformers
Lets BERT-style language models take in voice and facial cues, not only words, improving sentiment and behavior understanding.
-
Humor Knowledge Enriched Transformer for Understanding Multimodal Humor
Teaching AI to get jokes: a transformer that combines words, voice and facial cues with external humor knowledge to recognize humor in video.
