What taste in humor do LLMs have?
Summary
A research report reveals that LLMs have varying levels of agreement in humor taste, with a general preference for absurd humor and roast joke formats, and Gemini being the most consistent judge.
Similar Articles
Humor Arena: Which LLM is the funniest?
The article presents a comparison of 20 LLM versions on humor generation using a fine-tuned judge, with Fable 5 scoring highest in a joke benchmark.
Does post training make LLMs funnier?
This study investigates whether post-training makes LLMs funnier, finding it improves humor but reduces response diversity across multiple models and training stages.
Investigating Counterfactual Unfairness in LLMs towards Identities through Humor
Academic study exposes systemic counterfactual unfairness in LLMs: jokes from privileged speakers are refused 67% more often and rated as more malicious than identical jokes from marginalized speakers.
i built a benchmark to test whether LLMs can understand and create jokes
A developer built a benchmark called lolbench to evaluate LLMs on understanding and creating jokes, revealing models are strong at explaining real jokes but struggle with failed ones, and incorporating human voting for preference testing.
HumorRank: A Tournament-Based Leaderboard for Evaluating Humor Generation in Large Language Models
HumorRank introduces a tournament-based leaderboard using pairwise evaluations and Bradley-Terry MLE to rank LLMs on humor generation, showing humor quality depends on comedic mastery rather than scale.