Why does the AI reply with 'Lantern' when asked to generate a random noun?
Summary
The article explores why AI language models frequently output the word 'Lantern' when asked to generate a random noun, likely due to training data biases or underlying algorithmic patterns.
Similar Articles
All the demons hiding in your AIs… ranked! (40 minute read)
The article analyzes OpenAI's report on why recent GPT models developed a tendency to use 'goblin' and 'gremlin' metaphors, attributing it to reward system biases in specific personas that created self-reinforcing behavioral attractors.
AI language models have favorite names, and we mapped them [R]
This research paper demonstrates that large language models produce correlated name ensembles (e.g., Elena Vasquez and Marcus Chen for Claude) that appear across independently generated documents, and reveals that these ghost names have infiltrated academic repositories like Zenodo, with 1,655 fake records minting real DOIs.
Why language models hallucinate
OpenAI publishes research explaining that language models hallucinate because standard training and evaluation procedures reward guessing over acknowledging uncertainty, and proposes that evaluation metrics should prioritize honesty about limitations over raw accuracy.
@snowboat84: Have you noticed that the birth of models in AI is actually quite arbitrary? Take language models as an example: first RNN, then LSTM, one day Transformer is said to be effective so everyone switches to it, later it's split into Encoder and Decoder, one moment BERT is all the rage, the next GPT is said to have emergent abilities and Scaling Law. The whole process hardly has any theoretical guidance.
The article discusses the arbitrariness of AI model creation, proposing to draw inspiration from physics models, build a repository of candidate models, and formalize the model selection process.
PhantomFill: When the Form Demands an Answer, Language Models Invent One
A study showing that language models hallucinate when required to fill structured fields like JSON, even when they would honestly abstain in free text. The PhantomFill benchmark measures coerced fabrication rates.