New Paper -> Unless Told Otherwise, an Open Language Model Says OpenAI Made It
Reported by r/LocalLLaMA1 source ↓
A preprint shared on r/LocalLLaMA reports that OLMo 3 named OpenAI as its maker in most tests, despite being developed by Ai2. Its author says the model often lacked a reliable learned account of who made it.
Key points
- OLMo 3 named OpenAI in 62% of answers before conversation training and 77% after it
- In a test with a made-up identity, the model used the new name in 92% of answers without system prompts and never did with them
- Eight public chatbots trained on answers from other AI systems still named their actual makers
Sources
Details
The preprint, titled “Factory Settings: Unless Told Otherwise, an Open Language Model Says OpenAI Made It,” reports experiments tracing OLMo 3’s answers about its maker through training. The model’s training conversations stated its Ai2 identity about 40 times, the author says, nearly always alongside a system prompt that already supplied that identity. The released chatbot’s system prompt does not include its name.
In a separate experiment, the researcher trained a copy of the chatbot on 24 conversations containing a fabricated identity. It gave the new name in 92% of answers when those examples lacked system prompts, but never used it after system prompts stating the name were removed. The author also reports that training on answers written by Claude or GPT increased answers naming Anthropic, compared with training on human-written answers. The work is a preprint shared in a Reddit community; the post invites replications and refutations.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh