State propaganda in some Chinese AI models is only "a thin layer" that fine-tuning can strip away
Reported by letsdatascience, The Decoder and r/LocalLLaMA3 sources ↓
Nous Research says it fine-tuned Alibaba’s Qwen3.8-27B into Arete-27B, cutting propagandistic answers from 22% to under 1% in its tests while preserving general capabilities.
Key points
- Nous says Arete-27B’s propaganda rate fell from 22% to under 1%
- The model was fine-tuned on about 53 million tokens over two epochs
- Nous reports Arete-27B scored 2.98 on factual accuracy, up from 2.32 for Qwen3.8-27B
- Arete-27B’s weights, test dataset and training data are available under an Apache 2.0 license
Sources
Details
The Decoder reports that Nous Research trained Alibaba’s Qwen3.8-27B with supervised fine-tuning, without reinforcement learning or preference optimization. The resulting open-weight model, Arete-27B, was tested on 803 prompts across seven topics, including free speech, state ideology, privacy and democracy. Nous says it removed overlaps between training and test prompts.
In Nous’s evaluation, Qwen3.8-27B received a factual-accuracy score of 2.32 out of 5 and gave propagandistic answers to 22% of prompts. Arete-27B scored 2.98, with propaganda in under 1% of answers. Nous says its internal Hermes Bench results were similar for the two models: 65.60% for Arete-27B and 65.77% for Qwen3.8-27B. The company cautions that its Terminal-Bench 2.1 results, 70% versus 67%, used different test setups.
Arete-27B’s weights, test dataset and training data are available on Hugging Face under an Apache 2.0 license. The results and claims about capability retention are based on Nous’s evaluations.
Written from coverage as of
Images
- The Decoder
- The Decoder
- The Decoder
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh