I made a 400M model for NPC judgement calls in games (Apache-2.0, ~0.1s on a 3060 Ti)
Reported by r/LocalLLaMA1 source ↓
A community post describes Ettin-400M, an encoder model that returns probabilities or “not sure” for game-related questions, such as whether an NPC should consider a player threatening.
Key points
- The model includes 42 adapters for questions about threats, apologies, persuasion, memories and NPC mood
- The author reports checks take about 0.1 seconds on a 3060 Ti and about 1 second on a CPU
- The model runs locally through a pip-installable runtime and makes no network calls
- The author says public benchmarks have not yet been run
Details
The r/LocalLLaMA post says Ettin-400M takes a scene, a question and answer options, then returns probabilities or “not sure.” The author describes using it alongside a dialogue-generating language model for yes-or-no and multiple-choice checks, including screening generated replies.
The post lists 42 adapters for common questions and says up to five questions about the same scene take the same time as one. The author reports that CPU performance slows on long scenes; the model is English-only, and its planning-related capabilities were tested only on data generated by the author.
Written from coverage as of