Vellium 1.9.5: visual novels that actually work on a 12B local model
Reported by r/LocalLLaMA1 source ↓
Vellium 1.9.5 adds a Lite mode intended to make visual novels more reliable with smaller local models, alongside changes to image generation, character consistency and scene management. The update was tested primarily with Gemma 12B, according to the release post on r/LocalLLaMA.
Key points
- Lite mode uses plain-text markers instead of requiring structured JSON output
- The system prompt was reduced from about 8,000 to about 1,000 characters
- Images can begin rendering through ComfyUI while story text is streaming
- Characters now use compact visual descriptions and pinned outfits for image consistency
- The free, open-source update supports 12 new visual style presets tested with Anima
Details
The release post on r/LocalLLaMA says Lite mode is designed for smaller local models such as Gemma 12B. It has the model write plain text with simple scene and speaker markers, which Vellium parses into scenes; malformed output can fall back to plain narration. The post says the update was tested primarily with Gemma 12B and invites feedback from users of other small models.
Vellium also reduces the system prompt from about 8,000 to about 1,000 characters and streams text into the reader before the full response is complete. For images, the narrator can add tags within the story, allowing ComfyUI to start rendering while text streams, including when ComfyUI is on another machine.
Other changes include reusable backgrounds and character sprites, image redraw and editing controls, and scene-level image regeneration without regenerating the story. The update also adds support for user personas, attached RAG knowledge collections, conversion between chats and visual novels, and exporting stories to Writer projects.
Written from coverage as of