MachinePulse releases open Karpo-Decision-31B multimodal decision model
Reported by r/LocalLLaMA1 source ↓
MachinePulse released Karpo-Decision-31B, a Gemma 4 31B fine-tune for structured decisions from text and images. It scored 73.9 on the Decision Index Full leaderboard, tied for first among 300 entries.
Key points
- The model supports choice, yes/no and scoring questions over text and images
- Its 73.9 Full score tied with GLiDE 27B for first under the leaderboard’s tie rule
- The 31B weights and inference code are released under Apache 2.0
- BF16 weights require about 62.5 GB, plus runtime memory
Details
The community post reports that Karpo-Decision-31B returns probabilities for supplied answer options and can handle up to 255 options per choice question. It supports multiple questions about the same input in one forward pass, with a documented sequence limit of 32,768 tokens. Python API and HTTP server options are available.
The post says the Decision Index Full score combines private tests for familiar skills and tasks from new domains, weighted 60% and 40%, respectively. Karpo scored 70.7 on familiar private tests and 78.6 on new-domain tasks; its separately reported public index score was 75.0 and was excluded from the Full score.
MachinePulse reports median latency of about 95 milliseconds per request on the public Decision Index suite using one RTX PRO 6000. The team also reports that its final model averages five checkpoints; compared with a final single checkpoint, it improved unfamiliar-domain results by 1.6 points without requiring additional models at inference time.
Written from coverage as of