Preprint Models When Hybrid Decision Systems Should Invoke Reasoning
Reported by casrai.org and r/LocalLLaMA2 sources ↓
Researchers from Huawei, Liverpool and UCL present HDM, which uses one model to answer directly or invoke full reasoning. Their preprint reports lower token use and latency on several tests.
Key points
- HDM-4B scored 0.857 on JevBench, compared with 0.851 for Jev
- HDM-4B's median JevBench latency was 0.179 seconds, versus 0.652 seconds for Jev
- On MiniWoB, HDM-27B reduced token generation by 80.1%
- The preprint was published on November 12, 2026
Sources
Details
The preprint describes a single frozen model backbone with a lightweight routing block. It answers from its initial forward pass without generating reasoning tokens when the router selects the fast mode, and uses autoregressive reasoning when the router estimates that the added utility exceeds a set price for thinking.
The researchers report evaluations on question-answering, classification and agent benchmarks, including MMLU-Pro, AGIEval, GPQA-Diamond, JevBench, BANKING77 and MiniWoB. On JevBench, HDM-4B scored 0.857 against Jev's 0.851, with median latency of 0.179 seconds versus 0.652 seconds. On MiniWoB, HDM-27B reduced token generation by 80.1%; the press article also reports that episode completion time fell from 96.1 seconds to 31.3 seconds.
For agent tasks without labels for individual decisions, the authors introduce Calibrated Decision Policy Optimisation, which trains the routing block using episode-level returns. The work is a preprint; the press article says the team intends to release implementations and checkpoints, while the community post lists code and model links.
Written from coverage as of
Images
- casrai.org