BigMoeOnEdge outperforms Strata and colibri on 8-16 GB cards and Mac and you can run any model
Reported by r/LocalLLaMA1 source ↓
Key points
- The user reports about 35 tokens per second for BigMoeOnEdge on an 8 GB card running Qwen3.6-35B, versus about 23 for colibri
- On a 12 GB card with the same model, the user reports about 45 tokens per second for BigMoeOnEdge and 30 for Strata
- On a 16 GB MacBook, the user reports about 20 tokens per second on Qwen3.6-35B and 10 on Qwen3.8-Flash-Next 125B
Details
The benchmark figures come from a post in the r/LocalLLaMA community, not an independent test. The poster says BigMoeOnEdge runs MoE GGUF models that llama.cpp can load, without repacking or a special format, and uses an automatic setting option for the user's hardware.
In the poster’s 8 GB test with Qwen3.6-35B, BigMoeOnEdge reached about 35 tokens per second, compared with about 23 for colibri; Strata did not start at a 16,000-token context. On a long prompt on that card, the poster reports five seconds to the first token for BigMoeOnEdge, 14 seconds for Strata and nearly two minutes for colibri.
On a 16 GB MacBook, the poster reports 20 tokens per second for BigMoeOnEdge on Qwen3.6-35B, compared with 3.5 for colibri, and 10 tokens per second on Qwen3.8-Flash-Next 125B, compared with about seven for Strata. The poster also says Strata was ahead on two RTX 5060 Ti cards, running that 125B model 1.3 times faster than BigMoeOnEdge.
Written from coverage as of