Clover 2: dense 27.8B base + 7 LoRA experts routed per token, not a static merge, weights public
Reported by r/LocalLLaMA1 source ↓
Clover 2 keeps its base model and seven LoRA adapters separate and uses a router to select experts during inference. The team says its benchmarks improved over the base model; it has not provided scores in the post.
Key points
- The router can select experts per token or fall back to the base model
- The team reports gains on GSM8K, MATH-500, GSM-Hard and LongBench-v2, without giving scores
- The base model, adapters, router and vLLM plugin are public
- vLLM is the supported path; the post says there is no GGUF version yet
- The team says the service is free for a week, with no card required
Details
The Clover 2 team describes the release as a base model paired with seven separate LoRA adapters for roleplay, general assistance, security, math, long documents, efficiency and knowledge. A trained router selects which expert or experts to use for each token, or falls back to the base model when it finds no specialized match. The post says the adapters are not merged into the base model.
The team reports improvements over the untouched base on GSM8K, MATH-500 and GSM-Hard, a gain on LongBench-v2, and fewer generic AI-writing tics in creative writing. It gives no benchmark scores or further evaluation details. The team says the model, adapters, router and vLLM plugin are public; it identifies vLLM as the supported route and says GGUF is not yet available.
Written from coverage as of