Heretic 2.0 released: Model modification for everyone
Reported by r/LocalLLaMA1 source ↓
Heretic’s developer announced the immediate release of Heretic 2.0, expanding the tool beyond censorship removal to support other model modifications. The release makes Arbitrary-Rank Ablation the default steering method and adds a plugin system for defining objectives.
Key points
- Heretic now supports custom model modifications, including suppressing sycophancy and changing emotional alignment
- Arbitrary-Rank Ablation replaces directional abliteration as the default steering method
- Scorer and modifier plugins let users define optimization goals and steering methods
- Old Heretic configurations are not compatible with the new release
Details
The developer describes Arbitrary-Rank Ablation as a method that modifies model matrices using an objective function and the L-BFGS optimizer, without limiting changes to a fixed-rank subspace. Classic abliteration remains available as an option. The developer says the method has been tested and refined with community contributions.
Heretic 2.0 adds scorer plugins to measure model behavior and modifier plugins to implement steering methods. The project includes scorers for refusal detection, benchmark results and classification using ModernBERT-type models; the developer says its refusal classifier is more accurate than keyword matching but slower.
The release also adds non-interactive operation, expands support to models with hyper-connections and improves support for thinking models. Heretic’s developer says the release is available immediately and that older configuration files need changes to work with it.
Written from coverage as of