A community post shares GGUF conversions of Multiverse Computing's Comet 60B (A12B) that run on stock llama.cpp and retain the MTP head for speculative decoding.
Key points
The Q4_K_M file is 42.6 GB; the Q8_0 file is 64.2 GB
The GGUFs are text-only; the vision tower was not converted
The MTP head can be used with llama-server's --spec-type draft-mtp option
The r/LocalLLaMA post says the converted files run on stock llama.cpp and retain the MTP head. It gives file sizes of 42.6 GB for Q4_K_M and 64.2 GB for Q8_0.
The post describes Comet as Multiverse Computing's compressed version of Nemotron 3.5 Super. It says the vision tower was not converted, so the GGUFs are text-only.