A user tests Liquid’s LFM3-1.7B for compression and summarization
, updated First seen Updated Limited coverage, tapering
Industry
Reported by r/LocalLLaMA1 source ↓
A LocalLLaMA community member tested Liquid’s LFM3-1.7B model on two GPU setups, reporting speed measurements and better coherence at longer prompts.
Key points
- The user tested the model for compression and summarization work
- They reported about 4,100 tokens per second prefill and 78 decode on a Strix Halo iGPU
- Tensor-splitting across two graphics cards yielded about 7,100 prefill and 151 decode
- The user said responses were more coherent at 32,000–64,000-token prompts
Details
A LocalLLaMA community member reported testing Liquid’s LFM3-1.7B in Q8_0 GGUF format with llama.cpp and ROCm. On a Strix Halo integrated GPU, the user measured about 4,100 tokens per second for prefill and 78 for decode; tensor-splitting across a 7900 XTX and XT produced about 7,100 and 151, respectively.
The user said the model was more coherent with prompts of 32,000–64,000 tokens. These are measurements and observations from one community post, not an independent evaluation.
Written from coverage as of