LFM3 1.7b - Rather good
, updated First seen Updated Limited coverage, tapering
IndustryNVDA$125.53▼10.9%
Reported by r/LocalLLaMA1 source ↓
Key points
- The user reported testing LFM3 1.7B and its 2B vision-language model
- The 2B vision-language model was reported to have half the context length
- The user’s benchmark showed 20,648.61 tokens per second for prompt processing and 329.03 for generation
Details
The LocalLLaMA post reports running a quantized LFM3 1.7B model using CUDA on an NVIDIA RTX 3090 Ti. Its llama-bench results list 20,648.61 tokens per second for processing a 512-token prompt and 329.03 tokens per second for generating 128 tokens; these are results from the poster’s setup, not an independent evaluation.
The poster also said they tried the 2B vision-language model, describing it as good but saying it has half the context length of the 1.7B model. They asked how to use an omni model with a video file or YouTube link; the post does not report a method or test result for that use.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh