ISTA Qwen3.8 27b on 3060 12gb
Reported by r/LocalLLaMA1 source ↓
A LocalLLaMA user reports running ISTA-DASLab’s Qwen3.8-27B quantized model on an RTX 3060 with 12GB of VRAM, using a 65,536-token context and offloading the multimodal projector to system RAM.
Key points
- The user says the setup used an IQ3_XXS quant and TurboQuant for the context
- The user reports having 16GB of system RAM and offloading the multimodal projector to CPU memory
- The user says the model completed reasoning-heavy agent tasks on the device
Details
In a post on r/LocalLLaMA, a user described running the Qwen3.8-27B model from ISTA-DASLab on an RTX 3060 with 12GB of VRAM. They said they used an IQ3_XXS quant, TurboQuant, and a 65,536-token context, with the multimodal projector offloaded to CPU memory.
The user said their PC has 16GB of DDR4 RAM and that they had not been able to run Qwen3.8 Flash Next. They reported completing agent tasks that they characterized as requiring reasoning, but provided no benchmarks or independent verification.
Written from coverage as of