LocalLLaMA user asks for coding-agent model suited to an 11GB GTX 1080 Ti
Reported by r/LocalLLaMA1 source ↓
A Reddit user is seeking a local model for coding tasks on a GTX 1080 Ti with 11GB of VRAM and 32GB of system RAM. They report mixed results with several models and ask for recommendations based on real coding work.
Key points
- The user wants a local builder agent to execute plans written by a separate API-based planner
- Their setup uses Debian 13, llama.cpp with Vulkan, an i7-10700K and a GTX 1080 Ti
- They report 7–10 tokens per second with Qwen3.6 35B A3B UD Q4_K_M
- They say Qwen3.5-9B-UD-Q4_K_XL ran at 25–30 tokens per second but did not work for their builder-agent use
- They are seeking a model, quantization and harness that can handle real coding tasks
Sources
Details
The LocalLLaMA post, dated November 7, 2026, asks for recommendations for a coding agent that can run locally on the author's hardware. The author says quality is the top priority, followed by speed and model size, and says a context window of 100,000 to 128,000 tokens would be desirable.
The author reports trying Qwen3.6 35B A3B UD Q4_K_M at about 7–10 tokens per second, but says testing was limited to a few small tasks. Qwen3.5-9B-UD-Q4_K_XL with MTP reportedly ran at about 25–30 tokens per second but was not suitable as a builder agent. The author also says two Sharp Spark models were unsuitable or limited to simple everyday tasks.
The post says CUDA is unstable on the GTX 1080 Ti: after tens of thousands of tokens, it can fail with a memory-space error. The author's current setup uses llama.cpp with Vulkan on Debian 13; the post does not report a recommended model or any responses establishing which option works best.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh