Developer patches Strata to reduce DeepSeek V4.1 agent prompt-processing delays
Reported by r/LocalLLaMA1 source ↓
A community developer says a Strata patch reduces repeated prompt processing for DeepSeek V4.1 agent sessions on a locally run gaming PC. The patch is unmerged and has only been tested on AMD HIP hardware.
Key points
- The patch reuses cached prompt content and limits prompt reads to experts already in VRAM or RAM
- The setup runs DeepSeek V4.1 Flash offline across GPU memory, system RAM and an SSD
- The developer tested it on an AMD RX 9070 XT; CUDA, SYCL and Metal are untested
- The author reports no change in one hard-coding test, but says there was no formal evaluation
Details
The r/LocalLLaMA post describes a patch to the Strata inference engine for DeepSeek V4.1 Flash. On the author's system—an RX 9070 XT with 16 GB of VRAM, 64 GB of DDR4 RAM and a PCIe 3.0 NVMe drive—the model runs offline with experts distributed across GPU memory, RAM and storage. The author says generation was about 7 tokens per second, but that new OpenCode sessions took about 100 seconds to read a roughly 37,000-token system prompt before producing a first token.
The patch has two parts. One aligns new prompts with saved conversations and reuses cached content, reading changed lines and the user's message; the other routes prompt-reading work to experts already in VRAM or RAM instead of streaming experts from the SSD. The author says the changes can alter answers, and describes the prompt splice as approximate because later tokens were computed with removed text still in context.
The post says testing was limited to HIP on AMD gfx1201; the author has not built or tested CUDA, SYCL or Metal versions. In one hard-coding test, the score was 12 out of 13 both with and without the changes, which the author says is not a formal evaluation. The patch is available in a Strata branch, with both changes enabled by default there; the post does not say they have been merged upstream.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh