A pull request to ggml-org/llama.cpp proposes a CUDA change called flash_attn_ext_rows to fix unified KV handling for multiple sequences. A LocalLLaMA post describes it as a speedup but gives no measurements.
The pull request, by am17an, is titled “flash_attn_ext_rows” and targets ggml-org/llama.cpp. A November 2, 2026, post on r/LocalLLaMA says the change is intended to fix unified KV cache use with multiple sequences and describes it as a speedup. The post provides no benchmarks or information on whether the pull request was merged.