Developer ports Mamba-1 and PyTorch 2.7.1 to older NVIDIA GPUs on Windows
Reported by r/LocalLLaMA1 source ↓
A community developer says custom Windows builds support Mamba-1 on NVIDIA GPUs with compute capabilities SM 3.5–7.5, including a 2013 Tesla K40c. Mamba-2 and Mamba-3 are limited to Turing and newer GPUs.
Key points
- The custom PyTorch 2.7.1 build uses CUDA 11.8 and retains support for older GPU architectures
- Mamba-1 runs with native CUDA kernels across SM 3.5–7.5, the developer says
- A Tesla K40c test produced a maximum absolute error of 3.8e-06 versus the PyTorch reference
- Mamba-2 and Mamba-3 currently require Turing or newer GPUs; older cards fall back to Mamba-1
- The developer is seeking tests on Maxwell and Pascal GPUs
Details
The project, shared on r/LocalLLaMA, provides custom Windows builds of PyTorch 2.7.1, causal-conv1d 1.7.0, and Mamba-1 for NVIDIA GPUs from Kepler through Turing. It also includes Windows NCCL for multi-GPU training, according to the developer.
The developer reports that Mamba-1's native CUDA implementation was tested on a Tesla K40c, with a maximum absolute error of 3.8e-06 compared with the PyTorch reference implementation. Mamba-2 and Mamba-3 use Triton and TileLang and are currently supported only on Turing and newer; on older hardware, the package falls back to Mamba-1.
The developer says work to backport Mamba-2 and Mamba-3 to older GPUs is planned and is seeking community tests, particularly on Maxwell and Pascal cards.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh