Live-Swap CUDA Workloads: llama.cpp, ComfyUI, Strata & More
Reported by r/LocalLLaMA1 source ↓
Berth is an alpha GPU resource manager that queues and switches applications sharing GPU hardware. It is available as a single Go binary, with Linux NVIDIA support and experimental AMD Linux and Windows support.
Key points
- Berth manages GPU access through leases, priorities and a request queue
- Version 0.4.1 is in alpha
- Linux NVIDIA is supported; AMD Linux and Windows support is experimental
- The single Go binary requires no cloud account or separate monitoring service
Details
The project description says Berth manages which applications use a GPU and when, releasing memory and handing access to queued applications. It is designed to let AI models, image generators, voice engines, games and other GPU applications share hardware.
Berth can park supported engines in system RAM or use NVIDIA CUDA checkpointing to reduce repeated model loading. Its features also include GPU monitoring, local model management, an OpenAI-compatible gateway, ComfyUI workflow support and a web dashboard.
Berth supports managing multiple GPUs independently and includes tools for passing a GPU to a virtual machine and reclaiming it. The project is at alpha version 0.4.1; Linux NVIDIA support is listed as supported, while AMD Linux and Windows support are experimental.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh