Lamplight - Lessons Learned from Building a Local-First Harness
Reported by r/LocalLLaMA1 source ↓
A r/LocalLLaMA user says their Lamplight setup coordinates a MacBook Pro and an RTX 5090 PC, handling about 95% of their AI use locally. The user shared benchmark results and lessons from tuning the system, but is not yet sharing the harness itself.
Key points
- The setup links an M5 Max MacBook Pro with 128 GB unified memory and an RTX 5090 PC with 64 GB RAM
- The author reports 48 of 50 tests passed across three complex coding tasks; two failures involved editing read-only files
- The author reports decode speeds of 302 tokens per second on the PC and 100 on the Mac
- The author says the custom harness is not yet available to others
Details
The r/LocalLLaMA author says Lamplight coordinates work between two computers, with one acting as orchestrator. The machines are a MacBook Pro with an M5 Max and 128 GB of unified memory, and a PC with an RTX 5090, Ryzen 7 9800X3D and 64 GB of RAM. The author says about 95% of their AI use now runs locally.
Both machines use Qwen 3.8 Flash-Next, according to the post. In the author's tests, the PC averaged 302 tokens per second decoding and the Mac 100; on a 36,000-token context, the reported speeds were 343 and 77 tokens per second, respectively. The author also reports that 48 of 50 tests passed across three complex coding tasks, with the two failures involving edits to files that were meant to remain read-only.
The author says tuning reduced the PC's power use and temperatures: the RTX 5090 went from 575 W and 83 °C to 471 W and 70 °C, while the CPU went from 120 W and 96 °C to 77 W and 70 °C. The post says the harness combines a precompiled Pi build, custom extensions and tools, Git worktrees, and an event-driven job system. The author is working to separate out parts that could be shared, but is not yet releasing the harness itself.
Written from coverage as of