Best Practices for Provisioning Local Inference to a Team?
Reported by r/LocalLLaMA1 source ↓
A LocalLLaMA user outlined a proposed company setup for team access to a Radiance inference server and asked how to manage the Hermes harness and third-party API credentials.
Key points
- The proposed setup uses Tailscale as the only route to the server over HTTPS
- Each team member would get a separate Hermes container with access to a shared skills repository
- Radiance runs on a separate server configured to accept access only through the Framework Desktop
- The user says handling API tokens for services such as Google is a key challenge
Details
The LocalLLaMA post describes a Radiance inference server built for the poster’s company. The poster plans to provide team access through Hermes, hosted on a Framework Desktop, with individual containers and access restrictions for users.
The proposed network setup would limit HTTPS access to Tailscale, and the separate Radiance server would be configured to accept connections only through the Framework Desktop. The poster asks how to make Hermes work across the team without the burden of collecting API tokens for services such as Google; the post does not report that the setup has been rolled out.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh