Developer adds local speech tools to apple-llm using built-in Mac capabilities
Reported by r/LocalLLaMA1 source ↓
Version 0.3 of apple-llm adds text-to-speech and speech recognition using macOS features. The developer reports that on an M4 MacBook Air, 30 minutes of speech rendered in 18 to 20 seconds.
Key points
- Version 0.3 adds local text-to-speech and speech recognition to apple-llm
- The developer reports 30 minutes of speech rendered in 18 to 20 seconds on an M4 MacBook Air
- The package supports Node.js and Python and includes local HTTP audio endpoints
- It requires macOS 26 or later on Apple Silicon and Xcode Command Line Tools
- Language detection is not automatic, and some audio formats are unsupported
Details
The package uses system voices and Apple's speech recognition, with audio processing on the Mac, according to its developer. It also adds a voice assistant example that connects microphone input, an on-device language model and spoken replies.
The developer reports that rendering 30 minutes of speech took 18 to 20 seconds on an M4 MacBook Air running macOS 27.2, using about 50 MB of memory. The same setup transcribed 30 minutes of audio in about 28 seconds; the developer says word-level timestamps are available.
The package is available through npm and pip, and its local server supports OpenAI-compatible speech endpoints. The developer says it requires macOS 26 or later on Apple Silicon; they have tested it on macOS 27.2 and have not tested microphone use with a person speaking in a noisy room.
Written from coverage as of
Stocks in this story
Change since open: 20 Nov to 21 Nov 2026
Last refresh