Audio embeddings inference in C++/GGML with clap.cpp
, updated First seen Updated Limited coverage, tapering
Industry
Reported by r/LocalLLaMA1 source ↓
A community developer says clap.cpp runs audio embedding inference in C++/GGML using GGUF models, with command-line, HTTP and language-binding interfaces.
Key points
- It supports CLAP, CLAP2, CLaMP3, MERT, MuQ and MuQ-MuLan models
- Interfaces include a CLI, an HTTP server, and Python, Rust and Node.js bindings
- It accepts WAV, MP3 and FLAC files, with automatic resampling and mono downmixing
- CLAP embeddings can be used to search audio files with text queries
Details
The developer says clap.cpp provides audio embedding inference in C++/GGML and uses GGUF models. Its HTTP server includes an endpoint that accepts an OpenAI-compatible text-embeddings request format.
The post demonstrates searching a set of audio files for the text query “dog” with a CLAP model; the returned results include file paths and similarity scores. The post does not report independent performance measurements or comparisons.
Written from coverage as of