What are vector embeddings? An interactive guide
Reported by r/LocalLLaMA1 source ↓
Machine learning engineer Abdur-Rahman Butler published an interactive guide to vector embeddings, with visualizations and a word-guessing game that runs in a web browser.
Key points
- The guide includes interactive examples of cosine similarity, semantic search, clustering and other embedding techniques
- Its SemanticGuessr game uses a 2D map of 43,339 common English words
- The browser game’s data payload is 12.3 MB after dimension reduction and 4-bit quantization
Details
Butler, an engineer at Isaacus, published the guide to explain vector embeddings through interactive visualizations. It also includes Python snippets covering techniques such as vectorization, hierarchical retrieval, zero-shot classification and deduplication.
The guide’s SemanticGuessr game asks players to draw a loop around a target word by making guesses on a two-dimensional word map. Butler says the game’s data was reduced from 311 MB to 12.3 MB through dimension reduction and quantization, with an approximately 6% impact on precision.
Written from coverage as of