WollyMonjac’s Tiny 2.1 is a small question-answering transformer that runs under DOS on 486DX and Pentium PCs. It fits on a floppy and needs about 540 KB of free conventional memory.
Key points
Tiny 2.1 has 367,000 parameters across four layers and uses 380 KB
It was trained on about 3,500 facts, each phrased in multiple ways
The MIT-licensed distribution includes a training folder for adding knowledge
Tom’s Hardware reports that Tiny 2.1 is not a large language model, but a question-answering transformer written in Turbo C 2.0. Its 8-bit weights use one scale per row, and the program reads and writes one letter at a time.
The DOS program runs with about 540 KB of free conventional memory. Its interface includes conversation history, a neural monitor and an Ask Tiny prompt; responses can also be spoken in a PC-speaker robot voice. The project’s creator warns that it can confidently make things up.