Crowd-v1 - The collaborative LLM
Reported by r/LocalLLaMA1 source ↓
The CrowdGPT project says it is working toward a collaboratively trained 1-billion-parameter model, Crowd-v1, using volunteer computing. Its organizers report 85 registered contributors and 13 billion tokens trained in a week, but say the project remains a work in progress.
Key points
- CrowdGPT aims to train a 1-billion-parameter model without datacenters or funding
- Organizers say 85 contributors registered and 13 billion tokens were trained in a week
- The stated benchmark goal is to match or exceed Qwen3-0.6B
- The project says its code is open source and accepts data submissions
Details
In a post on r/LocalLLaMA, the CrowdGPT project described Crowd-v1 as a planned 1-billion-parameter transformer trained collaboratively without datacenters. The project says its goal is to demonstrate that volunteer resources can produce a competitive language model without large GPU clusters or millions of dollars.
The organizers report that 85 people had registered as contributors and that 13 billion tokens were trained in a week, citing results since an earlier post. They say Crowd-v1 is intended to match or exceed Qwen3-0.6B on benchmarks; the post does not report benchmark results for Crowd-v1.
The project says its code is available on GitHub for inspection and that people can submit data for possible use. It describes the work as in progress and says future model sizes would depend on community participation.
Written from coverage as of