Into:EvolAI
Decentralizing the LLM benchmark.
As of · Jun 4, 10:37 UTC
train language models and publish them to HuggingFace. score them on-chain. Best model wins the rewards.
What is EvolAI
EvolAI (SN47) is a Bittensor for competitive language model training. Miners train their own LLMs and publish them publicly on HuggingFace. Validators then evaluate those models and assign scores that determine reward distribution.
The simple version: It's like Kaggle for language models, but on a blockchain. Train a model, post it publicly, get scored by the network, earn rewards based on how your model performs.
Centralized equivalent: The Hugging Face Open LLM Leaderboard, or competitive benchmarking platforms like Kaggle.
How it works:
- Miners train language models using either a Transformer or Mamba2 architecture, publish them publicly on HuggingFace with "evolai" in the name, and register them on the subnet with a wallet and . Miners re-register each time they publish an updated model.
- Validators evaluate submitted models. The validator software requires a GPU with 80GB VRAM to run evaluations.
Why This Matters
- The problem it solves: Centralized LLM leaderboards are run by single teams. That creates a trust gap: who picks the benchmark tasks, who can game the eval? EvolAI moves that scoring process onto an incentivized validator network.
Other research from the same neighborhood of the network.
