Leaderboard
SomBench rankings
How models perform across core Somali NLP tasks.
Preview benchmarks. Scores below are from internal SomBench v0.1 runs. Public model weights and reproducible eval scripts are releasing soon.
| # | Model | Params | Overall score |
|---|---|---|---|
| 1 | goobo-baseSomali-native Goobo Labs | 125M | 52.4 |
| 2 | afroXLMR-large Masakhane | 561M | 44.1 |
| 3 | mDeBERTa-v3-base Microsoft | 86M | 38.7 |
| 4 | XLM-RoBERTa-base Meta AI | 125M | 35.1 |
| 5 | mBERT Google | 110M | 32.4 |
Scores are internal SomBench v0.1 preview averages on a held-out test set. Higher is better. Submit your model via the contact form.
Build with us
Build Somali AI in the open
Use our datasets and models, contribute to the research, or partner with the lab. Everything we can open, we do.
GooboLabs
976+
GitHub stars
490+
Forks
269+
Contributors