A physical commonsense reasoning benchmark for 100+ languages, written in collaboration with 300+ researchers from 65 countries.
Catherine Arnett
catherinearnett
AI & ML interests
multilingual NLP, tokenization
Recent Activity
upvoted an article 2 days ago
FineBooks: are open OCR models good enough to unlock historical knowledge? updated a dataset 7 days ago
catherinearnett/low_resource_clean updated a dataset 7 days ago
catherinearnett/multiblimp_egy_normalizedOrganizations
Multilingual Leaderboards
Leaderboards for languages other than English
- Runtime errorAgents76
La Leaderboard
🌸76Evaluate open LLMs in the languages of LATAM and Spain.
- Running on CPU UpgradeAgents127
Open Chinese LLM Leaderboard
🏆127Explore LLM benchmark leaderboards and submit your model
- Running on CPU UpgradeAgents184
Open Arabic LLM Leaderboard
🏆184Track, rank and evaluate open Arabic LLMs and chatbots
- Build errorAgents40
OpenLLM French leaderboard 🇫🇷
🥇40Explore and submit LLM benchmarks
Low Resource Language Datasets
B-GPT
Bilingual GPT-2 models with checkpoints
-
catherinearnett/B-GPT_en_nl_simultaneous
Text Generation • 0.1B • Updated • 66 -
catherinearnett/B-GPT_nl_en_simultaneous
Text Generation • 0.1B • Updated • 62 -
catherinearnett/B-GPT_en_nl_sequential
Text Generation • 0.1B • Updated • 52 -
catherinearnett/B-GPT_nl_en_sequential
Text Generation • 0.1B • Updated • 46
Monolingual Models with Checkpoints
Global PIQA
A physical commonsense reasoning benchmark for 100+ languages, written in collaboration with 300+ researchers from 65 countries.
B-GPT
Bilingual GPT-2 models with checkpoints
-
catherinearnett/B-GPT_en_nl_simultaneous
Text Generation • 0.1B • Updated • 66 -
catherinearnett/B-GPT_nl_en_simultaneous
Text Generation • 0.1B • Updated • 62 -
catherinearnett/B-GPT_en_nl_sequential
Text Generation • 0.1B • Updated • 52 -
catherinearnett/B-GPT_nl_en_sequential
Text Generation • 0.1B • Updated • 46
Multilingual Leaderboards
Leaderboards for languages other than English
- Runtime errorAgents76
La Leaderboard
🌸76Evaluate open LLMs in the languages of LATAM and Spain.
- Running on CPU UpgradeAgents127
Open Chinese LLM Leaderboard
🏆127Explore LLM benchmark leaderboards and submit your model
- Running on CPU UpgradeAgents184
Open Arabic LLM Leaderboard
🏆184Track, rank and evaluate open Arabic LLMs and chatbots
- Build errorAgents40
OpenLLM French leaderboard 🇫🇷
🥇40Explore and submit LLM benchmarks
Monolingual Models with Checkpoints
Low Resource Language Datasets