LLM-jp

university

https://llm-jp.nii.ac.jp/en/

AI & ML interests

None defined yet.

Recent Activity

AkimfromParis new activity about 17 hours ago

llm-jp/open-japanese-llm-leaderboard-v2:Duplicated Qwen3.6-27B row with contradictory scores, and 20 of 34 boards have an unseparated #1

speed updated a collection 1 day ago

Multi Modal Models

speed updated a dataset 1 day ago

llm-jp/Wiki-JA-Pair

View all activity

Papers

HakushoBench: A Japanese Chart and Table VQA Benchmark from Governmental White Papers

Jagle: Building a Large-Scale Japanese Multimodal Post-Training Dataset for Vision-Language Models

View all Papers

in llm-jp/open-japanese-llm-leaderboard-v2 about 17 hours ago

Duplicated Qwen3.6-27B row with contradictory scores, and 20 of 34 boards have an unseparated #1

#4 opened 3 days ago by

updated a collection 1 day ago

Multi Modal Models

9 items • Updated 1 day ago • 1

updated a dataset 1 day ago

llm-jp/Wiki-JA-Pair

Viewer • Updated 1 day ago • 1.02M • 28 • 1

in llm-jp/open-japanese-llm-leaderboard-v2 2 days ago

Stuck in Pending Evaluation Queue

#3 opened about 1 month ago by

updated 2 datasets 6 days ago

llm-jp/leaderboard-contents-v2

Viewer • Updated 6 days ago • 4 • 1.22k • 1

llm-jp/leaderboard-results-v2

Updated 6 days ago • 53

updated a dataset 7 days ago

llm-jp/leaderboard-requests-v2

Updated 6 days ago • 1.27k

updated a Space 26 days ago

Open Japanese LLM Leaderboard

Explore LLM benchmark rankings and submit your model for evaluation

published a dataset 27 days ago

llm-jp/msts-japanese

Viewer • Updated 27 days ago • 330 • 41

updated a dataset 27 days ago

llm-jp/msts-japanese

Viewer • Updated 27 days ago • 330 • 41

updated a dataset 28 days ago

llm-jp/AnswerCarefully

Viewer • Updated 28 days ago • 4.92k • 612 • 59

submitted a paper to Daily Papers about 1 month ago

CoffeeBench: Benchmarking Long-Horizon LLM Agents in Heterogeneous Multi-Agent Economies

Paper • 2606.16613 • Published Jun 15 • 9

authored a paper about 1 month ago

CoffeeBench: Benchmarking Long-Horizon LLM Agents in Heterogeneous Multi-Agent Economies

Paper • 2606.16613 • Published Jun 15 • 9

updated a collection about 1 month ago

LLM-jp-4 Models

7 items • Updated Jul 3 • 17

published 2 models about 1 month ago

llm-jp/llm-jp-4-32b-a3b-thinking-gguf

Text Generation • 32B • Updated Jun 22 • 2.34k • 6

llm-jp/llm-jp-4-8b-thinking-gguf

Text Generation • 9B • Updated Jun 22 • 997 • 13

updated 2 models about 1 month ago

llm-jp/llm-jp-4-8b-thinking-gguf

Text Generation • 9B • Updated Jun 22 • 997 • 13

llm-jp/llm-jp-4-32b-a3b-thinking-gguf

Text Generation • 32B • Updated Jun 22 • 2.34k • 6

in llm-jp/open-japanese-llm-leaderboard-v2 about 2 months ago

Cost + latency + hallucination evaluation for Japanese LLM selection

#2 opened about 2 months ago by