datablations

https://github.com/huggingface/datablations

Activity Feed Request to join this org

AI & ML interests

Scaling Data-Constrained Language Models

models 38

datablations/lm1-2b8-55b-oscartasky

Updated Jun 24, 2023

datablations/lm1-2b8-55b-tasky

Updated Jun 13, 2023

datablations/lm1-8b7-178b-c4-repetitions

Updated May 30, 2023

datablations/lm1-8b7-178b-oscar-repetitions

Updated May 30, 2023 • 1

datablations/lm1-misc

Updated May 30, 2023

datablations/lm1-4b2-84b-c4-repetitions

Updated May 30, 2023

datablations/lm1-2b8-55b-c4-perplexity

Updated May 26, 2023

datablations/lm1-misc-pile

Updated May 25, 2023

datablations/lm1-2b8-55b-c4-repetitions

Updated May 20, 2023

datablations/lm1-misc-oscar

Updated May 20, 2023

datasets 13

datablations/scripts

Viewer • Updated Jun 15, 2023 • 3.48M • 2.19k

datablations/oscar-subsets

Viewer • Updated Jun 14, 2023 • 365k • 841

datablations/c4-subsets

Viewer • Updated Jun 14, 2023 • 729k • 1.04k • 5

datablations/c4-filter-megatron

Updated May 28, 2023 • 485

datablations/oscar-filter-megatron

Updated May 27, 2023 • 234

datablations/python-megatron

Updated May 22, 2023 • 1.9k • 1

datablations/subsets

Viewer • Updated May 10, 2023 • 365k • 61

datablations/oscar-filter

Viewer • Updated May 10, 2023 • 432M • 6.92k

datablations/oscar-dedup-expanded

Viewer • Updated May 10, 2023 • 432M • 5.28k

datablations/mup

Updated Apr 24, 2023 • 1.04k

View 13 datasets