Mining Tasky Data

AI & ML interests

Mining Tasky Data

Recent Activity

craffel  authored a paper 10 days ago

TokSuite: Measuring the Impact of Tokenizer Choice on Language Model Behavior

craffel  authored a paper 6 months ago

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

craffel  authored a paper 7 months ago

The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text

View all activity

Team members 7