gsaltintas commited on
Commit
e61dfba
·
verified ·
1 Parent(s): 1ead6a2

Upload maddition_360/flexitok--maddition_jpn_Jpan_360_overlap.json with huggingface_hub

Browse files
maddition_360/flexitok--maddition_jpn_Jpan_360_overlap.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"1": {"ratio_to_total_tokens": 0.08333333333333333, "expected_training_ratio_in_superset": 0.0037878787878787884, "num_tokens": 30}, "2": {"ratio_to_total_tokens": 0.19722222222222222, "expected_training_ratio_in_superset": 0.01792929292929293, "num_tokens": 71}, "22": {"ratio_to_total_tokens": 0.7194444444444444, "expected_training_ratio_in_superset": 0.7194444444444444, "num_tokens": 259}, "total_training_compared_to_full_model": 0.7411616161616161}