Pythia models supervised finetuned and DPO finetuned with all of Anthropic-hh-rlhf dataset for 1 epoch.
Laura O'Mahony
lomahony
AI & ML interests
PhD student
Recent Activity
updated
a Space
8 days ago
lomahony/First_agent_template
new activity
8 months ago
lomahony/pythia-1.4b-helpful-sft:Adding `safetensors` variant of this model
new activity
12 months ago
lomahony/pythia-410m-helpful-sft:Adding `safetensors` variant of this model
Organizations
None yet
models
42
lomahony/pythia-1.4b-helpful-sft
Text Generation
•
1B
•
Updated
•
98
lomahony/pythia-410m-helpful-sft
Text Generation
•
0.4B
•
Updated
•
7
lomahony/pythia-70m-helpful-sft
Text Generation
•
70.4M
•
Updated
•
7
lomahony/pythia-1b-helpful-sft
Text Generation
•
1B
•
Updated
•
18
lomahony/pythia-160m-helpful-sft
Text Generation
•
0.2B
•
Updated
•
6
lomahony/pythia-1b-helpful-dpo
Text Generation
•
Updated
•
14
lomahony/pythia-70m-helpful-dpo
Text Generation
•
Updated
•
6
lomahony/pythia-160m-helpful-dpo
Text Generation
•
Updated
•
7
lomahony/pythia-1.4b-helpful-dpo
Text Generation
•
Updated
•
7
lomahony/pythia-2.8b-helpful-dpo
Text Generation
•
Updated
•
7
datasets
0
None public yet