deepseek-ai/deepseek-coder-7b-base-v1.5

Text Generation • 7B • Updated Feb 4, 2024 • 536 • 48

Note currently #1 with error rate of 0.353

deepseek-ai/deepseek-coder-1.3b-base

Text Generation • Updated Nov 14, 2023 • 25.8k • 109

Note # previous #1 error rate 0.38

Vipitis/santacoder-finetuned-Shadertoys-fine

Text Generation • 1B • Updated Dec 27, 2023 • 20

Note has noteable difference between fp16 and fp32, will need to run bf16 likely contaminated

Vipitis/santacoder-finetuned-Shadertoys

Text Generation • 1B • Updated Dec 15, 2023 • 6 • 2

Note likely contaminated

Deci/DeciCoder-1b

Text Generation • 1B • Updated Feb 15, 2024 • 1.15k • 248

Note current result is not fully correct, need to rerun model - however I don't know a transformers version that runs without errors

Salesforce/codegen2-1B_P

Text Generation • Updated Jan 31, 2025 • 3.49k • 41

Note needs rerun with incomplete_generation tag

microsoft/phi-2

Text Generation • 3B • Updated Dec 8, 2025 • 1.3M • 3.44k

Note performs the worst with error rate of 0.79

Note this space holds the evaluation metric that is used. It also has a usually up to date leaderboard. check for updates: https://huggingface.co/spaces/Vipitis/shadermatch/blob/main/result_preview.png