A/B summary (cos vs gold)
Browse files
multilingual-e5-small-imatrix-ab.txt
ADDED
|
@@ -0,0 +1,5 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
imatrix A/B — multilingual-e5-small (cstr/multilingual-e5-small-GGUF), cos vs full-precision gold, n=5, calib=10
|
| 2 |
+
q8_0 imatrix=0 cos_vs_f16=0.999850 131.6MB -> (A/B only)
|
| 3 |
+
q4_k imatrix=0 cos_vs_f16=0.988593 121.0MB -> (A/B only)
|
| 4 |
+
q4_k imatrix=1 cos_vs_f16=0.989721 121.0MB -> multilingual-e5-small-q4_k-imatrix.gguf
|
| 5 |
+
iq4_xs imatrix=1 cos_vs_f16=0.992258 120.8MB -> multilingual-e5-small-iq4_xs.gguf
|