feat: added vectors w/ description

.gitattributes

@@ -1,6 +1,7 @@
 *.7z filter=lfs diff=lfs merge=lfs -text
 *.arrow filter=lfs diff=lfs merge=lfs -text
 *.bin filter=lfs diff=lfs merge=lfs -text
+*.bin.* filter=lfs diff=lfs merge=lfs -text
 *.bz2 filter=lfs diff=lfs merge=lfs -text
 *.ftz filter=lfs diff=lfs merge=lfs -text
 *.gz filter=lfs diff=lfs merge=lfs -text
@@ -9,14 +10,10 @@
 *.lfs.* filter=lfs diff=lfs merge=lfs -text
 *.model filter=lfs diff=lfs merge=lfs -text
 *.msgpack filter=lfs diff=lfs merge=lfs -text
-*.npy filter=lfs diff=lfs merge=lfs -text
-*.npz filter=lfs diff=lfs merge=lfs -text
 *.onnx filter=lfs diff=lfs merge=lfs -text
 *.ot filter=lfs diff=lfs merge=lfs -text
 *.parquet filter=lfs diff=lfs merge=lfs -text
 *.pb filter=lfs diff=lfs merge=lfs -text
-*.pickle filter=lfs diff=lfs merge=lfs -text
-*.pkl filter=lfs diff=lfs merge=lfs -text
 *.pt filter=lfs diff=lfs merge=lfs -text
 *.pth filter=lfs diff=lfs merge=lfs -text
 *.rar filter=lfs diff=lfs merge=lfs -text
@@ -29,3 +26,6 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zstandard filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+*.bin filter=lfs diff=lfs merge=lfs -text
+*.floret filter=lfs diff=lfs merge=lfs -text
+*.vec filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,3 +1,47 @@
 ---
+tags:
+- spacy
+- floret
+- fasttext
+- feature-extraction
+- token-classification
+language:
+- hu
 license: cc-by-sa-4.0
+model-index:
+- name: hu_vectors_web_md
+  results:
+  - task:
+      name: Analogical questions
+      type: token-classification
+    metrics:
+    - name: Accuracy
+      type: accuracy
+      value: 0.1094
+    - name: MRR
+      type: mrr
+      value: 0.2107
+ 
 ---
+Hungarian word vectors for HuSpaCy. 
+
+The model is trained on the Hungarian Webcorpus 2.0 using floret with the following hyperparameters: `floret cbow -dim 100 -mode floret -bucket 200000 -minn 4 -maxn 6 -minCount 100 -neg 10 -hashCount 2 -lr 0.1 -thread 30 -epoch 5`
+
+Vectors are published in fasttext and floret format.
+
+| Feature | Description |
+| --- | --- |
+| **Name** | `hu_vectors_web_lg` |
+| **Version** | `1.0` |
+| **Vectors** | 200000 keys (300 dimensions) |
+| **Sources** | [Hungarian Webcorpus 2.0](https://hlt.bme.hu/en/resources/webcorpus2) (Dávid Márk Nemeskey (SZTAKI-HLT)) |
+| **License** | `cc-by-sa-4.0` |
+| **Author** | [SzegedAI, MILAB](https://github.com/huspacy/huspacy) |
+
+
+### Accuracy
+
+| Type | Score |
+| --- | --- |
+| `ACC` | 10.10 |
+| `MRR` | 0.1772 |

floret/floret_vectors.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c4db158aaf6311ececb55120a6db6715bff747d2763602859104030252ccb6fa
+size 1308880517

floret/floret_vectors.floret

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:de67b4b0955ce922c0eec1f89eeeb481bae1b980103b7b3acab4c8af55a6f3f3
+size 150872955

floret/floret_vectors.vec

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c36a7373ef3baef1983e02caffff655215b4d2db05347b0933e3fd4f4ce083cc
+size 1181547298