Instructions to use Aleksandar/electra-srb-ner with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Aleksandar/electra-srb-ner with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("token-classification", model="Aleksandar/electra-srb-ner")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForTokenClassification tokenizer = AutoTokenizer.from_pretrained("Aleksandar/electra-srb-ner") model = AutoModelForTokenClassification.from_pretrained("Aleksandar/electra-srb-ner", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Commit ·
3128e5f
1
Parent(s): 401f554
add model
Browse files- README.md +25 -15
- config.json +2 -8
- pytorch_model.bin +2 -2
- training_args.bin +1 -1
README.md
CHANGED
|
@@ -2,7 +2,7 @@
|
|
| 2 |
tags:
|
| 3 |
- generated_from_trainer
|
| 4 |
datasets:
|
| 5 |
-
-
|
| 6 |
metrics:
|
| 7 |
- precision
|
| 8 |
- recall
|
|
@@ -14,10 +14,14 @@ model_index:
|
|
| 14 |
- task:
|
| 15 |
name: Token Classification
|
| 16 |
type: token-classification
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
metric:
|
| 18 |
name: Accuracy
|
| 19 |
type: accuracy
|
| 20 |
-
value: 0.
|
| 21 |
---
|
| 22 |
|
| 23 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
@@ -25,13 +29,13 @@ should probably proofread and complete it, then remove this comment. -->
|
|
| 25 |
|
| 26 |
# electra-srb-ner
|
| 27 |
|
| 28 |
-
This model was trained from scratch on the
|
| 29 |
It achieves the following results on the evaluation set:
|
| 30 |
-
- Loss: 0.
|
| 31 |
-
- Precision: 0.
|
| 32 |
-
- Recall: 0.
|
| 33 |
-
- F1: 0.
|
| 34 |
-
- Accuracy: 0.
|
| 35 |
|
| 36 |
## Model description
|
| 37 |
|
|
@@ -56,16 +60,22 @@ The following hyperparameters were used during training:
|
|
| 56 |
- seed: 42
|
| 57 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 58 |
- lr_scheduler_type: linear
|
| 59 |
-
- num_epochs:
|
| 60 |
|
| 61 |
### Training results
|
| 62 |
|
| 63 |
-
| Training Loss | Epoch | Step
|
| 64 |
-
|:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
|
| 65 |
-
|
|
| 66 |
-
|
|
| 67 |
-
| 0.
|
| 68 |
-
| 0.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 69 |
|
| 70 |
|
| 71 |
### Framework versions
|
|
|
|
| 2 |
tags:
|
| 3 |
- generated_from_trainer
|
| 4 |
datasets:
|
| 5 |
+
- wikiann
|
| 6 |
metrics:
|
| 7 |
- precision
|
| 8 |
- recall
|
|
|
|
| 14 |
- task:
|
| 15 |
name: Token Classification
|
| 16 |
type: token-classification
|
| 17 |
+
dataset:
|
| 18 |
+
name: wikiann
|
| 19 |
+
type: wikiann
|
| 20 |
+
args: sr
|
| 21 |
metric:
|
| 22 |
name: Accuracy
|
| 23 |
type: accuracy
|
| 24 |
+
value: 0.95641898994996
|
| 25 |
---
|
| 26 |
|
| 27 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
|
|
| 29 |
|
| 30 |
# electra-srb-ner
|
| 31 |
|
| 32 |
+
This model was trained from scratch on the wikiann dataset.
|
| 33 |
It achieves the following results on the evaluation set:
|
| 34 |
+
- Loss: 0.3017
|
| 35 |
+
- Precision: 0.8911
|
| 36 |
+
- Recall: 0.9081
|
| 37 |
+
- F1: 0.8995
|
| 38 |
+
- Accuracy: 0.9564
|
| 39 |
|
| 40 |
## Model description
|
| 41 |
|
|
|
|
| 60 |
- seed: 42
|
| 61 |
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
|
| 62 |
- lr_scheduler_type: linear
|
| 63 |
+
- num_epochs: 10
|
| 64 |
|
| 65 |
### Training results
|
| 66 |
|
| 67 |
+
| Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1 | Accuracy |
|
| 68 |
+
|:-------------:|:-----:|:-----:|:---------------:|:---------:|:------:|:------:|:--------:|
|
| 69 |
+
| 0.2535 | 1.0 | 1250 | 0.2015 | 0.8494 | 0.8605 | 0.8549 | 0.9376 |
|
| 70 |
+
| 0.1461 | 2.0 | 2500 | 0.1853 | 0.8800 | 0.8681 | 0.8740 | 0.9464 |
|
| 71 |
+
| 0.0914 | 3.0 | 3750 | 0.2022 | 0.8695 | 0.8912 | 0.8802 | 0.9485 |
|
| 72 |
+
| 0.0545 | 4.0 | 5000 | 0.2214 | 0.8758 | 0.8975 | 0.8865 | 0.9514 |
|
| 73 |
+
| 0.0385 | 5.0 | 6250 | 0.2536 | 0.8806 | 0.9010 | 0.8907 | 0.9523 |
|
| 74 |
+
| 0.0266 | 6.0 | 7500 | 0.2506 | 0.8834 | 0.9020 | 0.8926 | 0.9539 |
|
| 75 |
+
| 0.0133 | 7.0 | 8750 | 0.2745 | 0.8910 | 0.9057 | 0.8983 | 0.9562 |
|
| 76 |
+
| 0.0077 | 8.0 | 10000 | 0.2946 | 0.8872 | 0.9065 | 0.8968 | 0.9559 |
|
| 77 |
+
| 0.0043 | 9.0 | 11250 | 0.2931 | 0.8902 | 0.9094 | 0.8997 | 0.9567 |
|
| 78 |
+
| 0.0022 | 10.0 | 12500 | 0.3017 | 0.8911 | 0.9081 | 0.8995 | 0.9564 |
|
| 79 |
|
| 80 |
|
| 81 |
### Framework versions
|
config.json
CHANGED
|
@@ -15,10 +15,7 @@
|
|
| 15 |
"3": "LABEL_3",
|
| 16 |
"4": "LABEL_4",
|
| 17 |
"5": "LABEL_5",
|
| 18 |
-
"6": "LABEL_6"
|
| 19 |
-
"7": "LABEL_7",
|
| 20 |
-
"8": "LABEL_8",
|
| 21 |
-
"9": "LABEL_9"
|
| 22 |
},
|
| 23 |
"initializer_range": 0.02,
|
| 24 |
"intermediate_size": 3072,
|
|
@@ -29,10 +26,7 @@
|
|
| 29 |
"LABEL_3": 3,
|
| 30 |
"LABEL_4": 4,
|
| 31 |
"LABEL_5": 5,
|
| 32 |
-
"LABEL_6": 6
|
| 33 |
-
"LABEL_7": 7,
|
| 34 |
-
"LABEL_8": 8,
|
| 35 |
-
"LABEL_9": 9
|
| 36 |
},
|
| 37 |
"layer_norm_eps": 1e-12,
|
| 38 |
"max_position_embeddings": 512,
|
|
|
|
| 15 |
"3": "LABEL_3",
|
| 16 |
"4": "LABEL_4",
|
| 17 |
"5": "LABEL_5",
|
| 18 |
+
"6": "LABEL_6"
|
|
|
|
|
|
|
|
|
|
| 19 |
},
|
| 20 |
"initializer_range": 0.02,
|
| 21 |
"intermediate_size": 3072,
|
|
|
|
| 26 |
"LABEL_3": 3,
|
| 27 |
"LABEL_4": 4,
|
| 28 |
"LABEL_5": 5,
|
| 29 |
+
"LABEL_6": 6
|
|
|
|
|
|
|
|
|
|
| 30 |
},
|
| 31 |
"layer_norm_eps": 1e-12,
|
| 32 |
"max_position_embeddings": 512,
|
pytorch_model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b7d8a1f36e88c5b01779347014202b894d16581de832b8ffd92fbe47819a491c
|
| 3 |
+
size 435672753
|
training_args.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 2671
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8f81507c71bf9458f8c2acc88833a1e325129d1e0909b54f2b6d8c75619cc011
|
| 3 |
size 2671
|