Summarization
Transformers
PyTorch
English
t5
text2text-generation
t5-large-summarization
pipeline:summarization
Eval Results (legacy)
text-generation-inference
Instructions to use sysresearch101/t5-large-finetuned-xsum with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use sysresearch101/t5-large-finetuned-xsum with Transformers:
# Use a pipeline as a high-level helper # Warning: Pipeline type "summarization" is no longer supported in transformers v5. # You must load the model directly (see below) or downgrade to v4.x with: # pip install "transformers<5.0.0" from transformers import pipeline pipe = pipeline("summarization", model="sysresearch101/t5-large-finetuned-xsum")# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("sysresearch101/t5-large-finetuned-xsum") model = AutoModelForSeq2SeqLM.from_pretrained("sysresearch101/t5-large-finetuned-xsum", device_map="auto") - Notebooks
- Google Colab
- Kaggle
Add verifyToken field to verify evaluation results are produced by Hugging Face's automatic model evaluator
#4
by autoevaluator HF Staff - opened
README.md
CHANGED
|
@@ -1,11 +1,11 @@
|
|
| 1 |
---
|
| 2 |
language:
|
| 3 |
- en
|
|
|
|
| 4 |
tags:
|
| 5 |
- summarization
|
| 6 |
- t5-large-summarization
|
| 7 |
- pipeline:summarization
|
| 8 |
-
license: mit
|
| 9 |
model-index:
|
| 10 |
- name: sysresearch101/t5-large-finetuned-xsum"
|
| 11 |
results:
|
|
@@ -18,30 +18,36 @@ model-index:
|
|
| 18 |
config: 3.0.0
|
| 19 |
split: train
|
| 20 |
metrics:
|
| 21 |
-
-
|
| 22 |
-
type: rouge
|
| 23 |
value: <TODO>
|
|
|
|
| 24 |
verified: true
|
| 25 |
-
|
| 26 |
-
|
| 27 |
value: <TODO>
|
|
|
|
| 28 |
verified: true
|
| 29 |
-
|
| 30 |
-
|
| 31 |
value: <TODO>
|
|
|
|
| 32 |
verified: true
|
| 33 |
-
|
| 34 |
-
|
| 35 |
value: <TODO>
|
|
|
|
| 36 |
verified: true
|
| 37 |
-
|
| 38 |
-
|
| 39 |
value: <TODO>
|
|
|
|
| 40 |
verified: true
|
| 41 |
-
|
| 42 |
-
|
| 43 |
value: <TODO>
|
|
|
|
| 44 |
verified: true
|
|
|
|
| 45 |
- task:
|
| 46 |
type: summarization
|
| 47 |
name: Summarization
|
|
@@ -51,30 +57,36 @@ model-index:
|
|
| 51 |
config: default
|
| 52 |
split: test
|
| 53 |
metrics:
|
| 54 |
-
-
|
| 55 |
-
type: rouge
|
| 56 |
value: 26.8921
|
|
|
|
| 57 |
verified: true
|
| 58 |
-
|
| 59 |
-
|
| 60 |
value: 6.9411
|
|
|
|
| 61 |
verified: true
|
| 62 |
-
|
| 63 |
-
|
| 64 |
value: 21.2832
|
|
|
|
| 65 |
verified: true
|
| 66 |
-
|
| 67 |
-
|
| 68 |
value: 21.284
|
|
|
|
| 69 |
verified: true
|
| 70 |
-
|
| 71 |
-
|
| 72 |
value: 2.5411810874938965
|
|
|
|
| 73 |
verified: true
|
| 74 |
-
|
| 75 |
-
|
| 76 |
value: 18.7755
|
|
|
|
| 77 |
verified: true
|
|
|
|
| 78 |
---
|
| 79 |
|
| 80 |
# T5-large Summarization Model Trained on the XSUM Dataset
|
|
|
|
| 1 |
---
|
| 2 |
language:
|
| 3 |
- en
|
| 4 |
+
license: mit
|
| 5 |
tags:
|
| 6 |
- summarization
|
| 7 |
- t5-large-summarization
|
| 8 |
- pipeline:summarization
|
|
|
|
| 9 |
model-index:
|
| 10 |
- name: sysresearch101/t5-large-finetuned-xsum"
|
| 11 |
results:
|
|
|
|
| 18 |
config: 3.0.0
|
| 19 |
split: train
|
| 20 |
metrics:
|
| 21 |
+
- type: rouge
|
|
|
|
| 22 |
value: <TODO>
|
| 23 |
+
name: ROUGE-1
|
| 24 |
verified: true
|
| 25 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNmE1YjI2OWVjMGRiZWU3MjJhOTViMWIzNWU3MDNlZmFkMmNhZTFiN2RhOTc0ZjkyNzc5ZDg1YWZiZWFhMTEyZiIsInZlcnNpb24iOjF9.ye9137aCRynwSZM0YD2k4_LIcrRU4EyCRjBB8YQ0kUCImJyHNVFPFbbzObfLSM3XQ_tauALczriBCMJ7IGxeDQ
|
| 26 |
+
- type: rouge
|
| 27 |
value: <TODO>
|
| 28 |
+
name: ROUGE-2
|
| 29 |
verified: true
|
| 30 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiYWYzYzZlZTEwYThhYjJkYzE0MzA1ZjE2NDBiMDNjOTNlZWNjNmMxNDJiMDE4OTJhMjdhNGI3OWRiZjQ1M2RhOSIsInZlcnNpb24iOjF9.-6WOpeYKgyiQSvWIeCfJWWTzI8kt_Q5by31r-ceBF384NMf6APLA94jKpLdE2HDbDgUtuxF9LAHFz9jmhkqKCA
|
| 31 |
+
- type: rouge
|
| 32 |
value: <TODO>
|
| 33 |
+
name: ROUGE-L
|
| 34 |
verified: true
|
| 35 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiNDAxODg3ZjRlMmUwZTdjYmRmYTZhMzEwYTg4MmU4NmY2MmJlZTE5N2MxYjY4YmE4NGM0NDJkNDRiYjc2OTQwMSIsInZlcnNpb24iOjF9.iWTpIMKC2HGkJMYOQviXBnc-lj4pHLWVyfMXSfbz26s1KUi5gOD97eEaHeBmUW5IMs64dosTVa6xo3T-5_FdDA
|
| 36 |
+
- type: rouge
|
| 37 |
value: <TODO>
|
| 38 |
+
name: ROUGE-LSUM
|
| 39 |
verified: true
|
| 40 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMGU2YzFiMDRkOTc2OTFjMGI1MzA3MTgwMzczMjhkMTMxNzkyNDVlZGUzMGM3OTk4ODk0YjQ4MzRjYTVlNmZmNiIsInZlcnNpb24iOjF9.K1duMlA1zQpSiencBbbhpShckuvEb8zspnJG5jf1n65KmNY4Md3VA96ERKixUOIymnTo-gKyS9QEDKblPmR_Ag
|
| 41 |
+
- type: loss
|
| 42 |
value: <TODO>
|
| 43 |
+
name: loss
|
| 44 |
verified: true
|
| 45 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZDQ4MDI4MzgyOWUwYzI0YTE3MTE2ODdhYjU3MGE1MTg1NTU4OTM4NzlmYjE1MDY5M2Q2OTVkZjY4MzRlZTYzOCIsInZlcnNpb24iOjF9.5BMk4fs-oVoDNJnPBpDlSkywd3Qogat4_N8_IdS26AObm2i1blwonx4sy8l8RK50pq16bJbplBEEG-3HuTz9DQ
|
| 46 |
+
- type: gen_len
|
| 47 |
value: <TODO>
|
| 48 |
+
name: gen_len
|
| 49 |
verified: true
|
| 50 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiOTE4ZTAzNmYxMzE2NGYzYTM2MzMxNTNlN2M4YmJlOWI3ZWFkMGRlMTc5NGMzNjBlZjg1MjJhZDdlNDIwZTAwNyIsInZlcnNpb24iOjF9._JTVMjukkupE4_QWOQZZZVwmnXSh-ppo7jlGdk0CUxNIIVTStxQhex09O1H6-Ilk9dtYk1PVCNNg8alZAFHeDQ
|
| 51 |
- task:
|
| 52 |
type: summarization
|
| 53 |
name: Summarization
|
|
|
|
| 57 |
config: default
|
| 58 |
split: test
|
| 59 |
metrics:
|
| 60 |
+
- type: rouge
|
|
|
|
| 61 |
value: 26.8921
|
| 62 |
+
name: ROUGE-1
|
| 63 |
verified: true
|
| 64 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZmFkMTFiNmM3YmRkZDk1Y2FhM2EwOTdiYmUwYjBhMGEzZmIyZmIwNWI5OTVmY2U0N2QzYzgxYzM0OTEzMjFjNSIsInZlcnNpb24iOjF9.fOq4zI_BWvTLFJFQOWNk3xEsDIu3aAeboGYPw5TiBqdJJjvdyKmLbfj2WVnNboWbrmp1PuL01iJjTi2Xj6PUAA
|
| 65 |
+
- type: rouge
|
| 66 |
value: 6.9411
|
| 67 |
+
name: ROUGE-2
|
| 68 |
verified: true
|
| 69 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMTBlZmI3NjQ3M2JiYzI4MTg3YmJkMjg0ZmE5MDUwNzljNTYyM2M0NzA3YTNiNTA2Nzk4MDhhYWZjZjgyMmE1MCIsInZlcnNpb24iOjF9.rH0DY2hMz2rXaK29vkt7xah-3G95rY4MOS2oVKjXmw4TijB-ZVytfLJAlBmyqA8HYAythRCywmLSjjCDWc66Cg
|
| 70 |
+
- type: rouge
|
| 71 |
value: 21.2832
|
| 72 |
+
name: ROUGE-L
|
| 73 |
verified: true
|
| 74 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiODAwZDYzNTc0NjZhNzNiMDE2ZDY2NjNjNmViNTc0NDVjNTZkYjljODhmYmNiMWFhY2NkZjU5MzQ0NmM0OTcyMSIsInZlcnNpb24iOjF9.5duHtdjZ8dwtbp1HKyMR4mVK9IIlEZvuWGjQMErpE7VNyKPhMOT6Avh_vXFQz6q_jBzqpZGGREho1mt50yBsDw
|
| 75 |
+
- type: rouge
|
| 76 |
value: 21.284
|
| 77 |
+
name: ROUGE-LSUM
|
| 78 |
verified: true
|
| 79 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiMGQ2NmNhZTZmZDFkNTcyYjQ4MjhhYWJhODY1ZGRjODY2ZTE5MmRmZDRlYTk4NWE4YWM1OWY2M2NjOWQ3YzU0OCIsInZlcnNpb24iOjF9.SJ8xTcAVWrRDmJmQoxE1ADIcdGA4tr3V04Lv0ipMJiUksCdNC7FO8jYbjG9XmiqbDnnr5h4XoK4JB4-GsA-gDA
|
| 80 |
+
- type: loss
|
| 81 |
value: 2.5411810874938965
|
| 82 |
+
name: loss
|
| 83 |
verified: true
|
| 84 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZGViNTVlNGI0Njk4NmZmZjExNDBkNTQ4N2FhMzRkZjRjNDNlYzFhZDIyMjJhMmFiM2ZhMTQzYTM4YzNkNWVlNyIsInZlcnNpb24iOjF9.p9n2Kf48k9F9Bkk9j7UKRayvVmOr7_LV80T0ti4lUWFtTsZ91Re841xnEAcKSYgQ9-Bni56ldq9js3kunspJCw
|
| 85 |
+
- type: gen_len
|
| 86 |
value: 18.7755
|
| 87 |
+
name: gen_len
|
| 88 |
verified: true
|
| 89 |
+
verifyToken: eyJhbGciOiJFZERTQSIsInR5cCI6IkpXVCJ9.eyJoYXNoIjoiZmQ1ZWUxNmFjNmU0OGI4MDQyZDNjMWQwZGViNDhlMzE1OGE3YmYwYzZjYmM1NWEwMjk2MDFiMjQ4ZThhMjg5YyIsInZlcnNpb24iOjF9.aNp-NFzBSm84GnXuDtYuHaOsSk7zw8kjCphowYFciwt-aDnhwwurYIr59kMT8JNFMnRInsDi8tvYdapareV3DA
|
| 90 |
---
|
| 91 |
|
| 92 |
# T5-large Summarization Model Trained on the XSUM Dataset
|