Spaces:
Sleeping
Sleeping
unbold for visibility
Browse files- README.md +1 -1
- harim_plus.py +1 -1
README.md
CHANGED
|
@@ -17,7 +17,7 @@ description: >-
|
|
| 17 |
|
| 18 |
|
| 19 |
# HaRiM+
|
| 20 |
-
|
| 21 |
<br />
|
| 22 |
HaRiM+ is reference-less metric for summarization task which hurls the power of summarization model to estimate the quality of the summary-article pair. <br />
|
| 23 |
Note that this metric is reference-free and do not require training. It is ready to go without reference text to compare with the generation nor any model training for scoring.
|
|
|
|
| 17 |
|
| 18 |
|
| 19 |
# HaRiM+
|
| 20 |
+
HaRiM+: Evaluating Summary Quality with Hallucination Risk, accepted at AACL-22 [paper](https://arxiv.org/abs/2211.12118). <br />
|
| 21 |
<br />
|
| 22 |
HaRiM+ is reference-less metric for summarization task which hurls the power of summarization model to estimate the quality of the summary-article pair. <br />
|
| 23 |
Note that this metric is reference-free and do not require training. It is ready to go without reference text to compare with the generation nor any model training for scoring.
|
harim_plus.py
CHANGED
|
@@ -30,7 +30,7 @@ _CITATION = """\
|
|
| 30 |
}
|
| 31 |
"""
|
| 32 |
|
| 33 |
-
_DESCRIPTION = f"""
|
| 34 |
Summarization model inside the HaRiM+ will read and evaluate how good the quality of a summary given the paired article.
|
| 35 |
It will work great for ranking the summary-article pairs according to its quality.
|
| 36 |
|
|
|
|
| 30 |
}
|
| 31 |
"""
|
| 32 |
|
| 33 |
+
_DESCRIPTION = f"""HaRiM+ is a reference-less evaluation metric (i.e. requires only article-summary pair, no reference summary) for summarization which hurls the power of summarization model.
|
| 34 |
Summarization model inside the HaRiM+ will read and evaluate how good the quality of a summary given the paired article.
|
| 35 |
It will work great for ranking the summary-article pairs according to its quality.
|
| 36 |
|