Tag
This paper introduces Reference Abstraction (RA), Summary Abstraction (SA), and Abstraction Ratio (AR) metrics to quantify abstractiveness in text summarization, using harmonic mean of document lengths and cubic non-overlap factor. Empirical evaluation on XSUM with four models shows the metrics effectively discriminate between extractive and abstractive summaries, and flag potential hallucination.