> For the complete documentation index, see [llms.txt](https://docs.raga.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.raga.ai/ragaai-catalyst/ragaai-metric-library/text-summarization.md).

# Text Summarization

Evaluate LLM-generated summaries for accuracy and readability. Learn to refine summarization for clarity and completeness.

{% hint style="info" %}
Exclusive to enterprise customers. [Contact us](https://calendly.com/nirmalya-raga/30min?month=2025-09) to activate this feature.
{% endhint %}

RagaAI provides several metrics for evaluating text summarization tasks, divided broadly into metrics based on N-gram overlap suited for extractive tasks (e.g, ROUGE, METEOR, BLEU) vs those using embeddings and LLM-as-a-judge suited for abstractive tasks (e.g, G-Eval, BERTScore, etc.). Here is a list of available metrics:

{% content-ref url="/pages/RpWMM3V6psL182RSwl84" %}
[Broken mention](broken://pages/RpWMM3V6psL182RSwl84)
{% endcontent-ref %}

{% content-ref url="/pages/yFh067y7q0WL0etqbDFV" %}
[Broken mention](broken://pages/yFh067y7q0WL0etqbDFV)
{% endcontent-ref %}

{% content-ref url="/pages/HO6h3UBaSULC8kUnBm6k" %}
[Broken mention](broken://pages/HO6h3UBaSULC8kUnBm6k)
{% endcontent-ref %}

{% content-ref url="/pages/Ozx4ppSdJm7uQmYJOqHI" %}
[Broken mention](broken://pages/Ozx4ppSdJm7uQmYJOqHI)
{% endcontent-ref %}

{% content-ref url="/pages/CzohjlIk628nXIwuGWWz" %}
[Broken mention](broken://pages/CzohjlIk628nXIwuGWWz)
{% endcontent-ref %}

{% content-ref url="/pages/Dj4u2n0Z9iAamyYHZJA0" %}
[Broken mention](broken://pages/Dj4u2n0Z9iAamyYHZJA0)
{% endcontent-ref %}

Additionally, Catalyst offers certain Summarization metrics that do not require LLM-as-a-judge for computation, including:

{% content-ref url="/pages/w4uFBzojEwbjqUFhxbKg" %}
[Broken mention](broken://pages/w4uFBzojEwbjqUFhxbKg)
{% endcontent-ref %}

{% content-ref url="/pages/6hVvv0LXqKwj2WhnEvKa" %}
[Broken mention](broken://pages/6hVvv0LXqKwj2WhnEvKa)
{% endcontent-ref %}

{% content-ref url="/pages/zNS8MPqLsOoF0kJyovbx" %}
[Broken mention](broken://pages/zNS8MPqLsOoF0kJyovbx)
{% endcontent-ref %}

{% content-ref url="/pages/xD46tTWcbe6rn5OlBy59" %}
[Broken mention](broken://pages/xD46tTWcbe6rn5OlBy59)
{% endcontent-ref %}