> For the complete documentation index, see [llms.txt](https://docs.raga.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.raga.ai/ragaai-prism/metric-glossary.md).

# Metric Glossary

Quick definitions and explanations of the various metrics used within the RagaAI Testing Platform

1. #### F1Score:&#x20;

The F1score is the harmonic mean of precision and recall. It provides a balanced assessment of a model's performance by considering both false positives and false negatives. <br>

<figure><img src="https://lh7-us.googleusercontent.com/CL2gqggNdRR4jZlpw2cQFZTgQT_wN-mqPeosli8DeH3nbieAILbrrcyUoLu_S2UBnkWhzu3qoEQO55rHgsAUWbHpJLDyT_EGicsB0dXkkj6J6iH5BlkFlngc75fnnEJxI38-NVtON8rfDO2LtDHrNX-19Zc3V1Y4rAYx4x69GLPxKWpOKHQeXc6pu4BoGA" alt="" width="375"><figcaption></figcaption></figure>

Averaging Method: Computes a global average by counting the sums of true positive (TP), false negative (FN) and false positive (FP) using Confusion Matrix.

***

2. **Precision:**&#x20;

Precision is a measure of the accuracy of positive predictions made by the model.&#x20;

<figure><img src="https://lh7-us.googleusercontent.com/YyHYdaQnRkHJtcd1nIwU1Lv3byJTJeMda4MxvN89hfKQe90e5ZIMuHP9HsbnI_xNil2dHbNIuVwMlMWOw2QV0XeQDgWX7PwokOpKj27vTFSb2p3dtfSY7HpcuqlvsRh8STHwSaMK4kUE1k8rETaMMpiV_HJ_amRbR-LuJm9qRiybRYiy6i8u8b4fgekG8w" alt="" width="188"><figcaption></figcaption></figure>

Averaging Method: Computes a global average by counting the sums of true positive (TP) and false positive (FP) using Confusion Matrix.

***

3. **Recall:**&#x20;

Recall, also known as sensitivity, measures the ability of the model to correctly identify all relevant instances.&#x20;

<figure><img src="https://lh7-us.googleusercontent.com/QUy6EI8muui2CuRVwSMXP2hhEKaZNH4G6qAtA2f_bJ7-WhNulCmy6c63Qkw0MnCqHN26jlEuUQ8e_5UOp9CR4RjEvf2nPXhz2QwtH6EmYUzy8kKAe-q2VrR7nufqe2sF-hhOvWV7dN7GuP3UOWzomzoMEUAnwNGq9qf5z-mhxvKScB-E35RxK8LrUi_ekQ" alt="" width="188"><figcaption></figcaption></figure>

Averaging Method: Computes a global average by counting the sums of true positive (TP) and false negative (FN) using Confusion Matrix.

***

4. **Pixel Accuracy:**&#x20;

Pixel accuracy is a metric that measures the percentage of correctly classified pixels in the segmentation output. <br>

<figure><img src="https://lh7-us.googleusercontent.com/xS4pgHVdKTQhPoKt5931p3uU4SZJf3uHkudeiRvwuOU7Z5_QUIIz3xzHyfYtKtWirPpjfWxZ7OLcaf_S0iP7P9KDaxfenWsG6JJuUxWZuMh2TqGuUWduUliWMyoi66FHFfz57ZpWE_T3CVl0nWwna-QB7T8yyYVN_O5W0R0-UIuQ9tH5oFZEKLYjzDHYXw" alt="" width="188"><figcaption></figcaption></figure>

Averaging Method: Computes a global average by counting the sums of true positive (TP), true negative (TN), false negative (FN) and false positive (FP) using Confusion Matrix.

***

5. **mIoU:**&#x20;

mIoU (Mean Intersection over Union) is a popular metric for semantic segmentation that measures the average intersection over union (IoU) across all classes.&#x20;

<figure><img src="https://lh7-us.googleusercontent.com/KrHu_cVfvleBS22wjPUIRH5-4hhME7eOD4KW3hJgfbFniQ86ECZ4EgGbLgrbCK0rdNiqiV6uPRNmlHIYLty0V8UlkzqblYKYiFAbjY0gTrvJtxgDQ3O_FOATBctpXpLLdI-_Lhc2B3zKh81yEQecspDvPuw4gktw4-qUxGfLdlaWf81kp4yclzE8Kt4nwQ" alt="" width="188"><figcaption></figcaption></figure>

Averaging Method (IoU): Computes a global average by counting the sums of true positive (TP), false negative (FN) and false positive (FP) using Confusion Matrix.

Averaging Method (mIoU): Mean of IoU values for all classes.<br>

<figure><img src="https://lh7-us.googleusercontent.com/zTxQxJ-qpf0vbU13G0JN1pb1BXRkogRwPeby7awLasJzfoOTV_f-Nhbnd7SBRDRMXNXUv6DdHSCMQhYdcKTt0feyFQN4AZkiaGyCbBRGl6J9Ql95ecfMSTYuWLlfa3goqbJ5VPCtwIpSVQ_QQLXnLsg7M8yS9l1kCUV7JZrepNI2WUfhfh_FE6s8TxET5Q" alt="" width="375"><figcaption></figcaption></figure>

***

6. **wIoU:**&#x20;

wIoU (Weighted Intersection over Union) is a variation of mIoU that assigns different weights to different classes, giving more importance to certain classes in the evaluation.<br>

<figure><img src="https://lh7-us.googleusercontent.com/hApxKk_07-hV_SjjJW4Hz5PyFX5ye8WjpciVWuUn3_zJVtjBeWXUpKXvcTHFs8pE_jF3vLrq1iHuGELu1oScnhDJFQKSPxNzNKwfd5ZxQsqU5V1yg6afkLVgbfbeQE4_mg5UTBVbH10xctdytfbUNqP6o6BylX50656XwynEwGLfFVoGJi7JbsqrFzvsQg" alt="" width="375"><figcaption></figcaption></figure>

***

7. **Mahalanobis Distance:**&#x20;

Mahalanobis distance is a measure of the distance between a data point and a distribution. It is used to assess the similarity of test data to the training data distribution. A higher Mahalanobis distance may indicate that a data point is "out of distribution."

***

8. **Mistake Score:**&#x20;

Mistake Score is a metric designed to evaluate the quality and accuracy of labelled data within your semantic segmentation datasets. This score serves as a quantitative measure of the labelling errors or inaccuracies that may exist in your dataset.

***

9. **Distance Score:**&#x20;

Distance Score is used in Drift Detection (ROI) Multi Class cases. It is a metric designed to evaluate the correctness and drift from its respective class. This score serves as a quantitative measure of the classification error or inaccuracies that may exist in your dataset.

***

10. **Similarity Score**:&#x20;

The similarity score is used to determine the resemblance between two data entities. In the context of super-resolution, it measures how closely a high-resolution image matches its low-resolution counterpart. Scores closer to 1 indicate high similarity, while scores nearing 0 suggest less similarity.

***

11. **Area Percentage**:

The fraction of the area covered by a label in an image, used in semantic segmentation.

***

12. **BLEU (Bilingual Evaluation Understudy)**: BLEU is a metric for evaluating a translated text against one or more reference translations. It measures the similarity of the machine translations to human translations, focusing on the precision of n-grams (word sequences of n words) in the translated text.

***

13. **Cosine Similarity:** Cosine Similarity measures the cosine of the angle between two non-zero vectors in a multi-dimensional space. In text analysis, it is often used to determine the similarity between two text documents.

***

14. **METEOR (Metric for Evaluation of Translation with Explicit Ordering):** METEOR is a metric for evaluating machine translation output by considering the alignment between the candidate translation and a reference translation. It extends beyond precision by incorporating synonyms and stemming, and it aims for high recall by penalizing omissions.

***

15. **ROUGE (Recall-Oriented Understudy for Gisting Evaluation):** ROUGE is a set of metrics for evaluating automatic summarization and machine translation. It measures the overlap between the candidate text and reference texts using n-grams, word sequences, and word pair matches.

***
