> For the complete documentation index, see [llms.txt](https://docs.raga.ai/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.raga.ai/ragaai-catalyst/human-feedback-and-annotations.md).

# Human Feedback & Annotations

Collect human feedback on AI responses. Use annotations to refine and improve model performance.

**Human Feedback & Annotations** in **RagaAI Catalyst** empower teams to enrich AI evaluations with expert oversight, providing granular insights into correctness, quality, nuance, and domain-specific preferences. By combining human judgments with automated metrics, you get more reliable, high-quality model assessment and continuous improvement.

#### Why Human Feedback & Annotations Matter

* **Add qualitative nuance** where automated metrics fall short (e.g., nuance in tone, subjective quality, interpretability).
* **Validate model outputs** for sensitive use cases like customer support, legal, or brand-critical scenarios.
* **Enable data-driven training loops**—collect human annotations to fine-tune models, prompts, or retriever selections.
* **Support A/B comparisons** by embedding side-by-side human-rated performance evaluations.

{% content-ref url="/pages/G0jewSSOnDNXyzx1s04b" %}
[Thumbs Up/Down](/ragaai-catalyst/human-feedback-and-annotations/thumbs-up-down.md)
{% endcontent-ref %}

{% content-ref url="/pages/yYnGDpReVzTeLlXH6bby" %}
[Add Metric Corrections](/ragaai-catalyst/human-feedback-and-annotations/add-metric-corrections.md)
{% endcontent-ref %}

{% content-ref url="/pages/ZXFvYlQkegmMC7fzVMqy" %}
[Corrections as Few-Shot Examples](/ragaai-catalyst/human-feedback-and-annotations/corrections-as-few-shot-examples.md)
{% endcontent-ref %}

{% content-ref url="/pages/iPrqz5GhSgYHBRRVtN13" %}
[Tagging](/ragaai-catalyst/human-feedback-and-annotations/tagging.md)
{% endcontent-ref %}