Detect Redundancy

Spot redundant outputs in AI responses. Optimize for efficiency and clarity in generated content.

Objective This metric detects and removes redundant or repetitive content, ensuring concise and clear responses.

Interpretation A higher score indicates the response contains excessive repetition. A lower (or zero) score indicates the response is concise and non-repetitive.

Code Execution

metrics = [
    {
        "name": "Detect Redundancy",
        "config": {
            "model": "gpt-4o-mini",
            "provider": "openai"
        },
        "column_name": "your-column-identifier",
        "schema_mapping": schema_mapping
    }
]

Example

• Prompt: “Summarize the plot of ‘Pride and Prejudice.’”

• Context: “Keep it concise.”

• Response: “It’s a story about Elizabeth and Darcy. Elizabeth and Darcy are the main characters. Elizabeth and Darcy have misunderstandings. Elizabeth and Darcy…”

• Metric Output: {"score": 1, "reason": "Excessive repetition detected (Elizabeth and Darcy repeated multiple times)."}