Detect Redundancy

Objective This metric detects and removes redundant or repetitive content, ensuring concise and clear responses.

Interpretation A higher score indicates the response contains excessive repetition. A lower (or zero) score indicates the response is concise and non-repetitive.

Code Execution

metrics = [
    {
        "name": "Detect Redundancy",
        "config": {
            "model": "gpt-4o-mini",
            "provider": "openai"
        },
        "column_name": "your-column-identifier",
        "schema_mapping": schema_mapping
    }
]

Example

• Prompt: “Summarize the plot of ‘Pride and Prejudice.’”

• Context: “Keep it concise.”

• Response: “It’s a story about Elizabeth and Darcy. Elizabeth and Darcy are the main characters. Elizabeth and Darcy have misunderstandings. Elizabeth and Darcy…”

• Metric Output: {"score": 1, "reason": "Excessive repetition detected (Elizabeth and Darcy repeated multiple times)."}