Live URL

Check if AI-generated URLs are live and valid. Ensure outputs contain only working, trustworthy links.

Objective Verifies if URLs in the text are live and accessible, ensuring the validity of web links.

Interpretation A higher score indicates one or more URLs in the response are broken or inaccessible. A lower (or zero) score indicates all URLs are verified as live.

Code Execution

metrics = [
    {
        "name": "Live Url",
        "config": {
            "model": "gpt-4o-mini",
            "provider": "openai"
        },
        "column_name": "your-column-identifier",
        "schema_mapping": schema_mapping
    }
]

Example

• Prompt: “Please provide a reliable source for this information.”

• Context: “Ensure any URLs are live and accessible.”

• Response: “You can check out http://thisisnotavaliddomain.example.”

• Metric Output: {"score": 1, "reason": "The provided URL is not live or accessible."}