URL Reachability

Check if generated URLs are reachable. Ensure AI outputs contain working, valid links.

Tests the reachability of the urls in the model response

Required arguments: prompt, response

Interpretation of results: Score 1 represents all the urls are valid, and 0 means they're invalid

Code Example:

prompt = '''What is the website for Netflix'''
response = '''Here is the official websites for Netflix:
Netflix:(www.netflix.com)'''

evaluator.add_test(
    test_names=["url_reachability_guardrail"],
    data={'prompt':prompt,
          'response': response,

    },

).run()
evaluator.print_results()