Sentiment Analysis

Objective: The test provides a sentiment score for the model response

Required Parameters: Response

Interpretation: Higher score indicates the model response was positive, the test can be used to put a guard on negative sentiment responses from the model

• ** Example with higher score**:

  • Response: "The movie was good"

• ** Example with lower score**:

  • Response: "The movie was so bad that I have decided not to watch any further movies"

# Add tests with custom data
evaluator.add_test(
    test_names=["sentiment_analysis_test"],
    data={
        "response" : "The movie was good"
    },
    arguments={"model": "gpt-4", "threshold": 0},
).run()

evaluator.print_results()