Sentiment Analysis
Objective: The test provides a sentiment score for the model response
Required Parameters: Response
Interpretation: Higher score indicates the model response was positive, the test can be used to put a guard on negative sentiment responses from the model
** Example with higher score**:
Response: "The movie was good"
** Example with lower score**:
Response: "The movie was so bad that I have decided not to watch any further movies"
# Add tests with custom data
evaluator.add_test(
test_names=["sentiment_analysis_test"],
data={
"response" : "The movie was good"
},
arguments={"model": "gpt-4", "threshold": 0},
).run()
evaluator.print_results()
Last updated
Was this helpful?