Consistency
Objective: The test is intended to check the consistency of the model i.e if the model can generate similar answers on multiple runs w.r.t the prompt and response provided
Required Parameters: Prompt, Response
By default, 5 responses are generated
Interpretation: A higher score signifies model is more consistent in its response to the given prompt.
Last updated