Source Citability

Exclusive to enterprise customers. Contact us to activate this feature.

Objective: The Source Citability Test checks whether the generated questions and the correct answer can be cited using specific chunk(s) from the source document. This test ensures that the response is directly supported by the source material, making it more reliable and credible. A higher score indicates higher citability.

Required Arguments:

• List of Chunks of Context: Sections of the context from the source document that contain the information that should support the generated questions and answers.

• Response Received: The questions and answers generated by the model that are being evaluated for citability.

• Threshold for Similarity Index: A parameter that determines the level of similarity required for the response to be considered citeable.

Score Range: 0 (low citability) to 1 (high citability)

Interpretation: A higher score suggests that the questions and answers generated by the model can be directly supported by the source document, making them more reliable for citation. A lower score would indicate that the response lacks sufficient support from the source, reducing its credibility.