Topic Coverage

Exclusive to enterprise customers. Contact us to activate this feature.

Objective: The Topic Coverage Test identifies whether there are sections of text in the context that are not represented in the response received. This test evaluates the extent to which the response covers the topics provided in the context. A higher score indicates more comprehensive coverage of the context.

Required Arguments:

• List of Chunks of Context: Sections of the context that contain the key information and topics that should be covered in the response.

• Response Received: The content generated by the model that is being evaluated for how well it covers the provided context.

Score Range: 0 (poor topic coverage) to 1 (high topic coverage)

Interpretation: A higher score suggests that the response effectively covers the topics outlined in the context, while a lower score indicates that there are gaps in the coverage, with some sections of the context not being represented in the response.