Goal Decomposition Efficiency

Find out how well the agent pipeline is able to divide the complex task into manageable chunks and how well the task is delegated

Objective

This metric evaluates the efficiency and effectiveness of an AI system's ability to break down complex goals into manageable sub-tasks. It measures how well the AI decomposes a goal in a way that facilitates successful and efficient task execution.

Interpretation

A score closer to 1.0 indicates that the AI consistently creates optimal and efficient sub-tasks that lead to the successful accomplishment of the original goal. A score closer to 0.0 suggests that the AI's decomposition process is inefficient or ineffective, potentially hindering the achievement of the goal.

Syntax

# Goal Decomposition Efficiency
response = experiment_manager.execute(
    metrics=[
        {"name": "goal_decomposition_efficiency", "config": {"model": "gpt-4o-mini"}}
    ]
)