Valid Python

Objective Validates if the text is valid Python code, ensuring executable and error-free scripts.

Interpretation A higher score indicates the code is invalid or contains errors. A lower (or zero) score indicates valid Python code.

Code Execution

metrics = [
    {
        "name": "Valid Python",
        "config": {
            "model": "gpt-4o-mini",
            "provider": "openai"
        },
        "column_name": "your-column-identifier",
        "schema_mapping": schema_mapping
    }
]

Example

• Prompt: “Provide a Python function that returns the sum of two numbers.”

• Context: “Ensure the code runs without syntax errors.”

• Response:

  pythonCopydef add_numbers(a, b):
      return a + b

• Metric Output: {"score": 0, "reason": "Valid Python code detected."}