Create new project

Get started on evaluations by creating use-cases specific projects

Via UI:

Create New Project

To begin using RagaAI Catalyst, you need to create a new project. Follow these steps to create a project via the UI:

  1. Navigate to RagaAI Catalyst.

  2. On the project page, click the Create New Project button.

  3. In the popup window, enter a name for your project.

  4. Select the use-case of your LLM Application from the dropdown. Currently supported use cases include:

    • Chatbot: For running chat-level evaluations on complete human-AI conversations

    • Text2SQL: For AI generated SQL-based response evaluations

    • Q/A (Default): Standard RAG prompt-context-response based evaluations

    • Code Generation: For evaluations on AI generated code

  5. Click Done to finalise the creation of your new project.

Via SDK:

You can also create project using the Python SDK with the following command structure:

from ragaai_catalyst import RagaAICatalyst

project_name = 'your-project-name'
project = catalyst.create_project(
    project_name=project_name, 
    usecase="Chatbot" #default usecase Q/A
)

Supported 'usecase' values are as listed above, and case sensitive.

Once created, projects can be listed using the following command:

catalyst.list_projects()

Last updated