Create new project

Get started on evaluations by creating use-cases specific projects

Via UI:

Create New Project

To begin using RagaAI Catalyst, you need to create a new project. Follow these steps to create a project via the UI:

1. Navigate to the projects section in RagaAI Catalyst.

2. On the project page, click the Create New Project button.

3. In the popup window, enter a name for your project.

4. Select the use-case of your LLM Application from the dropdown. Currently supported use cases include:

   • Chatbot: For running chat-level evaluations on complete human-AI conversations

   • Text2SQL: For AI generated SQL-based response evaluations

   • Q/A (Default): Standard RAG prompt-context-response based evaluations

   • Code Generation: For evaluations on AI generated code

5. Click Done to finalise the creation of your new project.

Via SDK:

You can also create project using the Python SDK with the following command structure:

from ragaai_catalyst import RagaAICatalyst

project_name = 'your-project-name'
project = catalyst.create_project(
    project_name=project_name, 
    usecase="Chatbot" #default usecase Q/A
)

Supported 'usecase' values are as listed above, and case sensitive.

Once created, projects can be listed using the following command:

catalyst.list_projects()