# User Quickstart

{% embed url="<https://www.youtube.com/watch?v=fvVkg0APlrs>" %}

{% hint style="info" %}
This Quickstart section demonstrates steps to get started on the Catalyst UI. For users trying to run Catalyst from their SDK, equivalent commands for each step mentioned below can be found in [this](https://colab.research.google.com/drive/1-Os-m_DTSnvpUhvqNoGnuyOOII7ni9YT?usp=sharing) Google Colab project.
{% endhint %}

**1.Sign Up and Authentication**

**1.1 Sign Up**

* Start by signing up for an account @ [https://catalyst.raga.ai/](https://catalyst.raga.ai/signup)

**1.2 Setup API Keys for LLM Access**

To start running evaluations on RagaAI Catalyst, you need specify the API keys to your LLM models. Follow these steps to set your API keys:

1. Navigate to Settings -> API Keys.
2. Enter your API key against the relevant supported model names by clicking "Edit". You can also setup keys for your custom gateways under the 'custom parameters' section.&#x20;
3. Click "Save" to store the API Key(s).

<figure><img src="https://1811327582-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FYbIiNdp1QbG4avl7VShw%2Fuploads%2FQkHwMGrJSZa6OhWpaTM0%2FAPIKeyonCatalystPlatform-ezgif.com-video-to-gif-converter.gif?alt=media&#x26;token=cc3c016c-e770-4dfc-aad5-f0e8e9defd60" alt=""><figcaption></figcaption></figure>

**2.Create New Project**

Create a new project for testing your LLM Application by clicking the "Create New Project" button on the platform homepage

<figure><img src="https://1811327582-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FYbIiNdp1QbG4avl7VShw%2Fuploads%2FEdRe98NGCfsDJyJCHq9U%2FScreenshot%202024-09-30%20at%204.51.39%E2%80%AFPM.png?alt=media&#x26;token=a0bb81c2-fbdf-40a8-ae33-fbeac71bac36" alt=""><figcaption></figcaption></figure>

**3. Upload Dataset**

RagaAI Catalyst enables users to ingest data in two broad ways: real-time tracing and static uploads of data (CSV, Pandas, etc.). Here we'll upload a sample dataset via a CSV. For alternate methods, please refer to the [Uploading Data](https://docs.raga.ai/ragaai-catalyst/concepts/uploading-data) section.&#x20;

{% file src="<https://1811327582-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FYbIiNdp1QbG4avl7VShw%2Fuploads%2F7uEPOBqtsST1A0KOhymJ%2FSample_Dataset_RagaAI.csv?alt=media&token=af1dd27d-cc3f-4606-bedc-150a3e646c69>" %}

For further details on schema mapping and other CSV upload information, refer this [page](https://docs.raga.ai/ragaai-catalyst/concepts/uploading-data).

<figure><img src="https://1811327582-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FYbIiNdp1QbG4avl7VShw%2Fuploads%2FQzYdeHGtsLBEqEYF8Pic%2Fdataset1.gif?alt=media&#x26;token=b923762b-930a-4247-8b22-507936fab90a" alt=""><figcaption></figcaption></figure>

**4. Run Evaluations on the Datasets**

This can be implemented on the UI as follows. For further details on schema mapping and other evaluation related information, refer this [page](https://docs.raga.ai/ragaai-catalyst/concepts/running-ragaai-evals/executing-evaluations).

<figure><img src="https://1811327582-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FYbIiNdp1QbG4avl7VShw%2Fuploads%2FGSU4wuqehWAASp6BZuLK%2F3.datasetviewandrunmetric-ezgif.com-video-to-gif-converter.gif?alt=media&#x26;token=2839a36c-6333-4dc4-8cb6-ab282079539b" alt=""><figcaption></figcaption></figure>

* Check out the list of [Supported metrics](https://docs.raga.ai/ragaai-catalyst/ragaai-metric-library).

5. **View Results - Dataset, Analysis and Embedding View**

You can go over the results for individual datapoints in the dataset view. **\[Project > Dataset > Dataset]**

For each metric computed on a datapoint, users can refer to the "Reasoning" column inside the datapoint view to understand the logic behind its calculation:

<figure><img src="https://1811327582-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FYbIiNdp1QbG4avl7VShw%2Fuploads%2FPxDRzAqhmBcdAbrQV0iE%2F5.metricresultsanddatapointview-ezgif.com-video-to-gif-converter.gif?alt=media&#x26;token=335a61ec-e92b-43b3-9b83-93e08939ea0c" alt=""><figcaption></figcaption></figure>

The **Analysis** tab is located within the following path: **\[Project > Dataset > Analysis]**

This section allows you to:

* View insights related to various metrics and response columns.
* Toggle between different metrics for analysis.
* Add, customize, or remove graphs for deeper insight.

<figure><img src="https://1811327582-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FYbIiNdp1QbG4avl7VShw%2Fuploads%2Foq9HYYOEB8bNzeVqJEUW%2F6.analysistabandaddgraph-ezgif.com-video-to-gif-converter.gif?alt=media&#x26;token=6bbc0952-ffcb-4527-804a-8240ded8b8e3" alt=""><figcaption></figcaption></figure>

The **Embedding** tab is located within the following path: **\[Project > Dataset > Embedding]**

This section allows you to:

* Generate insights related to various metrics based on prompt embeddings
* Identify failure modes for the LLM application.&#x20;

<figure><img src="https://1811327582-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2FYbIiNdp1QbG4avl7VShw%2Fuploads%2FK3g0pDXmYb46YMzyP28A%2F7.generateandfilterembeddings-ezgif.com-video-to-gif-converter.gif?alt=media&#x26;token=2b75ccfc-efec-4430-8648-5b7c6d0ad990" alt=""><figcaption></figcaption></figure>
