Enable Custom Gateway

Run metric evaluations on your own LLM models, even if you use a custom gateway.

Via UI:

To enable your custom LLM gateway for metric evaluations on RagaAI Catalyst, you need to follow these steps:

1. Navigate to Settings -> API Keys and scroll down to the Custom Parameters section.

2. Enter the relevant deployment values for the following two custom key parameters:

   1. api_base - Your relevant server link

   2. model - Name of the model to be used for metric evaluation

3. Click "Add" to save the variables within your Catalyst instance

You are now ready to run evaluations using this gateway. Simply choose "custom_gateway" in the dropdown for "Model" when triggering your metric evaluations (learn how to run an evaluation here).

Via SDK:

This action is currently supported on the UI only.