Enable Custom Gateway
Run metric evaluations on your own LLM models, even if you use a custom gateway.
Last updated
Run metric evaluations on your own LLM models, even if you use a custom gateway.
Last updated
To enable your custom LLM gateway for metric evaluations on RagaAI Catalyst, you need to follow these steps:
Navigate to Settings -> API Keys and scroll down to the Custom Parameters section.
Enter the relevant deployment values for the following two custom key parameters:
api_base - Your relevant server link
model - Name of the model to be used for metric evaluation
Click "Add" to save the variables within your Catalyst instance
You are now ready to run evaluations using this gateway. Simply choose "custom_gateway" in the dropdown for "Model" when triggering your metric evaluations (learn how to run an evaluation here).
This action is currently supported on the UI only.
