Multiple Prompt Playground

Recommended read: Single Prompt Playground

The Multiple Prompt Playground provides a versatile platform for experimenting with and managing multiple prompts simultaneously. It’s designed to enhance your workflow by allowing you to run, compare, and fine-tune several prompts in parallel.

Step-by-Step Guide to Using the Multiple Prompt Playground in RagaAI Catalyst

1. Access the Multiple Prompt Playground:

• Open the "Prompt Playground" inside the Project.

• Select the "Multiple" tab to enter the Multiple Prompt Playground.

1. Initiate Multiple Prompts:

• Click the "New Prompt" button to start creating a new prompt template.

• Repeat this step for each additional prompt you wish to test simultaneously.

1. Run and Compare Multiple Prompts:

• Use the “Run Prompt + Eval” button to execute all prompts simultaneously.

• Analyze the results in the “Result” and “Evaluation” tabs to compare outputs side-by-side.

• This comparison helps you identify which prompt or model configuration yields the best results.

1. Test Multiple Model Configurations:

• For each prompt, select different model configurations to see how they perform.

• In case you have configured a custom gateway (details here), the value of the "model" key provided by you should also populate in the model dropdown, and can be used for inferencing here.
• Fine-tune your prompts by adjusting settings and re-running them to optimize performance.

1. Save and Version Your Prompts:

• After refining your prompts, click the “Commit” button for each to save your work.

• Enter a descriptive commit message to track the changes or purpose of each version.

• Committed prompts are saved within RagaAI Catalyst’s system for future reference or iteration.

Until you commit your prompts, they will not be permanently saved in the playground. You can commit your prompts individually at any time by clicking the “Commit” button.