Logging traces
Another method to upload datasets is by logging traces of your application. This involves setting up a tracer to monitor your application. Follow these steps:
Set up a tracer to monitor your application:
In case you see an error around tenacity v9.0.0 on executing tracer.start(), retry the same after using the following command (ignore in absence of error):
Click here to open the companion notebook in Google Colab
Once the tracer has successfully started, execute your RAG Langchain code. You can find a sample RAG code in this Colab project. Your OpenAI API key will be required to run this example.
Once traces have been logged using your code, stop the tracer and check its status:
If successful, you can view the logged dataset by navigating to Project_Name -> Logs.
In order to run metrics on traced logs, Catalyst requires users to create a sub-dataset as follows:
You can also do this on the Catalyst UI by navigating to Project_Name -> Logs and clicking on the "Create Dataset" button.
In the dialog box that pops up, users can create a sub-dataset from the traced logs by filtering on metadata, human feedback, prompt length, and time as shown:
Your sub-dataset is now created and can be used for further experiments and analysis within RagaAI Catalyst.
Last updated