Logging traces
Users can log traces from their real-time (production) applications by invoking the Catalyst Tracer from their SDK. This allows Catalyst to read inferences in real-time and log them for instant evaluations. This way, users can avoid downloading and uploading in batches.
The Catalyst Tracer can be enabled with the following commands:
In case you see an error around tenacity v9.0.0 on executing Tracer.start(), retry the same after using the following command (ignore in absence of error):
Once the tracer has successfully started, execute your RAG Langchain code. You can find a sample RAG code in this Colab project. Your OpenAI API key will be required to run this example, as with a real-time application.
Once traces have been logged using your code, stop the tracer and check its status:
If successful, you can view the logged dataset by navigating to Project_Name -> Dataset_Name
Metrics can be run on logged datasets in the same fashion as for CSV uploads.
Last updated