Logging traces (LlamaIndex, Langchain, etc.)
Users can log traces from their real-time (production) applications by invoking the Catalyst Tracer from their SDK. This allows Catalyst to read inferences in real-time and log them for instant evaluations. This way, users can avoid downloading and uploading in batches.
The Catalyst Tracer can be enabled with the following commands:
If successful, you can view the logged dataset by navigating to Project_Name -> Dataset_Name
Metrics can be run on logged datasets in the same fashion as for CSV uploads.
Last updated
Was this helpful?