Gentrace Chat is a powerful agent that allows you to explore traces and experiments and create derivations (monitoring rules for errors). Right now, Gentrace Chat is in beta. We’re working on adding more features and improving the agent’s capabilities.

How to use Gentrace Chat

Gentrace Chat is available in the Gentrace UI by pressing the chat icon in the top right of the page.

Capabilities

Gentrace Chat is able to:

Prompts

Consider using the following prompts in Gentrace Chat:
Look at a few traces, find issues, and suggest derivations
Did a trace fail? If yes, why?
Create a monitoring column for the number of failed tool calls
Show the total number of LLM calls, input tokens, and output tokens across the entire trace
Create an LLM-as-judge column comparing the factualness of expected outputs to the actual outputs in an experiment