In Gentrace, error analysis refers to the process of discovering, monitoring, and alerting on errors that happen in both your production agent and in local / test time. As a pre-requisite for error analysis, ensure you are receiving either:
  • traces from your local or production agent
  • experiments from your evaluation infrastructure
Then,
  1. ask Gentrace chat to explore your traces and experiments
  2. have chat create derivations, monitoring rules for errors
  3. configure alerting to be notified of errors