Developer platform breaks down technical barriers with industry-first experimentation tool for cross-functional AI testing

LLM-as-a-judge evaluation uses an LLM to grade an output from an AI system, augmenting or replacing manual, human evaluation.

Gentrace suffered an evaluator outage that affected all customers who ran tests from Friday, July 26th at 1:42PM PT to Monday, July 29th at ~4:30 PM PT.

TLDR: A XSS vulnerability has been patched. We investigated and found no known affected users or recommended actions for Gentrace users.

AI hallucinations occur when an LLM returns incoherent and/or factually inaccurate information in response to a query.

One of the most common patterns in modern LLM development is Retrieval-Augmented Generation (RAG).

Over the course of 2023, you helped Gentrace grow from an internal tool to the generative AI evaluation platform for a number of technology companies building with generative AI.