Our Kubernetes-based architecture included several components that needed to be secured when deployed to customer environments. Learn how we improved self-hosted deployments by adopting Istio as our service mesh.

Gentrace's task queue system processes thousands of evaluation tasks daily. Learn how we simplified our task queue architecture by using PostgreSQL.

Developer platform breaks down technical barriers with industry-first experimentation tool for cross-functional AI testing

Today, we're announcing: $8M in Series A funding led by Kojo Osei at Matrix Ventures and our new Experiments feature to reimagine LLM product testing.

LLM-as-a-judge evaluation uses an LLM to grade an output from an AI system, augmenting or replacing manual, human evaluation.

Gentrace suffered an evaluator outage that affected all customers who ran tests from Friday, July 26th at 1:42PM PT to Monday, July 29th at ~4:30 PM PT.

TLDR: A XSS vulnerability has been patched. We investigated and found no known affected users or recommended actions for Gentrace users.

AI hallucinations occur when an LLM returns incoherent and/or factually inaccurate information in response to a query.

One of the most common patterns in modern LLM development is Retrieval-Augmented Generation (RAG).

Over the course of 2023, you helped Gentrace grow from an internal tool to the generative AI evaluation platform for a number of technology companies building with generative AI.