Encyclopedia Evalica / Annotation / Annotation
Annotation
/a.nuh'tay.shuhn/The process of adding structured human feedback, labels, or corrections to traces or dataset records. Annotation turns messy free-text notes into consistent signals that can be scored and tracked. (noun)
“We added annotations to those traces based on the customer feedback in the chat logs.”
Customer example
Portola has nontechnical subject matter experts review and annotate real conversation logs and ship prompt changes directly. Read more
Related Annotation terms
From the docs
Get started with Evals
Braintrust is the AI observability and eval platform for production AI. By connecting evals and observability in one workflow, teams at Notion, Stripe, Zapier, Vercel, and Ramp ship quality AI products at scale.
Start building