Scoring types

Scoring Type Description
Answer Correctness The factual accuracy of the generated output that is independent of the defined ground truth.
Answer Similarity The degree of alignment between the generated output and the defined ground truth.
Answer Relevance The measure of how appropriate and useful the generated output is with respect to the user intent.
Agent Trajectory The alignment between the orchestration that the Agent or Tool executed and the Agent trajectory ground truth.