incerto.llm.aur_c

Contents

incerto.llm.aur_c#

incerto.llm.aur_c(confidences, correctness)[source]#

Area Under Risk-Coverage curve.

Measures selective prediction quality - how well uncertainty correlates with correctness.

Parameters:
  • confidences (Tensor) – Confidence scores (batch,)

  • correctness (Tensor) – Binary correctness (batch,)

Return type:

float

Returns:

AURC value (lower is better)