incerto.llm.brier_score

Contents

incerto.llm.brier_score#

incerto.llm.brier_score(confidences, correctness)[source]#

Compute Brier score for binary correctness prediction.

Parameters:
  • confidences (Tensor) – Predicted probabilities of being correct (batch,)

  • correctness (Tensor) – Binary indicators (batch,)

Return type:

float

Returns:

Brier score (lower is better)