incerto.llm.plot_confidence_vs_correctness

incerto.llm.plot_confidence_vs_correctness#

incerto.llm.plot_confidence_vs_correctness(confidences, correctness, n_bins=10, ax=None, title='Confidence vs. Correctness')[source]#

Plot calibration diagram showing confidence vs. actual correctness.

Parameters:
  • confidences (ndarray | Tensor) – Model confidence scores

  • correctness (ndarray | Tensor) – Binary correctness indicators

  • n_bins (int) – Number of bins

  • ax – Matplotlib axes

  • title (str) – Plot title