incerto.shift.plot_confidence_distributions

incerto.shift.plot_confidence_distributions#

incerto.shift.plot_confidence_distributions(ref_confidences, test_confidences, bins=50, show=True)[source]#

Compare model confidence distributions between reference and test data.

Useful for detecting calibration degradation under distribution shift.

Parameters:
  • ref_confidences (Tensor) – Confidence scores for reference data, shape (n,)

  • test_confidences (Tensor) – Confidence scores for test data, shape (m,)

  • bins (int) – Number of histogram bins

  • show (bool) – Whether to call plt.show() (default: True)

Return type:

Figure

Returns:

The matplotlib Figure object for further customization