Index

_

__call__() (incerto.ood.CutMix method) __init__() (incerto.active.BadgeSampling method), [1] (incerto.active.BALDAcquisition method), [1] (incerto.active.BaseAcquisition method) (incerto.active.BatchBALDAcquisition method), [1] (incerto.active.CoreSetSelection method), [1] (incerto.active.DiversitySampling method), [1] (incerto.active.EntropyAcquisition method) (incerto.active.LeastConfidenceAcquisition method) (incerto.active.MarginAcquisition method) (incerto.active.MeanSTDAcquisition method), [1] (incerto.active.QueryByCommittee method), [1] (incerto.active.RandomAcquisition method) (incerto.active.UncertaintySampling method), [1] (incerto.active.VarianceRatioAcquisition method), [1] (incerto.bayesian.BaseBayesianMethod method) (incerto.bayesian.DeepEnsemble method), [1] (incerto.bayesian.GaussianLinear method), [1] (incerto.bayesian.LaplaceApproximation method), [1] (incerto.bayesian.MCDropout method), [1] (incerto.bayesian.SWAG method), [1] (incerto.bayesian.VariationalBayesNN method), [1] (incerto.calibration.BaseCalibrator method) (incerto.calibration.BetaCalibrator method), [1] (incerto.calibration.ConfidencePenalty method), [1] (incerto.calibration.DirichletCalibrator method), [1] (incerto.calibration.FocalLoss method), [1] (incerto.calibration.HistogramBinningCalibrator method), [1] (incerto.calibration.IdentityCalibrator method) (incerto.calibration.IsotonicRegressionCalibrator method), [1] (incerto.calibration.LabelSmoothingLoss method), [1] (incerto.calibration.MatrixScaling method), [1] (incerto.calibration.PlattScalingCalibrator method), [1] (incerto.calibration.TemperatureAwareTraining method), [1] (incerto.calibration.TemperatureScaling method), [1] (incerto.calibration.VectorScaling method), [1] (incerto.conformal.ConformalPredictor method), [1] (incerto.data.CIFAR10 method), [1] (incerto.data.CIFAR100 method), [1] (incerto.data.CIFAR10_vs_CIFAR100 method), [1] (incerto.data.CIFAR10_vs_SVHN method), [1] (incerto.data.CorruptedDataOOD method), [1] (incerto.data.FashionMNIST method), [1] (incerto.data.InfiniteDataLoader method), [1] (incerto.data.LabelNoiseDataset method), [1] (incerto.data.MNIST method), [1] (incerto.data.MNIST_vs_FashionMNIST method), [1] (incerto.data.MNIST_vs_NotMNIST method), [1] (incerto.data.OODBenchmark method), [1] (incerto.data.SubclassOOD method), [1] (incerto.data.SVHN method), [1] (incerto.data.TransformDataset method), [1] (incerto.data.VisionDataset method), [1] (incerto.llm.AverageLogProb method) (incerto.llm.BeamSearchUncertainty method) (incerto.llm.BidirectionalConsistency method) (incerto.llm.ContrastiveDecoding method) (incerto.llm.EnsembleDisagreement method) (incerto.llm.HistogramBinning method), [1] (incerto.llm.IDontKnowDetection method) (incerto.llm.LexicalSimilarity method) (incerto.llm.MutualInformation method) (incerto.llm.NormalizedSequenceProb method) (incerto.llm.NucleusSamplingUncertainty method) (incerto.llm.PredictiveEntropy method) (incerto.llm.PTrue method) (incerto.llm.SelfConsistency method) (incerto.llm.SelfEvaluation method) (incerto.llm.SemanticEntropy method) (incerto.llm.SequenceEntropy method) (incerto.llm.SequenceLengthCalibration method), [1] (incerto.llm.SequencePerplexity method) (incerto.llm.SequenceProbability method) (incerto.llm.SurprisalScore method) (incerto.llm.TokenConfidence method) (incerto.llm.TokenEntropy method) (incerto.llm.TokenPerplexity method) (incerto.llm.TokenTemperatureScaling method), [1] (incerto.llm.TopKConfidence method) (incerto.llm.VarianceOfTokenProbs method) (incerto.llm.VarianceRatio method) (incerto.llm.VerbalizedConfidence method) (incerto.llm.VerbosityBiasCorrection method), [1] (incerto.ood.CutMix method), [1] (incerto.ood.Energy method), [1] (incerto.ood.EnergyRegularizedLoss method), [1] (incerto.ood.KNN method), [1] (incerto.ood.Mahalanobis method), [1] (incerto.ood.MaxLogit method) (incerto.ood.MSP method) (incerto.ood.ODIN method), [1] (incerto.ood.OODDetector method), [1] (incerto.ood.OutlierExposureLoss method), [1] (incerto.shift.BaseShiftDetector method) (incerto.shift.ClassifierShiftDetector method), [1] (incerto.shift.EnergyShiftDetector method) (incerto.shift.ImportanceWeightingShift method), [1] (incerto.shift.KSShiftDetector method) (incerto.shift.LabelShiftDetector method), [1] (incerto.shift.MMDShiftDetector method), [1] (incerto.sp.BaseSelectivePredictor method) (incerto.sp.DeepGambler method), [1] (incerto.sp.SelectiveNet method), [1] (incerto.sp.SelfAdaptiveTraining method), [1] (incerto.sp.SoftmaxThreshold method), [1] (incerto.utils.ConvNet method), [1] (incerto.utils.MLP method), [1] (incerto.utils.ResNet18 method), [1]

_reference (incerto.shift.BaseShiftDetector attribute)

A

accuracy_coverage_curve() (in module incerto.sp) active_learning_loop() (in module incerto.active) adaptive_ece_score() (in module incerto.calibration) apply_corruption() (incerto.data.CorruptedDataOOD method) aps() (in module incerto.conformal)

aur_c() (in module incerto.llm) aurc() (in module incerto.sp) auroc() (in module incerto.ood) average_set_size() (in module incerto.conformal) AverageLogProb (class in incerto.llm)

B

BadgeSampling (class in incerto.active) BALDAcquisition (class in incerto.active) BaseAcquisition (class in incerto.active) BaseBayesianMethod (class in incerto.bayesian) BaseCalibrator (class in incerto.calibration) BaseSelectivePredictor (class in incerto.sp) BaseShiftDetector (class in incerto.shift)

BatchBALDAcquisition (class in incerto.active) BBSDDetector (in module incerto.shift) BeamSearchUncertainty (class in incerto.llm) BetaCalibrator (class in incerto.calibration) BidirectionalConsistency (class in incerto.llm) brier_score() (in module incerto.bayesian) (in module incerto.calibration) (in module incerto.llm)

C

calibrate() (incerto.llm.HistogramBinning method) (incerto.llm.SequenceLengthCalibration method) calibration_error() (in module incerto.llm) CIFAR10 (class in incerto.data) CIFAR100 (class in incerto.data) CIFAR10_vs_CIFAR100 (class in incerto.data) CIFAR10_vs_SVHN (class in incerto.data) ClassifierShiftDetector (class in incerto.shift) classwise_ece() (in module incerto.calibration) collect_model() (incerto.bayesian.SWAG method) compute() (incerto.llm.AverageLogProb static method) (incerto.llm.EnsembleDisagreement static method) (incerto.llm.MutualInformation static method) (incerto.llm.NormalizedSequenceProb static method) (incerto.llm.PredictiveEntropy static method) (incerto.llm.SelfConsistency static method) (incerto.llm.SemanticEntropy static method) (incerto.llm.SequenceEntropy static method) (incerto.llm.SequencePerplexity static method) (incerto.llm.SequenceProbability static method) (incerto.llm.SurprisalScore static method) (incerto.llm.TokenConfidence static method) (incerto.llm.TokenEntropy static method) (incerto.llm.TokenPerplexity static method) (incerto.llm.TopKConfidence static method) (incerto.llm.VarianceOfTokenProbs static method) (incerto.llm.VarianceRatio static method) compute_consistency() (incerto.llm.BidirectionalConsistency static method) compute_contrastive_score() (incerto.llm.ContrastiveDecoding static method)

compute_dataset_statistics() (in module incerto.data) compute_disagreement() (in module incerto.bayesian) compute_diversity_penalty() (in module incerto.active) compute_from_scores() (incerto.llm.BeamSearchUncertainty static method) compute_quantile() (in module incerto.conformal) compute_shift_magnitude() (incerto.shift.LabelShiftDetector method) compute_threshold_at_tpr() (in module incerto.ood) compute_weights() (incerto.shift.ImportanceWeightingShift method) conditional_coverage() (in module incerto.conformal) confidence_from_logits() (incerto.sp.BaseSelectivePredictor static method) (incerto.sp.DeepGambler method) (incerto.sp.SelectiveNet method) ConfidencePenalty (class in incerto.calibration) conformalized_quantile_regression() (in module incerto.conformal) ConformalPredictor (class in incerto.conformal) contains_uncertainty_phrase() (incerto.llm.IDontKnowDetection static method) ContrastiveDecoding (class in incerto.llm) ConvNet (class in incerto.utils) CoreSetSelection (class in incerto.active) correct() (incerto.llm.VerbosityBiasCorrection method) CorruptedDataOOD (class in incerto.data) coverage() (in module incerto.sp) create_balanced_dataloader() (in module incerto.data) create_calibration_loaders() (in module incerto.data) create_dataloaders() (in module incerto.data) create_imbalanced_dataset() (in module incerto.data) create_ood_dataloader() (in module incerto.data) CutMix (class in incerto.ood) cv_plus() (in module incerto.conformal)

D

decompose_uncertainty() (in module incerto.bayesian) DeepEnsemble (class in incerto.bayesian) DeepGambler (class in incerto.sp) detection_accuracy() (in module incerto.ood) DirichletCalibrator (class in incerto.calibration)

disable_logging() (in module incerto.utils) disagreement() (in module incerto.bayesian) disagreement_score() (incerto.llm.ContrastiveDecoding static method) diversity() (incerto.bayesian.DeepEnsemble method) diversity_among_beams() (incerto.llm.BeamSearchUncertainty static method) DiversitySampling (class in incerto.active)

E

ece_score() (in module incerto.calibration) effective_vocabulary_size() (incerto.llm.NucleusSamplingUncertainty static method) empirical_coverage() (in module incerto.conformal) Energy (class in incerto.ood) energy_distance() (in module incerto.shift) EnergyRegularizedLoss (class in incerto.ood) EnergyShiftDetector (class in incerto.shift) ensemble_diversity() (in module incerto.bayesian) ensemble_predictions_to_distribution() (in module incerto.bayesian) EnsembleDisagreement (class in incerto.llm)

EntropyAcquisition (class in incerto.active) estimate_target_distribution() (incerto.shift.LabelShiftDetector method) evaluate() (in module incerto.utils) evidential_loss() (in module incerto.calibration) exact_match_rate() (incerto.llm.LexicalSimilarity static method) expected_calibration_error() (in module incerto.bayesian) extract_confidence_from_hedging() (incerto.llm.IDontKnowDetection static method) extract_confidences_and_predictions() (in module incerto.calibration) extract_features() (in module incerto.ood) extract_percentage() (incerto.llm.VerbalizedConfidence static method) extract_probability() (incerto.llm.PTrue static method)

F

f1_score_tokens() (in module incerto.llm) FashionMNIST (class in incerto.data) filter_dataset_by_class() (in module incerto.data) first_sentence() (incerto.llm.SelfConsistency static method) fit() (incerto.bayesian.LaplaceApproximation method) (incerto.calibration.BaseCalibrator method) (incerto.calibration.BetaCalibrator method) (incerto.calibration.DirichletCalibrator method) (incerto.calibration.HistogramBinningCalibrator method) (incerto.calibration.IdentityCalibrator method) (incerto.calibration.IsotonicRegressionCalibrator method) (incerto.calibration.MatrixScaling method) (incerto.calibration.PlattScalingCalibrator method) (incerto.calibration.TemperatureScaling method) (incerto.calibration.VectorScaling method) (incerto.llm.HistogramBinning method) (incerto.llm.TokenTemperatureScaling method) (incerto.llm.VerbosityBiasCorrection method) (incerto.ood.KNN method) (incerto.ood.Mahalanobis method) (incerto.shift.BaseShiftDetector method) (incerto.shift.ImportanceWeightingShift method) (incerto.shift.LabelShiftDetector method)

FocalLoss (class in incerto.calibration) forward() (incerto.bayesian.DeepEnsemble method) (incerto.bayesian.GaussianLinear method) (incerto.bayesian.MCDropout method) (incerto.bayesian.VariationalBayesNN method) (incerto.calibration.ConfidencePenalty method) (incerto.calibration.DirichletCalibrator method) (incerto.calibration.FocalLoss method) (incerto.calibration.LabelSmoothingLoss method) (incerto.calibration.MatrixScaling method) (incerto.calibration.TemperatureAwareTraining method) (incerto.calibration.TemperatureScaling method) (incerto.calibration.VectorScaling method) (incerto.llm.TokenTemperatureScaling method) (incerto.ood.EnergyRegularizedLoss method) (incerto.ood.OutlierExposureLoss method) (incerto.sp.BaseSelectivePredictor method) (incerto.sp.SelectiveNet method) (incerto.utils.ConvNet method) (incerto.utils.MLP method) (incerto.utils.ResNet18 method) fpr_at_tpr() (in module incerto.ood) from_method() (incerto.conformal.ConformalPredictor class method)

G

gambler_loss() (incerto.sp.DeepGambler static method) GaussianLinear (class in incerto.bayesian) get_alpha() (incerto.sp.SelfAdaptiveTraining method) get_bin_stats() (in module incerto.calibration) get_class_balanced_subset() (in module incerto.data) get_confidence_prompt() (incerto.llm.VerbalizedConfidence static method) get_critique_prompt() (incerto.llm.SelfEvaluation static method) get_dataloader_stats() (in module incerto.data) get_datasets() (incerto.data.CIFAR10 method) (incerto.data.CIFAR100 method) (incerto.data.CIFAR10_vs_CIFAR100 method) (incerto.data.CIFAR10_vs_SVHN method) (incerto.data.CorruptedDataOOD method) (incerto.data.FashionMNIST method) (incerto.data.MNIST method) (incerto.data.MNIST_vs_FashionMNIST method) (incerto.data.MNIST_vs_NotMNIST method) (incerto.data.OODBenchmark method) (incerto.data.SubclassOOD method) (incerto.data.SVHN method)

get_logger() (in module incerto.utils) get_ood_benchmark() (in module incerto.data) get_ood_predictions() (in module incerto.ood) get_ptrue_prompt() (incerto.llm.PTrue static method) get_transforms() (incerto.data.CIFAR10 method) (incerto.data.CIFAR100 method) (incerto.data.CIFAR10_vs_CIFAR100 method) (incerto.data.CIFAR10_vs_SVHN method) (incerto.data.FashionMNIST method) (incerto.data.MNIST method) (incerto.data.MNIST_vs_FashionMNIST method) (incerto.data.MNIST_vs_NotMNIST method) (incerto.data.SVHN method) get_uncertainty_from_evidence() (in module incerto.calibration) greedy_k_center() (in module incerto.active)

H

HistogramBinning (class in incerto.llm)

HistogramBinningCalibrator (class in incerto.calibration)

I

IdentityCalibrator (class in incerto.calibration) IDontKnowDetection (class in incerto.llm) ImportanceWeightingShift (class in incerto.shift)

inductive_conformal() (in module incerto.conformal) InfiniteDataLoader (class in incerto.data) IsotonicRegressionCalibrator (class in incerto.calibration)

J

jackknife_plus() (in module incerto.conformal)

K

kl_divergence() (incerto.bayesian.GaussianLinear method) (incerto.bayesian.VariationalBayesNN method)

KNN (class in incerto.ood) KSShiftDetector (class in incerto.shift)

L

LabelNoiseDataset (class in incerto.data) LabelShiftDetector (class in incerto.shift) LabelSmoothingLoss (class in incerto.calibration) LaplaceApproximation (class in incerto.bayesian) LeastConfidenceAcquisition (class in incerto.active) LexicalSimilarity (class in incerto.llm) load() (incerto.calibration.BaseCalibrator class method) (incerto.calibration.DirichletCalibrator class method) (incerto.calibration.MatrixScaling class method) (incerto.calibration.VectorScaling class method) (incerto.ood.OODDetector class method) (incerto.shift.BaseShiftDetector class method) (incerto.shift.ImportanceWeightingShift class method) (incerto.shift.LabelShiftDetector class method) load_state_dict() (incerto.bayesian.LaplaceApproximation method) (incerto.bayesian.SWAG method) (incerto.calibration.BaseCalibrator method) (incerto.calibration.BetaCalibrator method) (incerto.calibration.DirichletCalibrator method) (incerto.calibration.HistogramBinningCalibrator method) (incerto.calibration.IdentityCalibrator method) (incerto.calibration.IsotonicRegressionCalibrator method) (incerto.calibration.PlattScalingCalibrator method) (incerto.ood.Energy method) (incerto.ood.KNN method) (incerto.ood.Mahalanobis method) (incerto.ood.ODIN method) (incerto.ood.OODDetector method) (incerto.shift.BaseShiftDetector method) (incerto.shift.ClassifierShiftDetector method) (incerto.shift.ImportanceWeightingShift method) (incerto.shift.LabelShiftDetector method) (incerto.shift.MMDShiftDetector method)

logits_to_probs() (in module incerto.calibration)

M

Mahalanobis (class in incerto.ood) make() (in module incerto.sp) MarginAcquisition (class in incerto.active) MatrixScaling (class in incerto.calibration) MaxLogit (class in incerto.ood) MCDropout (class in incerto.bayesian) mce_score() (in module incerto.calibration) MeanSTDAcquisition (class in incerto.active) merge_datasets() (in module incerto.data) mixup_criterion() (in module incerto.ood)

mixup_data() (in module incerto.ood) MLP (class in incerto.utils) MMDShiftDetector (class in incerto.shift) MNIST (class in incerto.data) MNIST_vs_FashionMNIST (class in incerto.data) MNIST_vs_NotMNIST (class in incerto.data) model (incerto.ood.OODDetector attribute) mondrian_conformal() (in module incerto.conformal) MSP (class in incerto.ood) mutual_information() (in module incerto.bayesian) MutualInformation (class in incerto.llm)

N

negative_log_likelihood() (in module incerto.bayesian) nll() (in module incerto.calibration)

NormalizedSequenceProb (class in incerto.llm) NucleusSamplingUncertainty (class in incerto.llm)

O

ODIN (class in incerto.ood) OODBenchmark (class in incerto.data)

OODDetector (class in incerto.ood) OutlierExposureLoss (class in incerto.ood)

P

pairwise_token_overlap() (incerto.llm.LexicalSimilarity static method) paraphrase_prompts() (incerto.llm.BidirectionalConsistency static method) PlattScalingCalibrator (class in incerto.calibration) plot_2d_classification() (in module incerto.utils) plot_accuracy_coverage() (in module incerto.sp) plot_calibration_curve() (in module incerto.calibration) plot_confidence_distributions() (in module incerto.shift) plot_confidence_histogram() (in module incerto.calibration) plot_confidence_vs_correctness() (in module incerto.llm) plot_coverage_vs_alpha() (in module incerto.conformal) plot_embedding_space() (in module incerto.shift) plot_feature_histograms() (in module incerto.shift) plot_generation_diversity() (in module incerto.llm) plot_ks_statistics() (in module incerto.shift) plot_length_vs_confidence() (in module incerto.llm) plot_reliability_diagram() (in module incerto.calibration) plot_risk_coverage() (in module incerto.sp) plot_risk_coverage_llm() (in module incerto.llm) plot_roc() (in module incerto.ood) plot_semantic_clusters() (in module incerto.llm) plot_set_size_hist() (in module incerto.conformal) plot_shift_severity() (in module incerto.shift) plot_smooth_reliability_diagram() (in module incerto.calibration) plot_token_uncertainty() (in module incerto.llm) plot_training_curves() (in module incerto.utils) plot_uncertainty_distribution() (in module incerto.llm) (in module incerto.utils)

population_stability_index() (in module incerto.shift) predict() (incerto.bayesian.BaseBayesianMethod method) (incerto.bayesian.DeepEnsemble method) (incerto.bayesian.LaplaceApproximation method) (incerto.bayesian.MCDropout method) (incerto.bayesian.SWAG method) (incerto.bayesian.VariationalBayesNN method) (incerto.calibration.BaseCalibrator method) (incerto.calibration.BetaCalibrator method) (incerto.calibration.DirichletCalibrator method) (incerto.calibration.HistogramBinningCalibrator method) (incerto.calibration.IdentityCalibrator method) (incerto.calibration.IsotonicRegressionCalibrator method) (incerto.calibration.MatrixScaling method) (incerto.calibration.PlattScalingCalibrator method) (incerto.calibration.TemperatureScaling method) (incerto.calibration.VectorScaling method) (incerto.conformal.ConformalPredictor method) (incerto.ood.ODIN method) (incerto.ood.OODDetector method) predict_entropy() (incerto.bayesian.MCDropout method) predict_mutual_information() (incerto.bayesian.MCDropout method) prediction_set_from_scores() (in module incerto.conformal) predictive_entropy() (in module incerto.bayesian) predictive_log_likelihood() (in module incerto.bayesian) PredictiveEntropy (class in incerto.llm) probability_mass_concentration() (incerto.llm.NucleusSamplingUncertainty static method) PTrue (class in incerto.llm)

Q

query() (incerto.active.BadgeSampling method) (incerto.active.CoreSetSelection method) (incerto.active.DiversitySampling method) (incerto.active.QueryByCommittee method) (incerto.active.UncertaintySampling method)

QueryByCommittee (class in incerto.active)

R

RandomAcquisition (class in incerto.active) raps() (in module incerto.conformal)

reject() (incerto.sp.BaseSelectivePredictor static method) ResNet18 (class in incerto.utils) risk() (in module incerto.sp)

S

sample_from_posterior() (in module incerto.bayesian) sample_parameters() (incerto.bayesian.SWAG method) sat_loss() (incerto.sp.SelfAdaptiveTraining method) save() (incerto.calibration.BaseCalibrator method) (incerto.ood.OODDetector method) (incerto.shift.BaseShiftDetector method) (incerto.shift.ImportanceWeightingShift method) (incerto.shift.LabelShiftDetector method) score() (incerto.active.BALDAcquisition method) (incerto.active.BaseAcquisition method) (incerto.active.BatchBALDAcquisition method) (incerto.active.EntropyAcquisition method) (incerto.active.LeastConfidenceAcquisition method) (incerto.active.MarginAcquisition method) (incerto.active.MeanSTDAcquisition method) (incerto.active.RandomAcquisition method) (incerto.active.VarianceRatioAcquisition method) (incerto.ood.Energy method) (incerto.ood.KNN method) (incerto.ood.Mahalanobis method) (incerto.ood.MaxLogit method) (incerto.ood.MSP method) (incerto.ood.ODIN method) (incerto.ood.OODDetector method) (incerto.shift.BaseShiftDetector method) score_hist() (in module incerto.ood) seed_everything() (in module incerto.utils) selective_accuracy() (in module incerto.llm) selective_loss() (incerto.sp.SelectiveNet method) SelectiveNet (class in incerto.sp) SelfAdaptiveTraining (class in incerto.sp) SelfConsistency (class in incerto.llm) SelfEvaluation (class in incerto.llm) SemanticEntropy (class in incerto.llm) sequence_level_accuracy() (in module incerto.llm) SequenceEntropy (class in incerto.llm)

SequenceLengthCalibration (class in incerto.llm) SequencePerplexity (class in incerto.llm) SequenceProbability (class in incerto.llm) setup_logging() (in module incerto.utils) sharpness() (in module incerto.bayesian) sliced_wasserstein_distance() (in module incerto.shift) smooth_ece() (in module incerto.calibration) SoftmaxThreshold (class in incerto.sp) split_data() (in module incerto.conformal) split_dataset() (in module incerto.data) split_labeled_unlabeled() (in module incerto.active) state_dict() (incerto.bayesian.LaplaceApproximation method) (incerto.bayesian.SWAG method) (incerto.calibration.BaseCalibrator method) (incerto.calibration.BetaCalibrator method) (incerto.calibration.DirichletCalibrator method) (incerto.calibration.HistogramBinningCalibrator method) (incerto.calibration.IdentityCalibrator method) (incerto.calibration.IsotonicRegressionCalibrator method) (incerto.calibration.PlattScalingCalibrator method) (incerto.ood.Energy method) (incerto.ood.KNN method) (incerto.ood.Mahalanobis method) (incerto.ood.ODIN method) (incerto.ood.OODDetector method) (incerto.shift.BaseShiftDetector method) (incerto.shift.ClassifierShiftDetector method) (incerto.shift.ImportanceWeightingShift method) (incerto.shift.LabelShiftDetector method) (incerto.shift.MMDShiftDetector method) SubclassOOD (class in incerto.data) subsample_dataset() (in module incerto.data) subsample_for_efficiency() (in module incerto.active) SurprisalScore (class in incerto.llm) SVHN (class in incerto.data) SWAG (class in incerto.bayesian)

T

TemperatureAwareTraining (class in incerto.calibration) TemperatureScaling (class in incerto.calibration) token_level_accuracy() (in module incerto.llm) TokenConfidence (class in incerto.llm) TokenEntropy (class in incerto.llm) TokenPerplexity (class in incerto.llm)

TokenTemperatureScaling (class in incerto.llm) TopKConfidence (class in incerto.llm) total_variation() (in module incerto.shift) train_epoch() (in module incerto.utils) train_member() (incerto.bayesian.DeepEnsemble method) TransformDataset (class in incerto.data)

U

uncertainty_auc() (in module incerto.llm) UNCERTAINTY_PHRASES (incerto.llm.IDontKnowDetection attribute)

uncertainty_quality() (in module incerto.bayesian) UncertaintySampling (class in incerto.active)

V

VarianceOfTokenProbs (class in incerto.llm) VarianceRatio (class in incerto.llm) VarianceRatioAcquisition (class in incerto.active) variational_loss() (incerto.bayesian.VariationalBayesNN method)

VariationalBayesNN (class in incerto.bayesian) VectorScaling (class in incerto.calibration) VerbalizedConfidence (class in incerto.llm) VerbosityBiasCorrection (class in incerto.llm) VisionDataset (class in incerto.data)

W

wasserstein_distance() (in module incerto.shift)

weighted_loss() (incerto.shift.ImportanceWeightingShift method)