incerto.llm.EnsembleDisagreement# class incerto.llm.EnsembleDisagreement[source]# Bases: object Disagreement rate across an ensemble of models or sampling strategies. Measures how often different samples/models produce different outputs. __init__()# Methods __init__() compute(predictions) Compute disagreement rate. static compute(predictions)[source]# Compute disagreement rate. Parameters: predictions (List[List[int]]) – List of prediction lists, each containing predicted classes for different examples Return type: float Returns: Disagreement rate (0-1)
