incerto.llm.SequenceProbability#

class incerto.llm.SequenceProbability[source]#

Bases: object

Joint probability of the entire sequence.

Computed as the product of individual token probabilities. Lower values indicate higher uncertainty.

__init__()#

Methods

__init__()

compute(logits, token_ids[, dim])

Compute sequence probability.

static compute(logits, token_ids, dim=-1)[source]#

Compute sequence probability.

Parameters:
  • logits (Tensor) – Token logits of shape (batch, seq_len, vocab_size)

  • token_ids (Tensor) – Generated token IDs of shape (batch, seq_len)

  • dim (int) – Dimension to compute softmax over (default: -1)

Return type:

Tensor

Returns:

Sequence probabilities of shape (batch,)