incerto.llm.AverageLogProb

incerto.llm.AverageLogProb#

class incerto.llm.AverageLogProb[source]#

Bases: object

Mean log-probability across the sequence.

Average negative log-likelihood per token. Higher (less negative) values indicate lower uncertainty.

__init__()#

Methods

__init__()

compute(logits, token_ids[, mask, dim])

Compute average log probability.
static compute(logits, token_ids, mask=None, dim=-1)[source]#

Compute average log probability.

Parameters:

  • logits (Tensor) – Token logits of shape (batch, seq_len, vocab_size)

  • token_ids (Tensor) – Generated token IDs of shape (batch, seq_len)

  • mask (Optional[Tensor]) – Optional mask for padding of shape (batch, seq_len)

  • dim (int) – Dimension to compute softmax over (default: -1)

Return type:

Tensor

Returns:

Average log probabilities of shape (batch,)

Contents