incerto.llm.token_level_accuracy# incerto.llm.token_level_accuracy(pred_tokens, true_tokens, mask=None)[source]# Compute token-level accuracy. Parameters: pred_tokens (Tensor) – Predicted token IDs (batch, seq_len) true_tokens (Tensor) – True token IDs (batch, seq_len) mask (Optional[Tensor]) – Optional mask for valid positions (batch, seq_len) Return type: float Returns: Token accuracy
