incerto.llm.sequence_level_accuracy

incerto.llm.sequence_level_accuracy#

incerto.llm.sequence_level_accuracy(pred_sequences, true_sequences, normalize=True)[source]#

Compute sequence-level exact match accuracy.

Parameters:
  • pred_sequences (List[str]) – List of predicted sequences

  • true_sequences (List[str]) – List of true sequences

  • normalize (bool) – Whether to normalize (lowercase, strip) before comparing

Return type:

float

Returns:

Exact match accuracy