Configuration

ESM-IF1

Fitness prediction model evaluated by the ProteinGym authors under their harness.

Overview

Fitness prediction model evaluated by the ProteinGym authors under their harness.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

Release 2026-09-17-134cd1815de8 · 5 evaluations · 5 metric rows. Different protocols are not a single leaderboard. Where several source tables report the same metric, the published comparisons above offer a pooled view that names what it does not hold constant.

Evaluation setupMetricEvidence origin

Results grouped by the exact reported evaluation
Metric and finding	Coverage and uncertainty	Evidence
ESM-IF1 on ProteinGym ZS-SUB-AUC: Zero-shot substitutions, AUC Configuration: ESM-IF1Task: ProteinGym ZS-SUB-AUC: Zero-shot substitutions, AUCDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Author-reported evaluation · Evaluation metadata: source checked
0.730 auc Unit: fraction · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(Inverse ESM-IF1), column(Zero-shot substitutions, AUC) Source checking is not independent reproduction.
ESM-IF1 on ProteinGym ZS-SUB-MCC: Zero-shot substitutions, MCC Configuration: ESM-IF1Task: ProteinGym ZS-SUB-MCC: Zero-shot substitutions, MCCDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Author-reported evaluation · Evaluation metadata: source checked
0.331 mcc Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(Inverse ESM-IF1), column(Zero-shot substitutions, MCC) Source checking is not independent reproduction.
ESM-IF1 on ProteinGym ZS-SUB-NDCG: Zero-shot substitutions, NDCG@10% Configuration: ESM-IF1Task: ProteinGym ZS-SUB-NDCG: Zero-shot substitutions, NDCG@10%Dataset subset: ProteinGym substitution DMS assays (ProteinGym split) Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Author-reported evaluation · Evaluation metadata: source checked
0.748 ndcg Unit: fraction · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(Inverse ESM-IF1), column(Zero-shot substitutions, NDCG@10%) Source checking is not independent reproduction.
ESM-IF1 on ProteinGym ZS-SUB-RECALL: Zero-shot substitutions, top 10% recall Configuration: ESM-IF1Task: ProteinGym ZS-SUB-RECALL: Zero-shot substitutions, top 10% recallDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Author-reported evaluation · Evaluation metadata: source checked
0.223 recall Unit: fraction · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(Inverse ESM-IF1), column(Zero-shot substitutions, top 10% recall) Source checking is not independent reproduction.
ESM-IF1 on ProteinGym ZS-SUB-SPEARMAN: Zero-shot substitutions, Spearman Configuration: ESM-IF1Task: ProteinGym ZS-SUB-SPEARMAN: Zero-shot substitutions, SpearmanDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Author-reported evaluation · Evaluation metadata: source checked
0.422 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(Inverse ESM-IF1), column(Zero-shot substitutions, Spearman) Source checking is not independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters