This paper-specific evaluation tests protein variant fitness prediction using ProteinGym substitutions.
Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.
| Property | Description and evidence |
|---|---|
| Record type | Paper-specific task; protocol incompletely extractedPseudo-perplexity in One Fell Swoop for Protein Fitness Estimation · Published PDF page 6 (033014-6), Table I, ESM2: OFS PP row, Aggregate mean column |
| Inputs | ProteinGym substitutionsPseudo-perplexity in One Fell Swoop for Protein Fitness Estimation · Published PDF page 6 (033014-6), Table I, ESM2: OFS PP row, Aggregate mean column |
| Assessment | Spearman rhoPseudo-perplexity in One Fell Swoop for Protein Fitness Estimation · Published PDF page 6 (033014-6), Table I, ESM2: OFS PP row, Aggregate mean column |
| Recorded split or evaluation setting | aggregate across assaysPseudo-perplexity in One Fell Swoop for Protein Fitness Estimation · Published PDF page 6 (033014-6), Table I, ESM2: OFS PP row, Aggregate mean column |
| Datasets | Not extracted or verified for this record. |
| Organisms | Not extracted or verified for this record. |
| Assays | Not extracted or verified for this record. |
| Adaptation | Not extracted or verified for this record. |
| Baselines | Not extracted or verified for this record. |
Outline of the existing paper extraction. Split membership, fitting details and scorer implementation remain incompletely reviewed.
The existing paper extraction describes: authors’ zero-shot ESM2 OFS pseudo-perplexity evaluation; aggregate mean across ProteinGym substitution assays. This description is retained with the exact evaluation records; it is not a new protocol reconstruction.
Pseudo-perplexity in One Fell Swoop for Protein Fitness Estimation · Published PDF page 6 (033014-6), Table I, ESM2: OFS PP row, Aggregate mean columnRelease 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| ESM2 OFS pseudo-perplexity: protein variant fitness prediction Model: ESM2 OFS pseudo-perplexity · Benchmark: protein variant fitness prediction · Dataset: ProteinGym substitutions authors’ zero-shot ESM2 OFS pseudo-perplexity evaluation; aggregate mean across ProteinGym substitution assays Author-reported evaluation · Evaluation metadata: needs review | ||
| 0.403 Spearman rho Unit: unitless · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedPseudo-perplexity in One Fell Swoop for Protein Fitness Estimation · Published PDF page 6 (033014-6), Table I, ESM2: OFS PP row, Aggregate mean column Source checking is not independent reproduction. |
Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.
Stable record: reported-task-c7a8a372f77886Release 2026-09-16-d74d282221a9 · Record review: needs review
Stable ID: reported-task-c7a8a372f77886