evaluation · needs review
ESM-2: Zero-shot substitution mutation effects: stability
Evaluation procedure
Zero-shot mutation scores; average Spearman across stability-category assays.
- Model
- ESM-2
- Benchmark
- Zero-shot substitution mutation effects: stability
- Dataset
- ProteinGym substitution DMS: stability assays
- origin
- Independent external evaluation
- configuration
- 15B
- protocol id
- Not reported
- dataset version
- Not reported
- split
- Not reported
- population
- Not reported
- inputs
- Not reported
- adaptation
- Not reported
- metric implementation
- Not reported
- aggregation
- Not reported
- budget
- Not reported
Metadata review: needs review. Unreported conditions prevent automatic comparisons.
Evaluation results
Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| ESM-2: Zero-shot substitution mutation effects: stability Model: ESM-2 · Benchmark: Zero-shot substitution mutation effects: stability · Dataset: ProteinGym substitution DMS: stability assays Zero-shot mutation scores; average Spearman across stability-category assays. Independent external evaluation · Evaluation metadata: needs review | ||
| 0.488 Mean Spearman rho Unit: unitless · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedProteinGym: Large-Scale Benchmarks for Protein Design and Fitness Prediction · Table A7, ESM-2 (15B) row, Stability column Source checking is not independent reproduction. |
Sources and history
Release 2026-09-16-d74d282221a9 · Record review: needs review
- ProteinGym: Large-Scale Benchmarks for Protein Design and Fitness Prediction · Original source · PMC10723403.1
Technical metadata and extraction receipts
Stable ID: evaluation-lit-017
- areas
- proteins-complexes
- tasks
- Zero-shot substitution mutation effects: stability
- origin
- independent_paper
- protocol
- Zero-shot mutation scores; average Spearman across stability-category assays.
- version
- 15B
- comparison
- protocol id: Not reported; dataset version: Not reported; split: Not reported; population: Not reported; inputs: Not reported; adaptation: Not reported; metric implementation: Not reported; aggregation: Not reported; budget: Not reported
- missing metadata
- dataset version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract