ProteinGym substitution DMS: stability assays
Evaluation results
Release 2026-09-16-d74d282221a9 · 2 evaluations · 2 metric rows. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| ESM-2: Zero-shot substitution mutation effects: stability Model: ESM-2 · Benchmark: Zero-shot substitution mutation effects: stability · Dataset: ProteinGym substitution DMS: stability assays Zero-shot mutation scores; average Spearman across stability-category assays. Independent external evaluation · Evaluation metadata: needs review | ||
| 0.488 Mean Spearman rho Unit: unitless · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedProteinGym: Large-Scale Benchmarks for Protein Design and Fitness Prediction · Table A7, ESM-2 (15B) row, Stability column Source checking is not independent reproduction. |
| ProteinMPNN: Zero-shot substitution mutation effects: stability Model: ProteinMPNN · Benchmark: Zero-shot substitution mutation effects: stability · Dataset: ProteinGym substitution DMS: stability assays Zero-shot mutation scores; average Spearman across stability-category assays. Independent external evaluation · Evaluation metadata: needs review | ||
| 0.566 Mean Spearman rho Unit: unitless · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedProteinGym: Large-Scale Benchmarks for Protein Design and Fitness Prediction · Table A7, ProteinMPNN row, Stability column Source checking is not independent reproduction. |
Sources and history
Release 2026-09-16-d74d282221a9 · Record review: needs review
- ProteinGym: Large-Scale Benchmarks for Protein Design and Fitness Prediction · Original source · PMC10723403.1
Technical metadata and extraction receipts
Stable ID: reported-dataset-7cec655cd742f3
- areas
- proteins-complexes
- version
- Not reported
- split
- Not reported
- missing metadata
- version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract; accession: not_reported_in_legacy_extract