evaluation · needs review

ESM-2: Zero-shot variant effect prediction

Evaluation procedure

Zero-shot VEP; paper averages absolute Spearman correlations.

Metadata review: needs review. Unreported conditions prevent automatic comparisons.

Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.

Evaluated configurationMetricEvidence origin

Results grouped by the exact reported evaluation
Metric and finding	Coverage and uncertainty	Evidence
ESM-2: Zero-shot variant effect prediction Model: ESM-2 · Benchmark: Zero-shot variant effect prediction · Dataset: ProteinShake VEP datasets Zero-shot VEP; paper averages absolute Spearman correlations. Independent external evaluation · Evaluation metadata: needs review
0.489 Mean \|Spearman rho\| Unit: unitless · Direction: unknown	Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported	source checkedEndowing protein language models with structural knowledge · Table 2, ESM-2 row, Zero-shot VEP Mean \|ρ\| column Source checking is not independent reproduction.

Release 2026-09-16-d74d282221a9 · Record review: needs review

Technical metadata and extraction receipts

Stable ID: evaluation-lit-024

areas: proteins-complexes
tasks: Zero-shot variant effect prediction
origin: independent_paper
protocol: Zero-shot VEP; paper averages absolute Spearman correlations.
version: Not reported
comparison: protocol id: Not reported; dataset version: Not reported; split: Not reported; population: Not reported; inputs: Not reported; adaptation: Not reported; metric implementation: Not reported; aggregation: Not reported; budget: Not reported
missing metadata: model version: not_reported_in_legacy_extract; dataset version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract

Related records