result · source checked
0.403 Spearman rho
ESM2 OFS pseudo-perplexity · Spearman rho · ProteinGym substitutions
- Tested model
- ESM2 OFS pseudo-perplexity
- Task or benchmark
- protein variant fitness prediction
- Dataset
- ProteinGym substitutions
- Procedure
- authors’ zero-shot ESM2 OFS pseudo-perplexity evaluation; aggregate mean across ProteinGym substitution assays
- Evaluation
- ESM2 OFS pseudo-perplexity: protein variant fitness prediction
- Evidence
- Author-reported evaluation · source checkedPseudo-perplexity in One Fell Swoop for Protein Fitness Estimation · Published PDF page 6 (033014-6), Table I, ESM2: OFS PP row, Aggregate mean column
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.
Evaluation results
Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| ESM2 OFS pseudo-perplexity: protein variant fitness prediction Model: ESM2 OFS pseudo-perplexity · Benchmark: protein variant fitness prediction · Dataset: ProteinGym substitutions authors’ zero-shot ESM2 OFS pseudo-perplexity evaluation; aggregate mean across ProteinGym substitution assays Author-reported evaluation · Evaluation metadata: needs review | ||
| 0.403 Spearman rho Unit: unitless · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedPseudo-perplexity in One Fell Swoop for Protein Fitness Estimation · Published PDF page 6 (033014-6), Table I, ESM2: OFS PP row, Aggregate mean column Source checking is not independent reproduction. |
Sources and history
Release 2026-09-16-d74d282221a9 · Record review: source checked
- Pseudo-perplexity in One Fell Swoop for Protein Fitness Estimation · Original source · PRX Life 2025 journal article
Technical metadata and extraction receipts
Stable ID: b2-esm2-ofs-fitness-2025
- areas
- proteins-complexes
- tasks
- protein variant fitness prediction
- printed value
- 0.403
- numeric value
- 0.403
- metric
- Spearman rho
- metric direction
- unknown
- unit
- unitless
- uncertainty
- Not reported
- source locator
- Published PDF page 6 (033014-6), Table I, ESM2: OFS PP row, Aggregate mean column
- review
- method: independent_ai_table_review; reviewer: Codex omics research agent; independent source review, not human review; reviewed at: 2026-09-16T10:45:41.099916+00:00; notes: Publisher PDF retrieved through official APS harvest endpoint after direct download returned403. Table I is ProteinGym substitutions, not indels TableII. Last column aggregate mean0.403; separate function categories precede it. This verifies reported score, not experimental reproduction. Comparator rows in this table are sourced from ProteinGym; OFS PP is authors own method.; evidence: Headers: Activity(43), Binding(14), Expression(17), Organismal fitness(77), Stability(66), Aggregate mean. ESM2:OFS PP row:0.393,0.279,0.397,0.331,0.507,0.403. Verified publisher PDF layout extraction against web-rendered primary PDF table.; artifact sha256: 085ef646f11b8e5335c4b3d86b15fb6c7bf5edf4a80a8b622753ac69d9991a67; retrieval url: https://harvest.aps.org/v2/journals/articles/10.1103/zhx7-hcmm/fulltext
- legacy id
- b2-esm2-ofs-fitness-2025
- legacy row
- id: b2-esm2-ofs-fitness-2025; paper id: esm2-ofs-fitness-2025; domain id: proteins-complexes; task: protein variant fitness prediction; model: ESM2 OFS pseudo-perplexity; model version: not stated in table; dataset: ProteinGym substitutions; dataset version: Not reported; split: aggregate across assays; metric: Spearman rho; value: 0.403; unit: unitless; uncertainty: Not reported; protocol: authors’ zero-shot ESM2 OFS pseudo-perplexity evaluation; aggregate mean across ProteinGym substitution assays; source locator: Table I, ESM2: OFS PP row, Aggregate Mean Spearman correlation column; source url: https://journals.aps.org/prxlife/pdf/10.1103/zhx7-hcmm; evaluation origin: author_reported; reviewed utc: 2026-09-15T23:33:26Z
- missing metadata
- dataset version: not_reported_in_legacy_extract; uncertainty: not_reported_in_legacy_extract