ESMC-300M naive supervised · FLIP2 hydro low-to-high; held-out test set · hydro
FLIP2 hydro low-to-high; held-out test set; hydro. Source checked, not independently reproduced.
Evaluation results
Release 2026-09-19-eb6149e5d766 · 1 evaluation · 2 metric rows. Different protocols are not a single leaderboard. Charts retain each source table’s protocol and dataset.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| ESMC-300M naive supervised · FLIP2 hydro low-to-high; held-out test set · hydro Configuration: ESMC-300M naive supervisedProtocol: FLIP2 hydro low-to-high; held-out test set · hydroDataset subset: hydro FLIP2 hydro low-to-high; held-out test set Author-reported evaluation · Evaluation metadata: discovered | ||
| 0.905 ± 0.008 ndcg Unit: unitless · Direction: higher Aggregation: mean of five random-seed fits (Section 4.3) | Uncertainty: printed spread: 0.008; type: unreported; value: 0.008 Scored: Not reported · Eligible: Not reported | source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A11; row ESMC-300M naive supervised; column ndcg Source checking is not independent reproduction. |
| 0.270 ± 0.048 spearman Unit: correlation · Direction: higher Aggregation: mean of five random-seed fits (Section 4.3) | Uncertainty: printed spread: 0.048; type: unreported; value: 0.048 Scored: Not reported · Eligible: Not reported | source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A11; row ESMC-300M naive supervised; column spearman Source checking is not independent reproduction. |
Methods and reproduction
FLIP2 hydro low-to-high; held-out test set; hydro. Source checked, not independently reproduced.
- configuration
- ESMC-300M naive supervised
- protocol
- FLIP2 hydro low-to-high; held-out test set · hydro
- dataset subset
- hydro
- Split
- low-to-high
- Adaptation
- random-initialized supervised training
- Scoring implementation
- Not reported
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evaluation procedure
FLIP2 hydro low-to-high; held-out test set
- Configuration
- ESMC-300M naive supervised
- Protocol
- FLIP2 hydro low-to-high; held-out test set · hydro
- Dataset subset
- hydro
- origin
- Author-reported evaluation
- configuration
- Not reported
- protocol id
- acquired-protocol-2a25c278d301f1b27a06
- dataset version
- Official FLIP2 manuscript; retrieved 2026-09-19; exact bytes pinned
- split
- low-to-high
- population
- hydro
- inputs
- unreported
- adaptation
- random-initialized supervised training
- aggregation
- metric-specific; inspect each result
Metadata review: discovered. Unreported conditions prevent automatic comparisons.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
22 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.comparison.adaptation random-initialized supervised training Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A11; row ESMC-300M naive supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.aggregation metric-specific; inspect each result Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A11; row ESMC-300M naive supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.dataset_version Official FLIP2 manuscript; retrieved 2026-09-19; exact bytes pinned Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A11; row ESMC-300M naive supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.inputs unreported Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A11; row ESMC-300M naive supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.population hydro Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A11; row ESMC-300M naive supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.protocol_id acquired-protocol-2a25c278d301f1b27a06 Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A11; row ESMC-300M naive supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.split low-to-high Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A11; row ESMC-300M naive supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.conditions.adaptation random-initialized supervised training Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A11; row ESMC-300M naive supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.conditions.checkpoint_hash No value recorded Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A11; row ESMC-300M naive supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.conditions.comparison_scope Table A11, same metric only Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A11; row ESMC-300M naive supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
View linked audit checks and correction history
Release 2026-09-19-eb6149e5d766 · Record review: discovered
1 source records and release history
- FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Original source · Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Technical metadata and extraction receipts
Stable ID: acquired-evaluation-30fe7a61751d0af671be
- origin
- author_reported
- protocol
- FLIP2 hydro low-to-high; held-out test set
- source locator
- Table A11; row ESMC-300M naive supervised; column spearman
- conditions
- adaptation: random-initialized supervised training; checkpoint hash: Not reported; comparison scope: Table A11, same metric only; eligible count: Not reported; scored count: Not reported; seed count: 5; spread definition: unreported in inspected text; do not infer standard deviation
- comparison
- protocol id: acquired-protocol-2a25c278d301f1b27a06; dataset version: Official FLIP2 manuscript; retrieved 2026-09-19; exact bytes pinned; split: low-to-high; population: hydro; inputs: unreported; adaptation: random-initialized supervised training; aggregation: metric-specific; inspect each result
- missing metadata
- checkpoint revision: unreported; scored count: unreported
Related records
- model: ESMC-300M naive supervised
- benchmark: FLIP2 hydro low-to-high; held-out test set · hydro
- dataset: hydro
- evaluation: ESMC-300M naive supervised · ndcg · hydro
- evaluation: ESMC-300M naive supervised · spearman · hydro