ESMC-300M supervised · FLIP2 hydro to-P0A9X9; held-out test set · hydro
FLIP2 hydro to-P0A9X9; held-out test set; hydro. Source checked, not independently reproduced.
Evaluation results
Release 2026-09-19-eb6149e5d766 · 1 evaluation · 2 metric rows. Different protocols are not a single leaderboard. Charts retain each source table’s protocol and dataset.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| ESMC-300M supervised · FLIP2 hydro to-P0A9X9; held-out test set · hydro Configuration: ESMC-300M supervisedProtocol: FLIP2 hydro to-P0A9X9; held-out test set · hydroDataset subset: hydro FLIP2 hydro to-P0A9X9; held-out test set Author-reported evaluation · Evaluation metadata: discovered | ||
| 0.078 ± 0.133 spearman Unit: correlation · Direction: higher Aggregation: mean of five random-seed fits (Section 4.3) | Uncertainty: printed spread: 0.133; type: unreported; value: 0.133 Scored: Not reported · Eligible: Not reported | source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A13; row ESMC-300M supervised; column spearman Source checking is not independent reproduction. |
| 0.970 ± 0.001 ndcg Unit: unitless · Direction: higher Aggregation: mean of five random-seed fits (Section 4.3) | Uncertainty: printed spread: 0.001; type: unreported; value: 0.001 Scored: Not reported · Eligible: Not reported | source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A13; row ESMC-300M supervised; column ndcg Source checking is not independent reproduction. |
Methods and reproduction
FLIP2 hydro to-P0A9X9; held-out test set; hydro. Source checked, not independently reproduced.
- configuration
- ESMC-300M supervised
- protocol
- FLIP2 hydro to-P0A9X9; held-out test set · hydro
- dataset subset
- hydro
- Split
- to-P0A9X9
- Adaptation
- fine-tuned pretrained model
- Scoring implementation
- Not reported
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evaluation procedure
FLIP2 hydro to-P0A9X9; held-out test set
- Configuration
- ESMC-300M supervised
- Protocol
- FLIP2 hydro to-P0A9X9; held-out test set · hydro
- Dataset subset
- hydro
- origin
- Author-reported evaluation
- configuration
- Not reported
- protocol id
- acquired-protocol-e693882416f4067e6939
- dataset version
- Official FLIP2 manuscript; retrieved 2026-09-19; exact bytes pinned
- split
- to-P0A9X9
- population
- hydro
- inputs
- unreported
- adaptation
- fine-tuned pretrained model
- aggregation
- metric-specific; inspect each result
Metadata review: discovered. Unreported conditions prevent automatic comparisons.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
22 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.comparison.adaptation fine-tuned pretrained model Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A13; row ESMC-300M supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.aggregation metric-specific; inspect each result Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A13; row ESMC-300M supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.dataset_version Official FLIP2 manuscript; retrieved 2026-09-19; exact bytes pinned Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A13; row ESMC-300M supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.inputs unreported Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A13; row ESMC-300M supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.population hydro Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A13; row ESMC-300M supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.protocol_id acquired-protocol-e693882416f4067e6939 Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A13; row ESMC-300M supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.split to-P0A9X9 Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A13; row ESMC-300M supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.conditions.adaptation fine-tuned pretrained model Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A13; row ESMC-300M supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.conditions.checkpoint_hash No value recorded Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A13; row ESMC-300M supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.conditions.comparison_scope Table A13, same metric only Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A13; row ESMC-300M supervised; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
View linked audit checks and correction history
Release 2026-09-19-eb6149e5d766 · Record review: discovered
1 source records and release history
- FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Original source · Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Technical metadata and extraction receipts
Stable ID: acquired-evaluation-142005cb36f413fc72d0
- origin
- author_reported
- protocol
- FLIP2 hydro to-P0A9X9; held-out test set
- source locator
- Table A13; row ESMC-300M supervised; column spearman
- conditions
- adaptation: fine-tuned pretrained model; checkpoint hash: Not reported; comparison scope: Table A13, same metric only; eligible count: Not reported; scored count: Not reported; seed count: 5; spread definition: unreported in inspected text; do not infer standard deviation
- comparison
- protocol id: acquired-protocol-e693882416f4067e6939; dataset version: Official FLIP2 manuscript; retrieved 2026-09-19; exact bytes pinned; split: to-P0A9X9; population: hydro; inputs: unreported; adaptation: fine-tuned pretrained model; aggregation: metric-specific; inspect each result
- missing metadata
- checkpoint revision: unreported; scored count: unreported
Related records
- model: ESMC-300M supervised
- benchmark: FLIP2 hydro to-P0A9X9; held-out test set · hydro
- dataset: hydro
- evaluation: ESMC-300M supervised · spearman · hydro
- evaluation: ESMC-300M supervised · ndcg · hydro