ESM2-650M likelihood · FLIP2 Amylase close-to-far; held-out test set · Amylase
FLIP2 Amylase close-to-far; held-out test set; Amylase. Source checked, not independently reproduced.
Evaluation results
Release 2026-09-19-eb6149e5d766 · 1 evaluation · 2 metric rows. Different protocols are not a single leaderboard. Charts retain each source table’s protocol and dataset.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| ESM2-650M likelihood · FLIP2 Amylase close-to-far; held-out test set · Amylase Configuration: ESM2-650M likelihoodProtocol: FLIP2 Amylase close-to-far; held-out test set · AmylaseDataset subset: Amylase FLIP2 Amylase close-to-far; held-out test set Author-reported evaluation · Evaluation metadata: discovered | ||
| 0.955 ndcg Unit: unitless · Direction: higher Aggregation: reported point estimate | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A2; row ESM2-650M likelihood; column ndcg Source checking is not independent reproduction. |
| 0.617 spearman Unit: correlation · Direction: higher Aggregation: reported point estimate | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A2; row ESM2-650M likelihood; column spearman Source checking is not independent reproduction. |
Methods and reproduction
FLIP2 Amylase close-to-far; held-out test set; Amylase. Source checked, not independently reproduced.
- configuration
- ESM2-650M likelihood
- protocol
- FLIP2 Amylase close-to-far; held-out test set · Amylase
- dataset subset
- Amylase
- Split
- close-to-far
- Adaptation
- zero-shot likelihood
- Scoring implementation
- Not reported
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evaluation procedure
FLIP2 Amylase close-to-far; held-out test set
- Configuration
- ESM2-650M likelihood
- Protocol
- FLIP2 Amylase close-to-far; held-out test set · Amylase
- Dataset subset
- Amylase
- origin
- Author-reported evaluation
- configuration
- Not reported
- protocol id
- acquired-protocol-677b87f02518f844ef73
- dataset version
- Official FLIP2 manuscript; retrieved 2026-09-19; exact bytes pinned
- split
- close-to-far
- population
- Amylase
- inputs
- unreported
- adaptation
- zero-shot likelihood
- aggregation
- metric-specific; inspect each result
Metadata review: discovered. Unreported conditions prevent automatic comparisons.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
22 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.comparison.adaptation zero-shot likelihood Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A2; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.aggregation metric-specific; inspect each result Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A2; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.dataset_version Official FLIP2 manuscript; retrieved 2026-09-19; exact bytes pinned Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A2; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.inputs unreported Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A2; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.population Amylase Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A2; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.protocol_id acquired-protocol-677b87f02518f844ef73 Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A2; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.split close-to-far Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A2; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.conditions.adaptation zero-shot likelihood Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A2; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.conditions.checkpoint_hash No value recorded Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A2; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.conditions.comparison_scope Table A2, same metric only Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A2; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
View linked audit checks and correction history
Release 2026-09-19-eb6149e5d766 · Record review: discovered
1 source records and release history
- FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Original source · Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Technical metadata and extraction receipts
Stable ID: acquired-evaluation-f98684f543cdd7612f05
- origin
- author_reported
- protocol
- FLIP2 Amylase close-to-far; held-out test set
- source locator
- Table A2; row ESM2-650M likelihood; column spearman
- conditions
- adaptation: zero-shot likelihood; checkpoint hash: Not reported; comparison scope: Table A2, same metric only; eligible count: Not reported; scored count: Not reported; seed count: Not reported; spread definition: unreported in inspected text; do not infer standard deviation
- comparison
- protocol id: acquired-protocol-677b87f02518f844ef73; dataset version: Official FLIP2 manuscript; retrieved 2026-09-19; exact bytes pinned; split: close-to-far; population: Amylase; inputs: unreported; adaptation: zero-shot likelihood; aggregation: metric-specific; inspect each result
- missing metadata
- checkpoint revision: unreported; scored count: unreported
Related records
- model: ESM2-650M likelihood
- benchmark: FLIP2 Amylase close-to-far; held-out test set · Amylase
- dataset: Amylase
- evaluation: ESM2-650M likelihood · ndcg · Amylase
- evaluation: ESM2-650M likelihood · spearman · Amylase