ESM2-650M likelihood · FLIP2 TrpB by-position; held-out test set · TrpB
FLIP2 TrpB by-position; held-out test set; TrpB. Source checked, not independently reproduced.
Evaluation results
Release 2026-09-19-eb6149e5d766 · 1 evaluation · 2 metric rows. Different protocols are not a single leaderboard. Charts retain each source table’s protocol and dataset.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| ESM2-650M likelihood · FLIP2 TrpB by-position; held-out test set · TrpB Configuration: ESM2-650M likelihoodProtocol: FLIP2 TrpB by-position; held-out test set · TrpBDataset subset: TrpB FLIP2 TrpB by-position; held-out test set Author-reported evaluation · Evaluation metadata: discovered | ||
| 0.988 ndcg Unit: unitless · Direction: higher Aggregation: reported point estimate | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A9; row ESM2-650M likelihood; column ndcg Source checking is not independent reproduction. |
| 0.260 spearman Unit: correlation · Direction: higher Aggregation: reported point estimate | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A9; row ESM2-650M likelihood; column spearman Source checking is not independent reproduction. |
Methods and reproduction
FLIP2 TrpB by-position; held-out test set; TrpB. Source checked, not independently reproduced.
- configuration
- ESM2-650M likelihood
- protocol
- FLIP2 TrpB by-position; held-out test set · TrpB
- dataset subset
- TrpB
- Split
- by-position
- Adaptation
- zero-shot likelihood
- Scoring implementation
- Not reported
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evaluation procedure
FLIP2 TrpB by-position; held-out test set
- Configuration
- ESM2-650M likelihood
- Protocol
- FLIP2 TrpB by-position; held-out test set · TrpB
- Dataset subset
- TrpB
- origin
- Author-reported evaluation
- configuration
- Not reported
- protocol id
- acquired-protocol-ed315b25923fa3e1f9a6
- dataset version
- Official FLIP2 manuscript; retrieved 2026-09-19; exact bytes pinned
- split
- by-position
- population
- TrpB
- inputs
- unreported
- adaptation
- zero-shot likelihood
- aggregation
- metric-specific; inspect each result
Metadata review: discovered. Unreported conditions prevent automatic comparisons.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
22 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.comparison.adaptation zero-shot likelihood Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A9; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.aggregation metric-specific; inspect each result Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A9; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.dataset_version Official FLIP2 manuscript; retrieved 2026-09-19; exact bytes pinned Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A9; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.inputs unreported Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A9; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.population TrpB Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A9; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.protocol_id acquired-protocol-ed315b25923fa3e1f9a6 Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A9; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.split by-position Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A9; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.conditions.adaptation zero-shot likelihood Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A9; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.conditions.checkpoint_hash No value recorded Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A9; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.conditions.comparison_scope Table A9, same metric only Context-only references | FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications Table A9; row ESM2-650M likelihood; column spearman Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
View linked audit checks and correction history
Release 2026-09-19-eb6149e5d766 · Record review: discovered
1 source records and release history
- FLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Original source · Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Technical metadata and extraction receipts
Stable ID: acquired-evaluation-4c6eb28a935d84a26271
- origin
- author_reported
- protocol
- FLIP2 TrpB by-position; held-out test set
- source locator
- Table A9; row ESM2-650M likelihood; column spearman
- conditions
- adaptation: zero-shot likelihood; checkpoint hash: Not reported; comparison scope: Table A9, same metric only; eligible count: Not reported; scored count: Not reported; seed count: Not reported; spread definition: unreported in inspected text; do not infer standard deviation
- comparison
- protocol id: acquired-protocol-ed315b25923fa3e1f9a6; dataset version: Official FLIP2 manuscript; retrieved 2026-09-19; exact bytes pinned; split: by-position; population: TrpB; inputs: unreported; adaptation: zero-shot likelihood; aggregation: metric-specific; inspect each result
- missing metadata
- checkpoint revision: unreported; scored count: unreported
Related records
- model: ESM2-650M likelihood
- benchmark: FLIP2 TrpB by-position; held-out test set · TrpB
- dataset: TrpB
- evaluation: ESM2-650M likelihood · ndcg · TrpB
- evaluation: ESM2-650M likelihood · spearman · TrpB