ESM-untrained (per AA) on FLIP THERMOSTABILITY-MIXED: Thermostability fitness prediction, Mixed split
FLIP evaluation of ESM-untrained (per AA) on Thermostability fitness prediction, Mixed split, scored with Spearman correlation.
Methods and reproduction
FLIP evaluation of ESM-untrained (per AA) on Thermostability fitness prediction, Mixed split, scored with Spearman correlation.
- task
- FLIP THERMOSTABILITY-MIXED: Thermostability fitness prediction, Mixed split
- configuration
- ESM-untrained (per AA)
- dataset subset
- FLIP Thermostability, Mixed split (FLIP split)
- Split
- Not reported
- Adaptation
- Not reported
- Scoring implementation
- Spearman correlation
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evaluation procedure
Trained on the split's training set with ten percent held out for validation, scored on its test set.
- Configuration
- ESM-untrained (per AA)
- Task
- FLIP THERMOSTABILITY-MIXED: Thermostability fitness prediction, Mixed split
- Dataset subset
- FLIP Thermostability, Mixed split (FLIP split)
- origin
- Author-reported evaluation
- configuration
- Not reported
- protocol id
- flip-task-thermostability-mixed
- metric implementation
- Spearman correlation
Metadata review: source checked. Unreported conditions prevent automatic comparisons.
Evaluation results
Release 2026-09-17-134cd1815de8 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard. Where several source tables report the same metric, the published comparisons above offer a pooled view that names what it does not hold constant.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| ESM-untrained (per AA) on FLIP THERMOSTABILITY-MIXED: Thermostability fitness prediction, Mixed split Configuration: ESM-untrained (per AA)Task: FLIP THERMOSTABILITY-MIXED: Thermostability fitness prediction, Mixed splitDataset subset: FLIP Thermostability, Mixed split (FLIP split) Trained on the split's training set with ten percent held out for validation, scored on its test set. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.44 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedflip primary benchmark evidence · Table 6, row(ESM-untrained (per AA)), column(Mixed) Source checking is not independent reproduction. |
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
10 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.comparison.metric_implementation Spearman correlation Context-only references | flip primary benchmark evidence Table 6, row(ESM-untrained (per AA)), column(Mixed) Version: 2021 manuscript | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.protocol_id flip-task-thermostability-mixed Context-only references | flip primary benchmark evidence Table 6, row(ESM-untrained (per AA)), column(Mixed) Version: 2021 manuscript | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.origin author_reported Context-only references | flip primary benchmark evidence Table 6, row(ESM-untrained (per AA)), column(Mixed) Version: 2021 manuscript | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.protocol Trained on the split's training set with ten percent held out for validation, scored on its test set. Context-only references | flip primary benchmark evidence Table 6, row(ESM-untrained (per AA)), column(Mixed) Version: 2021 manuscript | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.source_locator Table 6, row(ESM-untrained (per AA)), column(Mixed) Context-only references | flip primary benchmark evidence Table 6, row(ESM-untrained (per AA)), column(Mixed) Version: 2021 manuscript | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| description FLIP evaluation of ESM-untrained (per AA) on Thermostability fitness prediction, Mixed split, scored with Spearman correlation. Context-only references | flip primary benchmark evidence Table 6, row(ESM-untrained (per AA)), column(Mixed) Version: 2021 manuscript | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Relationship: benchmark flip-task-thermostability-mixed Context-only references | flip primary benchmark evidence Table 6, row(ESM-untrained (per AA)), column(Mixed) Version: 2021 manuscript | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Relationship: dataset flip-dataset-flip-thermostability-mixed-split Context-only references | flip primary benchmark evidence Table 6, row(ESM-untrained (per AA)), column(Mixed) Version: 2021 manuscript | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Relationship: model flip-method-esm-untrained-per-aa Context-only references | flip primary benchmark evidence Table 6, row(ESM-untrained (per AA)), column(Mixed) Version: 2021 manuscript | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| name ESM-untrained (per AA) on FLIP THERMOSTABILITY-MIXED: Thermostability fitness prediction, Mixed split Context-only references | flip primary benchmark evidence Table 6, row(ESM-untrained (per AA)), column(Mixed) Version: 2021 manuscript | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
Release 2026-09-17-134cd1815de8 · Record review: source checked
1 source records and release history
- flip primary benchmark evidence · Original source · 2021 manuscript
Technical metadata and extraction receipts
Stable ID: flip-evaluation-esm-untrained-per-aa-thermostability-mixed
- areas
- proteins-complexes
- tasks
- Thermostability fitness prediction, Mixed split
- origin
- author_reported
- protocol
- Trained on the split's training set with ten percent held out for validation, scored on its test set.
- comparison
- protocol id: flip-task-thermostability-mixed; metric implementation: Spearman correlation
- missing metadata
- checkpoint revision: unreported; seeds: unreported; budget: unreported; split manifest: unextracted
- source locator
- Table 6, row(ESM-untrained (per AA)), column(Mixed)