rewire.it
benchmark · suite

FLIP

FLIP tests protein fitness prediction under deliberately different generalization splits.

0 evaluations · 0 metric rows

At a glance

Explanatory profile: source reviewed · Automated source review, 2026-09-16. This does not change the review status of its results.

Data, procedure and scoring
PropertyDescription and evidence
Record typeDataset and split suiteJ-SNACKKB/FLIP official source · README: Folder breakup; Find out more about the splits; Split semaphore
InputsProtein sequences with experimental fitness measurementsJ-SNACKKB/FLIP official source · README: Folder breakup; Find out more about the splits; Split semaphore
Outputs and assessmentFitness prediction on the selected splitJ-SNACKKB/FLIP official source · README: Folder breakup; Find out more about the splits; Split semaphore
DatasetsNot extracted or verified for this record.
OrganismsNot extracted or verified for this record.
AssaysNot extracted or verified for this record.
SplitsNot extracted or verified for this record.
AdaptationNot extracted or verified for this record.
BaselinesNot extracted or verified for this record.

How it works

Procedure overview

Conceptual overview of the cited procedure; consult the pinned source for executable settings.

Procedure overviewSelect active split. Then: Fit fitness predictor. Then: Predict held-out variants. Then: Assess fitness predictionsSelect active splitFit fitness predictorPredict held-out variantsAssess fitness predictions
Read the diagram as text
  1. Select active split
  2. Fit fitness predictor
  3. Predict held-out variants
  4. Assess fitness predictions
J-SNACKKB/FLIP official source · README: Folder breakup; Find out more about the splits; Split semaphore

Procedure

Select an active released split, fit the selected sequence-to-fitness method on its training data and assess its test variants. The repository documents split construction and baseline implementations.

J-SNACKKB/FLIP official source · README: Folder breakup; Find out more about the splits; Split semaphore

Tested models and results

Release 2026-09-16-d74d282221a9 · 0 evaluations · 0 metric rows. Different protocols are not a single leaderboard.

No evaluations linked in this release.

Strengths and limitations

Strengths supported by sources

  • Split definitions make the intended generalization challenge explicit.J-SNACKKB/FLIP official source · README: Folder breakup; Find out more about the splits; Split semaphore

Limitations and conditions

  • Orange splits may overestimate performance; red splits are obsolete and should not support new comparisons.J-SNACKKB/FLIP official source · README: Folder breakup; Find out more about the splits; Split semaphore
Profile review details

Primary-source description checked by an automated research assistant. This is a profile review, not an independent execution or numerical reproduction.

Stable record: discovery-benchmark-flip

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: discovered

Download this release
Technical metadata and extraction receipts

Stable ID: discovery-benchmark-flip

areas
protein-function
entity level
suite
missing metadata
dataset release: unextracted; metric implementation: unextracted; split manifest: unextracted; version: unextracted
scope note
Specialist molecular or omics evaluation; protocol details require review before numerical comparison.
task
Generalisation in protein fitness landscapes
version
Not reported
Related records

    Suggest a correction