rewire.it
Configuration

CARP-640M naive supervised

Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred.

16 evaluations · 32 metric rows

Overview

Exact source-reported configuration or submission label. Family membership, checkpoint identity and aliases have not been inferred.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

Release 2026-09-19-eb6149e5d766 · 16 evaluations · 32 metric rows. Different protocols are not a single leaderboard. Charts retain each source table’s protocol and dataset.

Results grouped by the exact reported evaluation
Metric and findingCoverage and uncertaintyEvidence
CARP-640M naive supervised · FLIP2 Amylase far-to-close; held-out test set · Amylase

FLIP2 Amylase far-to-close; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.825 ± 0.009 ndcg

Unit: unitless · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.009; type: unreported; value: 0.009

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A3; row CARP-640M naive supervised; column ndcg

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 TrpB one-to-many; held-out test set · TrpB

FLIP2 TrpB one-to-many; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.298 ± 0.217 spearman

Unit: correlation · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.217; type: unreported; value: 0.217

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A7; row CARP-640M naive supervised; column spearman

Source checking is not independent reproduction.

0.984 ± 0.002 ndcg

Unit: unitless · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.002; type: unreported; value: 0.002

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A7; row CARP-640M naive supervised; column ndcg

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 TrpB two-to-many; held-out test set · TrpB

FLIP2 TrpB two-to-many; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.985 ± 0.002 ndcg

Unit: unitless · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.002; type: unreported; value: 0.002

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A8; row CARP-640M naive supervised; column ndcg

Source checking is not independent reproduction.

0.328 ± 0.095 spearman

Unit: correlation · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.095; type: unreported; value: 0.095

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A8; row CARP-640M naive supervised; column spearman

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 hydro to-P06241; held-out test set · hydro

FLIP2 hydro to-P06241; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.927 ± 0.006 ndcg

Unit: unitless · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.006; type: unreported; value: 0.006

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A12; row CARP-640M naive supervised; column ndcg

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 hydro to-P01053; held-out test set · hydro

FLIP2 hydro to-P01053; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.061 ± 0.094 spearman

Unit: correlation · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.094; type: unreported; value: 0.094

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A14; row CARP-640M naive supervised; column spearman

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 rhomax by-wild-type; held-out test set · rhomax

FLIP2 rhomax by-wild-type; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.934 ± 0.009 ndcg

Unit: unitless · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.009; type: unreported; value: 0.009

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A15; row CARP-640M naive supervised; column ndcg

Source checking is not independent reproduction.

0.056 ± 0.125 spearman

Unit: correlation · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.125; type: unreported; value: 0.125

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A15; row CARP-640M naive supervised; column spearman

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 PDZ3 single-to-double; held-out test set · PDZ3

FLIP2 PDZ3 single-to-double; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.870 ± 0.008 ndcg

Unit: unitless · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.008; type: unreported; value: 0.008

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A16; row CARP-640M naive supervised; column ndcg

Source checking is not independent reproduction.

0.464 ± 0.022 spearman

Unit: correlation · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.022; type: unreported; value: 0.022

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A16; row CARP-640M naive supervised; column spearman

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 Amylase by-mutation; held-out test set · Amylase

FLIP2 Amylase by-mutation; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.109 ± 0.134 spearman

Unit: correlation · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.134; type: unreported; value: 0.134

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A4; row CARP-640M naive supervised; column spearman

Source checking is not independent reproduction.

0.819 ± 0.029 ndcg

Unit: unitless · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.029; type: unreported; value: 0.029

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A4; row CARP-640M naive supervised; column ndcg

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 IRED two-to-many; held-out test set · IRED

FLIP2 IRED two-to-many; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.012 ± 0.017 spearman

Unit: correlation · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.017; type: unreported; value: 0.017

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A5; row CARP-640M naive supervised; column spearman

Source checking is not independent reproduction.

0.944 ± 0.001 ndcg

Unit: unitless · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.001; type: unreported; value: 0.001

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A5; row CARP-640M naive supervised; column ndcg

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 TrpB by-position; held-out test set · TrpB

FLIP2 TrpB by-position; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

−0.009 ± nan spearman

Unit: correlation · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: nan; type: unreported; value: Not reported

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A9; row CARP-640M naive supervised; column spearman

Source checking is not independent reproduction.

0.975 ± 0.000 ndcg

Unit: unitless · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.000; type: unreported; value: 0

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A9; row CARP-640M naive supervised; column ndcg

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 Amylase one-to-many; held-out test set · Amylase

FLIP2 Amylase one-to-many; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.087 ± 0.172 spearman

Unit: correlation · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.172; type: unreported; value: 0.172

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A1; row CARP-640M naive supervised; column spearman

Source checking is not independent reproduction.

0.863 ± 0.023 ndcg

Unit: unitless · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.023; type: unreported; value: 0.023

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A1; row CARP-640M naive supervised; column ndcg

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 Amylase close-to-far; held-out test set · Amylase

FLIP2 Amylase close-to-far; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.006 ± 0.117 spearman

Unit: correlation · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.117; type: unreported; value: 0.117

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A2; row CARP-640M naive supervised; column spearman

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 hydro low-to-high; held-out test set · hydro

FLIP2 hydro low-to-high; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.188 ± 0.202 spearman

Unit: correlation · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.202; type: unreported; value: 0.202

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A11; row CARP-640M naive supervised; column spearman

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 hydro to-P0A9X9; held-out test set · hydro

FLIP2 hydro to-P0A9X9; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.960 ± 0.002 ndcg

Unit: unitless · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.002; type: unreported; value: 0.002

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A13; row CARP-640M naive supervised; column ndcg

Source checking is not independent reproduction.

−0.029 ± 0.074 spearman

Unit: correlation · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.074; type: unreported; value: 0.074

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A13; row CARP-640M naive supervised; column spearman

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 NucB two-to-many; held-out test set · NucB

FLIP2 NucB two-to-many; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.704 ± 0.007 spearman

Unit: correlation · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.007; type: unreported; value: 0.007

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A6; row CARP-640M naive supervised; column spearman

Source checking is not independent reproduction.

CARP-640M naive supervised · FLIP2 hydro three-to-many; held-out test set · hydro

FLIP2 hydro three-to-many; held-out test set

Author-reported evaluation · Evaluation metadata: discovered

0.984 ± 0.001 ndcg

Unit: unitless · Direction: higher

Aggregation: mean of five random-seed fits (Section 4.3)

Uncertainty: printed spread: 0.001; type: unreported; value: 0.001

Scored: Not reported · Eligible: Not reported

source checkedFLIP2: Expanding Protein Fitness Landscape Benchmarks for Real-World Machine Learning Applications · Table A10; row CARP-640M naive supervised; column ndcg

Source checking is not independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-09-19-eb6149e5d766
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

View linked audit checks and correction history

Release 2026-09-19-eb6149e5d766 · Record review: discovered

1 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: acquired-configuration-a0a6e3bb087d0e8b2b3e

source locator
Table A1; row CARP-640M naive supervised; column spearman
reported configuration
CARP-640M naive supervised
reference kind
not_a_reference
missing metadata
checkpoint revision: unreported; model family: unextracted
Related records

Suggest a correction