Task

NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation

Fitness prediction on mRNA assays, supervised, contiguous cross validation. Scored with Spearman ρ on NABench mRNA assays. Scored supervised, contiguous cross validation across the NABench mRNA assays.

25 evaluations · 25 metric rows

Overview

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluation design

Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.

Benchmarks

NABench

These source-backed links do not make different protocols or scores interchangeable.

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Explore all linked results

Run instructions

No runnable recipe has been reviewed for this task. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

A task describes a biological question. Choose a linked protocol to obtain concrete split and scoring instructions.

Published comparisons

Explore the results reported under one evaluation protocol. Each figure keeps its source, dataset and metric together; it is not a ranking across studies. The pooled view gathers every source table that reports the same metric and names what it does not hold constant.

Comparison and metric

NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation

spearman (correlation) · Higher values are better for this metric.

Every method NABench reports on Fitness prediction on mRNA assays, supervised, contiguous cross validation, scored with Spearman ρ on NABench mRNA assays.

Evaluation protocol · NABench mRNA assays (NABench split)

RNA-FM · Configuration · Author-reported evaluation0.259
LucaOne · Configuration · Author-reported evaluation0.304
RESM · Configuration · Author-reported evaluation0.200
Enformer · Configuration · Author-reported evaluation0.278
GENERator-3B · Configuration · Author-reported evaluation0.290
structRFM · Configuration · Author-reported evaluation0.136
SPACE · Configuration · Author-reported evaluation0.112
N.T.-v2-50m · Configuration · Author-reported evaluation0.073
Evo_1.5_8k_base · Configuration · Author-reported evaluation0.227
Evo2-7B · Configuration · Author-reported evaluation0.221
Crafts · Configuration · Author-reported evaluation0.124
Evo_1_8k_base · Configuration · Author-reported evaluation0.172
Evo_1_8k · Configuration · Author-reported evaluation0.172
BiRNA-BERT · Configuration · Author-reported evaluation0.238
RNAernie · Configuration · Author-reported evaluation0.247
Evo2-7B-base · Configuration · Author-reported evaluation0.176
GENA-LM-large · Configuration · Author-reported evaluation0.105
HyenaDNA · Configuration · Author-reported evaluation0.232
RiNALMo_giga · Configuration · Author-reported evaluation0.093
GenerRNA · Configuration · Author-reported evaluation0.103
Dnabert · Configuration · Author-reported evaluation0.167
AIDO.RNA · Configuration · Author-reported evaluation0.143
LucaVirus · Configuration · Author-reported evaluation0.224
GenSLM · Configuration · Author-reported evaluation0.103
Dnabert_6 · Configuration · Author-reported evaluation0.121

Source order is preserved. Plotted marks show point estimates; uncertainty, where reported, is retained in the printed values and table. Differences do not establish statistical significance.

NABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, column(mRNA)

Values, uncertainty and evidence

spearman: original source values
Tested entity	Printed value	Uncertainty	Evidence
RNA-FM · Configuration	0.259 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(RNA-FM), column(mRNA)
LucaOne · Configuration	0.304 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(LucaOne), column(mRNA)
RESM · Configuration	0.200 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(RESM), column(mRNA)
Enformer · Configuration	0.278 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Enformer), column(mRNA)
GENERator-3B · Configuration	0.290 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(GENERator-3B), column(mRNA)
structRFM · Configuration	0.136 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(structRFM), column(mRNA)
SPACE · Configuration	0.112 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(SPACE), column(mRNA)
N.T.-v2-50m · Configuration	0.073 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(N.T.-v2-50m), column(mRNA)
Evo_1.5_8k_base · Configuration	0.227 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Evo_1.5_8k_base), column(mRNA)
Evo2-7B · Configuration	0.221 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Evo2-7B), column(mRNA)
Crafts · Configuration	0.124 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Crafts), column(mRNA)
Evo_1_8k_base · Configuration	0.172 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Evo_1_8k_base), column(mRNA)
Evo_1_8k · Configuration	0.172 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Evo_1_8k), column(mRNA)
BiRNA-BERT · Configuration	0.238 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(BiRNA-BERT), column(mRNA)
RNAernie · Configuration	0.247 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(RNAernie), column(mRNA)
Evo2-7B-base · Configuration	0.176 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Evo2-7B-base), column(mRNA)
GENA-LM-large · Configuration	0.105 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(GENA-LM-large), column(mRNA)
HyenaDNA · Configuration	0.232 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(HyenaDNA), column(mRNA)
RiNALMo_giga · Configuration	0.093 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(RiNALMo_giga), column(mRNA)
GenerRNA · Configuration	0.103 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(GenerRNA), column(mRNA)
Dnabert · Configuration	0.167 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Dnabert), column(mRNA)
AIDO.RNA · Configuration	0.143 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(AIDO.RNA), column(mRNA)
LucaVirus · Configuration	0.224 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(LucaVirus), column(mRNA)
GenSLM · Configuration	0.103 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(GenSLM), column(mRNA)
Dnabert_6 · Configuration	0.121 correlation	Not reported	Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Dnabert_6), column(mRNA)

Scope and limitations

Author-reported numbers, source checked but not independently reproduced.
Zero-shot, few-shot and supervised cross validation figures come from different protocols and are not comparable to each other.
The per-nucleotide-type figures and the overall figures describe the same runs at different resolutions, so they must not be combined.

Source transcription and grouping reviewed by automated source review on 2026-09-18. These experiments were not independently reproduced by rewire.

Tested entities and results

Release 2026-09-17-134cd1815de8 · 25 evaluations · 25 metric rows. Different protocols are not a single leaderboard. Where several source tables report the same metric, the published comparisons above offer a pooled view that names what it does not hold constant.

Evaluation setupMetricEvidence origin

Results grouped by the exact reported evaluation
Metric and finding	Coverage and uncertainty	Evidence
AIDO.RNA on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: AIDO.RNATask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.143 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(AIDO.RNA), column(mRNA) Source checking is not independent reproduction.
BiRNA-BERT on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: BiRNA-BERTTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.238 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(BiRNA-BERT), column(mRNA) Source checking is not independent reproduction.
Crafts on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: CraftsTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.124 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Crafts), column(mRNA) Source checking is not independent reproduction.
Dnabert_6 on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: Dnabert_6Task: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.121 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Dnabert_6), column(mRNA) Source checking is not independent reproduction.
Dnabert on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: DnabertTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.167 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Dnabert), column(mRNA) Source checking is not independent reproduction.
Enformer on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: EnformerTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.278 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Enformer), column(mRNA) Source checking is not independent reproduction.
Evo_1.5_8k_base on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: Evo_1.5_8k_baseTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.227 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Evo_1.5_8k_base), column(mRNA) Source checking is not independent reproduction.
Evo_1_8k_base on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: Evo_1_8k_baseTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.172 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Evo_1_8k_base), column(mRNA) Source checking is not independent reproduction.
Evo_1_8k on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: Evo_1_8kTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.172 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Evo_1_8k), column(mRNA) Source checking is not independent reproduction.
Evo2-7B-base on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: Evo2-7B-baseTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.176 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Evo2-7B-base), column(mRNA) Source checking is not independent reproduction.
Evo2-7B on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: Evo2-7BTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.221 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(Evo2-7B), column(mRNA) Source checking is not independent reproduction.
GENA-LM-large on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: GENA-LM-largeTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.105 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(GENA-LM-large), column(mRNA) Source checking is not independent reproduction.
GENERator-3B on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: GENERator-3BTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.290 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(GENERator-3B), column(mRNA) Source checking is not independent reproduction.
GenerRNA on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: GenerRNATask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.103 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(GenerRNA), column(mRNA) Source checking is not independent reproduction.
GenSLM on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: GenSLMTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.103 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(GenSLM), column(mRNA) Source checking is not independent reproduction.
HyenaDNA on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: HyenaDNATask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.232 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(HyenaDNA), column(mRNA) Source checking is not independent reproduction.
LucaOne on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: LucaOneTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.304 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(LucaOne), column(mRNA) Source checking is not independent reproduction.
LucaVirus on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: LucaVirusTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.224 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(LucaVirus), column(mRNA) Source checking is not independent reproduction.
N.T.-v2-50m on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: N.T.-v2-50mTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.073 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(N.T.-v2-50m), column(mRNA) Source checking is not independent reproduction.
RESM on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: RESMTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.200 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(RESM), column(mRNA) Source checking is not independent reproduction.
RiNALMo_giga on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: RiNALMo_gigaTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.093 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(RiNALMo_giga), column(mRNA) Source checking is not independent reproduction.
RNA-FM on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: RNA-FMTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.259 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(RNA-FM), column(mRNA) Source checking is not independent reproduction.
RNAernie on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: RNAernieTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.247 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(RNAernie), column(mRNA) Source checking is not independent reproduction.
SPACE on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: SPACETask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.112 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(SPACE), column(mRNA) Source checking is not independent reproduction.
structRFM on NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation Configuration: structRFMTask: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validationDataset subset: NABench mRNA assays (NABench split) Scored supervised, contiguous cross validation across the NABench mRNA assays. Author-reported evaluation · Evaluation metadata: source checked
0.136 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 11, row(structRFM), column(mRNA) Source checking is not independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-09-17-134cd1815de8
Property and statement	Original source and location	Review and provenance
Relationship: part of discovery-benchmark-nabench Individual claims	NABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction Original source ↗ Table 11, column(mRNA) Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 Retrieved: 2026-09-17T08:06:28.183421+00:00	source checked automated source review · 2026-09-18 Audit details Primary-source transcription with no human sign-off and no independent reproduction. Field: `links:part_of:discovery-benchmark-nabench` Claim: nabench-association-ccv-corr-mrna Source artifact SHA-256: `fefd48d53b1a7eadf9e14db96adacc8e646304c1b592562d9f136f4508941350` Hash scope: Exact retrieved primary paper artifact bytes. Inspected artifact

All evidence (CSV)All evidence (JSONL)How to read the evidence

Sources and history

Release 2026-09-17-134cd1815de8 · Record review: source checked

1 source records and release history

NABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Original source · Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256

Download this release

Technical metadata and extraction receipts

Stable ID: nabench-task-ccv-corr-mrna

areas: rna-transcriptomes
tasks: Fitness prediction on mRNA assays, supervised, contiguous cross validation
metric: Spearman ρ
metric direction: higher
dataset: NABench mRNA assays
protocol: Scored supervised, contiguous cross validation across the NABench mRNA assays.
source locator: Table 11, column(mRNA)
comparison panels: id: nabench-panel-ccv-corr-mrna; title: NABench CCV-CORR-MRNA: Fitness prediction on mRNA assays, supervised, contiguous cross validation; protocol id: nabench-task-ccv-corr-mrna; dataset id: nabench-dataset-nabench-mrna-assays; metric: spearman; unit: correlation; direction: higher; result ids: nabench-result-rna-fm-ccv-corr-mrna-spearman; nabench-result-lucaone-ccv-corr-mrna-spearman; nabench-result-resm-ccv-corr-mrna-spearman; nabench-result-enformer-ccv-corr-mrna-spearman; nabench-result-generator-3b-ccv-corr-mrna-spearman; nabench-result-structrfm-ccv-corr-mrna-spearman; nabench-result-space-ccv-corr-mrna-spearman; nabench-result-n-t-v2-50m-ccv-corr-mrna-spearman; nabench-result-evo-1-5-8k-base-ccv-corr-mrna-spearman; nabench-result-evo2-7b-ccv-corr-mrna-spearman; nabench-result-crafts-ccv-corr-mrna-spearman; nabench-result-evo-1-8k-base-ccv-corr-mrna-spearman; nabench-result-evo-1-8k-ccv-corr-mrna-spearman; nabench-result-birna-bert-ccv-corr-mrna-spearman; nabench-result-rnaernie-ccv-corr-mrna-spearman; nabench-result-evo2-7b-base-ccv-corr-mrna-spearman; nabench-result-gena-lm-large-ccv-corr-mrna-spearman; nabench-result-hyenadna-ccv-corr-mrna-spearman; nabench-result-rinalmo-giga-ccv-corr-mrna-spearman; nabench-result-generrna-ccv-corr-mrna-spearman; nabench-result-dnabert-ccv-corr-mrna-spearman; nabench-result-aido-rna-ccv-corr-mrna-spearman; nabench-result-lucavirus-ccv-corr-mrna-spearman; nabench-result-genslm-ccv-corr-mrna-spearman; nabench-result-dnabert-6-ccv-corr-mrna-spearman; source ids: evidence-expansion-nabench-fefd48d5; source locator: Table 11, column(mRNA); context: Every method NABench reports on Fitness prediction on mRNA assays, supervised, contiguous cross validation, scored with Spearman ρ on NABench mRNA assays.; caveats: Author-reported numbers, source checked but not independently reproduced.; Zero-shot, few-shot and supervised cross validation figures come from different protocols and are not comparable to each other.; The per-nucleotide-type figures and the overall figures describe the same runs at different resolutions, so they must not be combined.; review: method: automated_source_review; date: 2026-09-18

Related records

Suggest a correction