NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ. Scored with Zero-shot Spearman ρ on NABench deep mutational scanning assays. Aggregated by the NABench authors across NABench deep mutational scanning assays.
Overview
Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ. Scored with Zero-shot Spearman ρ on NABench deep mutational scanning assays. Aggregated by the NABench authors across NABench deep mutational scanning assays.
Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.
Evaluation design
Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.
Benchmarks
These source-backed links do not make different protocols or scores interchangeable.
Recorded evaluations
Each evaluation records what was tested and under which conditions.
- AIDO.RNA on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- BiRNA-BERT on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- Crafts on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- Dnabert_6 on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- Dnabert on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- Enformer on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- Evo_1.5_8k_base on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- Evo_1_8k_base on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- Evo_1_8k on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- Evo2-7B-base on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- Evo2-7B on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- GENA-LM-large on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
Run instructions
No runnable recipe has been reviewed for this task. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.
A task describes a biological question. Choose a linked protocol to obtain concrete split and scoring instructions.
Published comparisons
Explore the results reported under one evaluation protocol. Each figure keeps its source, dataset and metric together; it is not a ranking across studies. The pooled view gathers every source table that reports the same metric and names what it does not hold constant.
NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
spearman (correlation) · Higher values are better for this metric.
Every method NABench reports on Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ, scored with Zero-shot Spearman ρ on NABench deep mutational scanning assays.
Evaluation protocol · NABench deep mutational scanning assays (NABench split)
- RNA-FM · Configuration · Author-reported evaluation0.148
- RNAernie · Configuration · Author-reported evaluation0.078
- SPACE · Configuration · Author-reported evaluation0.087
- AIDO.RNA · Configuration · Author-reported evaluation0.098
- BiRNA-BERT · Configuration · Author-reported evaluation0.093
- Crafts · Configuration · Author-reported evaluation0.128
- Dnabert · Configuration · Author-reported evaluation0.080
- Dnabert_6 · Configuration · Author-reported evaluation0.069
- Enformer · Configuration · Author-reported evaluation0.144
- Evo2-7B · Configuration · Author-reported evaluation0.126
- Evo2-7B-base · Configuration · Author-reported evaluation0.126
- Evo_1.5_8k_base · Configuration · Author-reported evaluation0.177
- Evo_1_8k · Configuration · Author-reported evaluation0.171
- Evo_1_8k_base · Configuration · Author-reported evaluation0.171
- GENA-LM-large · Configuration · Author-reported evaluation0.113
- GENERator-3B · Configuration · Author-reported evaluation0.097
- GenerRNA · Configuration · Author-reported evaluation0.079
- GenSLM · Configuration · Author-reported evaluation0.082
- HyenaDNA · Configuration · Author-reported evaluation0.094
- LucaOne · Configuration · Author-reported evaluation0.090
- LucaVirus · Configuration · Author-reported evaluation0.093
- N.T.-v2-50m · Configuration · Author-reported evaluation0.097
- RESM · Configuration · Author-reported evaluation0.172
- RiNALMo_giga · Configuration · Author-reported evaluation0.105
- structRFM · Configuration · Author-reported evaluation0.130
Source order is preserved. Plotted marks show point estimates; uncertainty, where reported, is retained in the printed values and table. Differences do not establish statistical significance.
NABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, column(Zero-shot Spearman ρ)Values, uncertainty and evidence
| Tested entity | Printed value | Uncertainty | Evidence |
|---|---|---|---|
| RNA-FM · Configuration | 0.148 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(RNA-FM), column(Zero-shot Spearman ρ) |
| RNAernie · Configuration | 0.078 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(RNAernie), column(Zero-shot Spearman ρ) |
| SPACE · Configuration | 0.087 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(SPACE), column(Zero-shot Spearman ρ) |
| AIDO.RNA · Configuration | 0.098 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(AIDO.RNA), column(Zero-shot Spearman ρ) |
| BiRNA-BERT · Configuration | 0.093 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(BiRNA-BERT), column(Zero-shot Spearman ρ) |
| Crafts · Configuration | 0.128 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Crafts), column(Zero-shot Spearman ρ) |
| Dnabert · Configuration | 0.080 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Dnabert), column(Zero-shot Spearman ρ) |
| Dnabert_6 · Configuration | 0.069 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Dnabert_6), column(Zero-shot Spearman ρ) |
| Enformer · Configuration | 0.144 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Enformer), column(Zero-shot Spearman ρ) |
| Evo2-7B · Configuration | 0.126 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Evo2-7B), column(Zero-shot Spearman ρ) |
| Evo2-7B-base · Configuration | 0.126 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Evo2-7B-base), column(Zero-shot Spearman ρ) |
| Evo_1.5_8k_base · Configuration | 0.177 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Evo_1.5_8k_base), column(Zero-shot Spearman ρ) |
| Evo_1_8k · Configuration | 0.171 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Evo_1_8k), column(Zero-shot Spearman ρ) |
| Evo_1_8k_base · Configuration | 0.171 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Evo_1_8k_base), column(Zero-shot Spearman ρ) |
| GENA-LM-large · Configuration | 0.113 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(GENA-LM-large), column(Zero-shot Spearman ρ) |
| GENERator-3B · Configuration | 0.097 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(GENERator-3B), column(Zero-shot Spearman ρ) |
| GenerRNA · Configuration | 0.079 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(GenerRNA), column(Zero-shot Spearman ρ) |
| GenSLM · Configuration | 0.082 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(GenSlm), column(Zero-shot Spearman ρ) |
| HyenaDNA · Configuration | 0.094 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(HyenaDNA), column(Zero-shot Spearman ρ) |
| LucaOne · Configuration | 0.090 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(LucaOne), column(Zero-shot Spearman ρ) |
| LucaVirus · Configuration | 0.093 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(LucaVirus), column(Zero-shot Spearman ρ) |
| N.T.-v2-50m · Configuration | 0.097 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(N.T.-v2-50m), column(Zero-shot Spearman ρ) |
| RESM · Configuration | 0.172 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(RESM), column(Zero-shot Spearman ρ) |
| RiNALMo_giga · Configuration | 0.105 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(RiNALMo_giga), column(Zero-shot Spearman ρ) |
| structRFM · Configuration | 0.130 correlation | Not reported | Author-reported evaluation · source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(structRFM), column(Zero-shot Spearman ρ) |
Scope and limitations
- Author-reported numbers, source checked but not independently reproduced.
- Zero-shot, few-shot and supervised cross validation figures come from different protocols and are not comparable to each other.
- The per-nucleotide-type figures and the overall figures describe the same runs at different resolutions, so they must not be combined.
Source transcription and grouping reviewed by automated source review on 2026-09-18. These experiments were not independently reproduced by rewire.
Tested entities and results
Release 2026-09-17-134cd1815de8 · 25 evaluations · 25 metric rows. Different protocols are not a single leaderboard. Where several source tables report the same metric, the published comparisons above offer a pooled view that names what it does not hold constant.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| AIDO.RNA on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: AIDO.RNATask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.098 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(AIDO.RNA), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| BiRNA-BERT on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: BiRNA-BERTTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.093 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(BiRNA-BERT), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| Crafts on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: CraftsTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.128 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Crafts), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| Dnabert_6 on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: Dnabert_6Task: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.069 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Dnabert_6), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| Dnabert on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: DnabertTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.080 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Dnabert), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| Enformer on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: EnformerTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.144 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Enformer), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| Evo_1.5_8k_base on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: Evo_1.5_8k_baseTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.177 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Evo_1.5_8k_base), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| Evo_1_8k_base on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: Evo_1_8k_baseTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.171 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Evo_1_8k_base), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| Evo_1_8k on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: Evo_1_8kTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.171 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Evo_1_8k), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| Evo2-7B-base on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: Evo2-7B-baseTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.126 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Evo2-7B-base), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| Evo2-7B on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: Evo2-7BTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.126 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(Evo2-7B), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| GENA-LM-large on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: GENA-LM-largeTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.113 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(GENA-LM-large), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| GENERator-3B on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: GENERator-3BTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.097 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(GENERator-3B), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| GenerRNA on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: GenerRNATask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.079 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(GenerRNA), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| GenSLM on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: GenSLMTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.082 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(GenSlm), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| HyenaDNA on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: HyenaDNATask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.094 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(HyenaDNA), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| LucaOne on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: LucaOneTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.090 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(LucaOne), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| LucaVirus on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: LucaVirusTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.093 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(LucaVirus), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| N.T.-v2-50m on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: N.T.-v2-50mTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.097 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(N.T.-v2-50m), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| RESM on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: RESMTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.172 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(RESM), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| RiNALMo_giga on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: RiNALMo_gigaTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.105 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(RiNALMo_giga), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| RNA-FM on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: RNA-FMTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.148 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(RNA-FM), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| RNAernie on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: RNAernieTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.078 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(RNAernie), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| SPACE on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: SPACETask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.087 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(SPACE), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
| structRFM on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ Configuration: structRFMTask: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρDataset subset: NABench deep mutational scanning assays (NABench split) Aggregated by the NABench authors across NABench deep mutational scanning assays. Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.130 spearman Unit: correlation · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedNABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Table 6, row(structRFM), column(Zero-shot Spearman ρ) Source checking is not independent reproduction. |
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
1 evidence row matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Relationship: part of discovery-benchmark-nabench Individual claims | NABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction Table 6, column(Zero-shot Spearman ρ) Version: Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | source checked automated source review · 2026-09-18 Audit detailsPrimary-source transcription with no human sign-off and no independent reproduction. Field: Claim: nabench-association-dms-zs-corr Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
Release 2026-09-17-134cd1815de8 · Record review: source checked
1 source records and release history
- NABench: Large-Scale Benchmarks of Nucleotide Foundation Models for Fitness Prediction · Original source · Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256
Technical metadata and extraction receipts
Stable ID: nabench-task-dms-zs-corr
- areas
- rna-transcriptomes
- tasks
- Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- metric
- Zero-shot Spearman ρ
- metric direction
- higher
- dataset
- NABench deep mutational scanning assays
- protocol
- Aggregated by the NABench authors across NABench deep mutational scanning assays.
- source locator
- Table 6, column(Zero-shot Spearman ρ)
- comparison panels
- id: nabench-panel-dms-zs-corr; title: NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ; protocol id: nabench-task-dms-zs-corr; dataset id: nabench-dataset-nabench-deep-mutational-scanning-assays; metric: spearman; unit: correlation; direction: higher; result ids: nabench-result-rna-fm-dms-zs-corr-spearman; nabench-result-rnaernie-dms-zs-corr-spearman; nabench-result-space-dms-zs-corr-spearman; nabench-result-aido-rna-dms-zs-corr-spearman; nabench-result-birna-bert-dms-zs-corr-spearman; nabench-result-crafts-dms-zs-corr-spearman; nabench-result-dnabert-dms-zs-corr-spearman; nabench-result-dnabert-6-dms-zs-corr-spearman; nabench-result-enformer-dms-zs-corr-spearman; nabench-result-evo2-7b-dms-zs-corr-spearman; nabench-result-evo2-7b-base-dms-zs-corr-spearman; nabench-result-evo-1-5-8k-base-dms-zs-corr-spearman; nabench-result-evo-1-8k-dms-zs-corr-spearman; nabench-result-evo-1-8k-base-dms-zs-corr-spearman; nabench-result-gena-lm-large-dms-zs-corr-spearman; nabench-result-generator-3b-dms-zs-corr-spearman; nabench-result-generrna-dms-zs-corr-spearman; nabench-result-genslm-dms-zs-corr-spearman; nabench-result-hyenadna-dms-zs-corr-spearman; nabench-result-lucaone-dms-zs-corr-spearman; nabench-result-lucavirus-dms-zs-corr-spearman; nabench-result-n-t-v2-50m-dms-zs-corr-spearman; nabench-result-resm-dms-zs-corr-spearman; nabench-result-rinalmo-giga-dms-zs-corr-spearman; nabench-result-structrfm-dms-zs-corr-spearman; source ids: evidence-expansion-nabench-fefd48d5; source locator: Table 6, column(Zero-shot Spearman ρ); context: Every method NABench reports on Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ, scored with Zero-shot Spearman ρ on NABench deep mutational scanning assays.; caveats: Author-reported numbers, source checked but not independently reproduced.; Zero-shot, few-shot and supervised cross validation figures come from different protocols and are not comparable to each other.; The per-nucleotide-type figures and the overall figures describe the same runs at different resolutions, so they must not be combined.; review: method: automated_source_review; date: 2026-09-18
Related records
- part of: NABench
- subject: NABench DMS-ZS-CORR: part of discovery-benchmark-nabench
- benchmark: AIDO.RNA on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: BiRNA-BERT on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: Crafts on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: Dnabert_6 on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: Dnabert on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: Enformer on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: Evo_1.5_8k_base on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: Evo_1_8k_base on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: Evo_1_8k on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: Evo2-7B-base on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: Evo2-7B on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: GENA-LM-large on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: GENERator-3B on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: GenerRNA on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: GenSLM on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: HyenaDNA on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: LucaOne on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: LucaVirus on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: N.T.-v2-50m on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: RESM on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: RiNALMo_giga on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: RNA-FM on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: RNAernie on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: SPACE on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ
- benchmark: structRFM on NABench DMS-ZS-CORR: Overall fitness prediction on NABench deep mutational scanning assays, Zero-shot Spearman ρ