rewire.it
Benchmark

RhoFold+ CASP15 natural RNA comparison

Complete Figure 2h source table: ten configurations, six natural CASP15 RNA targets, RMSD and cumulative GDT-TS/TM Z-score. Retrospective best-of-five comparison; eight unavailable entries retained in extraction receipts.

56 evaluations · 112 metric rows

Overview

Complete Figure 2h source table: ten configurations, six natural CASP15 RNA targets, RMSD and cumulative GDT-TS/TM Z-score. Retrospective best-of-five comparison; eight unavailable entries retained in extraction receipts.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Results

Each comparison retains its reviewed evaluation scope, dataset and metric. Results are shown without a pooled ranking.

RhoFold+ 2024 CASP15 natural RNA comparison R1107-rmsd: R1107: RMSD

rmsd (angstrom) · Lower values are better.

Every method RhoFold+ 2024 CASP15 natural RNA comparison reports on R1107: RMSD, scored with RMSD on CASP15 natural RNA target R1107.

RhoFold+ 2024 CASP15 natural RNA comparison R1107-rmsd: R1107: RMSD · CASP15 natural RNA target R1107 (RhoFold+ 2024 CASP15 natural RNA comparison split)

Evidence origin: Result quoted from another source, Independent external evaluation, Author-reported evaluation. Numerical source review does not establish independent reproduction.

RhoFold+ Nature Methods 2024: Source Data Figure 2h · Source Data Fig. 2, fig2hi!A1:M11, target R1107, RMSD; Figure 2h caption; primary XML Par13–15 and Par51

Comparator configurations mix CASP15 expert/server submissions and retrospectively run published methods. These are not a controlled identical-compute benchmark.

All comparison limitations (10)
  • Comparator configurations mix CASP15 expert/server submissions and retrospectively run published methods. These are not a controlled identical-compute benchmark.
  • Best-of-five performance is not default single-prediction accuracy. Metric-specific candidate identity is not given in this sheet.
  • N/A is missing official data, never zero.
  • Do not pool target scores or infer an aggregate ranking from these extractions.
  • Numeric OOXML tokens can expose binary floating-point serialization; preserve raw tokens separately from numeric values and do not infer extra experimental precision.
  • Yang-best remains the workbook label; no inferred alias to a named model family.
  • The six natural targets are a bounded retrospective subset of CASP15, not the complete competition or a blind RhoFold+ submission.
  • All ten source rows and both metric blocks are retained. Eight N/A cells are preserved in source-cells.json and omitted from numerical result records.
  • Only source row RhoFold+ links to catalog-model-rhofold. Alchemy_RNA (RhoFold) and Alchemy_RNA2 are separate configurations.
  • CASP15 group scores are quoted prior submissions, not independent new experiments; AlphaFold3 is a third-party server evaluation reported by the RhoFold+ authors.

Automated source review: 2026-09-23.

No unavailable values; missing scores remain labelled and are never plotted as zero.

Showing 8 of 8 matching rows.

Tested configuration
3.717.5111.315.118.9
Reported score
  1. rDP (DRfold)18.1 Å
  2. Yang-best17.8 Å
  3. Chen6.48 Å
  4. UltraFold6.43 Å
  5. AlphaFold36.03 Å
  6. Alchemy_RNA (RhoFold)5.92 Å
  7. RhoFold+5.01 Å
  8. Alchemy_RNA24.52 Å

Dots show point estimates. Whiskers show only explicitly defined uncertainty (standard deviation, standard error or a labelled interval); their definitions remain in Table. Unresolved uncertainty is not plotted. Differences do not establish statistical significance.

Methods and evaluation design

Procedure, tasks and evaluated configurations

Evaluation design

Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.

Protocols

These source-backed links do not make different protocols or scores interchangeable.

Baseline coverage

Reference methods help show what a model adds beyond simple controls. We track a null control and a conventional method for each protocol.

0 of 24 active baseline roles have published Rewire measurements in this release. Measurements on a selected protocol do not establish coverage of an entire suite.

Baseline status by linked protocol

Protocol coverage CSV · Model evaluation matrix · Source table · Release and checksums

Coverage is derived from release 2026-09-23-2b89723c6dd9. Source citations describe the original records; they do not validate an unreviewed baseline proposal. No results have been generated by this audit.

Run this benchmark

Choose a concrete protocol before running an evaluation. Its inputs, split and scoring rules determine which results can be compared.

Run instructions

No runnable recipe has been reviewed for this benchmark. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

Strengths, limitations and unresolved questions

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-09-23-2b89723c6dd9
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

All evidence (CSV)All evidence (JSONL)How to read the evidence

Sources and history

View linked audit checks and correction history

Release 2026-09-23-2b89723c6dd9 · Record review: source checked

2 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: model-coverage-rhofold-casp15-natural

areas
rna-transcriptomics
entity level
suite
source locator
Source Data Fig. 2, fig2hi!A1:M11; Fig. 2h caption; XML Par13–15 and Par51
missing metadata
runner: unavailable; checkpoint revisions: unreported
Related records

Suggest a correction