UltraFold on RhoFold+ 2024 CASP15 natural RNA comparison R1108-sum_z_gdt_ts_tm_score: R1108: Sum of Z-scores for GDT-TS and TM-score
RhoFold+ 2024 CASP15 natural RNA comparison evaluation of UltraFold on R1108: Sum of Z-scores for GDT-TS and TM-score, scored with Sum of Z-scores for GDT-TS and TM-score.
Evaluation results
1 evaluation · 1 metric rows. Different protocols are not a single leaderboard.
Filter evaluations
Applied filters: All linked evaluations
| Tested configuration | Protocol and dataset | Finding | Evidence and details |
|---|---|---|---|
| Configuration: UltraFold | Protocol: RhoFold+ 2024 CASP15 natural RNA comparison R1108-sum_z_gdt_ts_tm_score: R1108: Sum of Z-scores for GDT-TS and TM-score Dataset subset: CASP15 natural RNA target R1108 (RhoFold+ 2024 CASP15 natural RNA comparison split) | 2.16 sum_z_gdt_ts_tm_score dimensionless · higher Uncertainty: Not reported Coverage: unit: CASP15 natural RNA target; scored: 1; eligible: 1; note: Per-cell target count; source retains up to five candidate structures, not five independent evaluation targets. | Result quoted from another source · source checkedMethods, coverage and sourceRetrospective evaluation of six CASP15 natural single-chain RNA targets; each task retains one named target. Artificially designed targets and RNA-protein complexes excluded. RNA sequence inputs without ions or other molecules. Paper Par13 selects the highest-performing of five candidates; Par51 describes five sampled-MSA runs for RhoFold+, one AlphaFold3 server run yielding five models, and five CASP15 models for the other methods. Figure 2h reports RMSD and sum of Z-scores for GDT-TS and TM-score. Metric-specific winning candidate identity, exact scoring-tool revision and RMSD atom selection remain unextracted. No target pooling or score recomputation. Aggregation: Source-reported selected candidate for one target; no cross-target aggregation. RhoFold+ Nature Methods 2024: Source Data Figure 2h · fig2hi!I6; method fig2hi!A6; target fig2hi!I1; Fig. 2h caption; XML Par13–15 and Par51 |
Source checking is not independent reproduction. Release 2026-09-23-2b89723c6dd9.
Evaluation procedure
Retrospective evaluation of six CASP15 natural single-chain RNA targets; each task retains one named target. Artificially designed targets and RNA-protein complexes excluded. RNA sequence inputs without ions or other molecules. Paper Par13 selects the highest-performing of five candidates; Par51 describes five sampled-MSA runs for RhoFold+, one AlphaFold3 server run yielding five models, and five CASP15 models for the other methods. Figure 2h reports RMSD and sum of Z-scores for GDT-TS and TM-score. Metric-specific winning candidate identity, exact scoring-tool revision and RMSD atom selection remain unextracted. No target pooling or score recomputation.
- Configuration
- UltraFold
- Protocol
- RhoFold+ 2024 CASP15 natural RNA comparison R1108-sum_z_gdt_ts_tm_score: R1108: Sum of Z-scores for GDT-TS and TM-score
- Dataset subset
- CASP15 natural RNA target R1108 (RhoFold+ 2024 CASP15 natural RNA comparison split)
- origin
- Result quoted from another source
- configuration
- Not reported
- protocol id
- rhofold-2024-casp15-natural-task-r1108-sum-z-gdt-ts-tm-score
- metric implementation
- Sum of Z-scores for GDT-TS and TM-score
Metadata review: source checked. Unreported conditions prevent automatic comparisons.
Reproduction
- Split
- Not reported
- Adaptation
- Not reported
- Scoring implementation
- Sum of Z-scores for GDT-TS and TM-score
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
20 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.adaptation Source-labelled five-candidate CASP15 configuration; fine-tuning and exact checkpoints not established. No additional adaptation inferred. Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!I6; method fig2hi!A6; target fig2hi!I1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.candidate_budget 5 Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!I6; method fig2hi!A6; target fig2hi!I1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.candidate_selection Highest-performing candidate as described in Par13; metric-specific candidate identity unreported. Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!I6; method fig2hi!A6; target fig2hi!I1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.comparison.metric_implementation Sum of Z-scores for GDT-TS and TM-score Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!I6; method fig2hi!A6; target fig2hi!I1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.comparison.protocol_id rhofold-2024-casp15-natural-task-r1108-sum-z-gdt-ts-tm-score Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!I6; method fig2hi!A6; target fig2hi!I1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.count_unit RNA target Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!I6; method fig2hi!A6; target fig2hi!I1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.evaluation_group_id rhofold-2024-casp15-natural-method-ultrafold-rhofold-2024-casp15-natural-dataset-casp15-natural-rna-target-r1108-evaluation-setup Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!I6; method fig2hi!A6; target fig2hi!I1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.evidence_overlap Twelve per-target/metric observations per complete method belong to one six-target comparison setup. RMSD and cumulative Z-score reuse candidate predictions; CASP15 submissions quoted here are not new independent evidence. Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!I6; method fig2hi!A6; target fig2hi!I1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.origin paper_compilation Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!I6; method fig2hi!A6; target fig2hi!I1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| attributes.protocol Retrospective evaluation of six CASP15 natural single-chain RNA targets; each task retains one named target. Artificially designed targets and RNA-protein complexes excluded. RNA sequence inputs without ions or other molecules. Paper Par13 selects the highest-performing of five candidates; Par51 describes five sampled-MSA runs for RhoFold+, one AlphaFold3 server run yielding five models, and five CASP15 models for the other methods. Figure 2h reports RMSD and sum of Z-scores for GDT-TS and TM-score. Metric-specific winning candidate identity, exact scoring-tool revision and RMSD atom selection remain unextracted. No target pooling or score recomputation. Context-only references | RhoFold+ Nature Methods 2024: Source Data Figure 2h fig2hi!I6; method fig2hi!A6; target fig2hi!I1; Fig. 2h caption; XML Par13–15 and Par51 Version: Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23 | not individually reviewed No individual claim review recorded paper compilation Audit detailsField: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Sources and history
View linked audit checks and correction history
Release 2026-09-23-2b89723c6dd9 · Record review: source checked
1 source records and release history
- RhoFold+ Nature Methods 2024: Source Data Figure 2h · Original source · Publisher Source Data Fig. 2, DOI 10.1038/s41592-024-02487-0; retrieved 2026-09-23
Technical metadata and extraction receipts
Stable ID: rhofold-2024-casp15-natural-evaluation-ultrafold-r1108-sum-z-gdt-ts-tm-score
- areas
- rna-transcriptomics
- tasks
- R1108: Sum of Z-scores for GDT-TS and TM-score
- origin
- paper_compilation
- protocol
- Retrospective evaluation of six CASP15 natural single-chain RNA targets; each task retains one named target. Artificially designed targets and RNA-protein complexes excluded. RNA sequence inputs without ions or other molecules. Paper Par13 selects the highest-performing of five candidates; Par51 describes five sampled-MSA runs for RhoFold+, one AlphaFold3 server run yielding five models, and five CASP15 models for the other methods. Figure 2h reports RMSD and sum of Z-scores for GDT-TS and TM-score. Metric-specific winning candidate identity, exact scoring-tool revision and RMSD atom selection remain unextracted. No target pooling or score recomputation.
- comparison
- protocol id: rhofold-2024-casp15-natural-task-r1108-sum-z-gdt-ts-tm-score; metric implementation: Sum of Z-scores for GDT-TS and TM-score
- missing metadata
- checkpoint revision: unreported; seeds: unreported; scoring tool revision: unextracted; rmsd atom selection: unextracted; candidate identity by metric: unreported
- source locator
- fig2hi!I6; method fig2hi!A6; target fig2hi!I1; Fig. 2h caption; XML Par13–15 and Par51
- candidate budget
- 5
- candidate selection
- Highest-performing candidate as described in Par13; metric-specific candidate identity unreported.
- retrospective
- true
- count unit
- RNA target
- scored count
- 1
- adaptation
- Source-labelled five-candidate CASP15 configuration; fine-tuning and exact checkpoints not established. No additional adaptation inferred.
- evidence overlap
- Twelve per-target/metric observations per complete method belong to one six-target comparison setup. RMSD and cumulative Z-score reuse candidate predictions; CASP15 submissions quoted here are not new independent evidence.
- published score reproduction
- false
- suite complete
- false
- evaluation group id
- rhofold-2024-casp15-natural-method-ultrafold-rhofold-2024-casp15-natural-dataset-casp15-natural-rna-target-r1108-evaluation-setup
Related records
- benchmark: RhoFold+ 2024 CASP15 natural RNA comparison R1108-sum_z_gdt_ts_tm_score: R1108: Sum of Z-scores for GDT-TS and TM-score
- model: UltraFold
- dataset: CASP15 natural RNA target R1108 (RhoFold+ 2024 CASP15 natural RNA comparison split)
- evaluation: UltraFold · RhoFold+ 2024 CASP15 natural RNA comparison R1108-sum_z_gdt_ts_tm_score · Sum of Z-scores for GDT-TS and TM-score