rewire.it
Protocol

BEELINE 2020 Figure 4 · GSD · {}

Source-specific evaluation. Input conditions: {}. No equivalence to other releases, protocols or model families is inferred.

12 evaluations · 48 metric rows

Published comparisons

Each figure keeps its source, protocol, dataset and metric together. Results from different protocols are shown separately, without a pooled ranking.

BEELINE 2020 Figure 4 · GSD · {}: AUPRC Ratio

AUPRC Ratio (ratio) · Higher values are better for this metric.

Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.

Evaluation protocol · GSD

  1. PIDC · Configuration · Author-reported evaluation1.320264312
  2. GENIE3 · Configuration · Author-reported evaluation1.252627651
  3. GRNBOOST2 · Configuration · Author-reported evaluation1.258403675
  4. PPCOR · Configuration · Author-reported evaluation1.374030802
  5. SCODE · Configuration · Author-reported evaluation1.30613851
  6. GRISLI · Configuration · Author-reported evaluation1.367750246
  7. SINGE · Configuration · Author-reported evaluation1.214742181
  8. SCNS · Configuration · Author-reported evaluation0.90036574
  9. LEAP · Configuration · Author-reported evaluation1.162201873
  10. SINCERITIES · Configuration · Author-reported evaluation1.128392301
  11. GRNVBEM · Configuration · Author-reported evaluation1.28426324
  12. SCRIBE · Configuration · Author-reported evaluation1.388307534

Source order is preserved. Plotted marks show point estimates; uncertainty, where reported, is retained in the printed values and table. Differences do not establish statistical significance.

BEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 3, column 5 through Figure 4 source CSV row 14, column 5
Values, uncertainty and evidence
AUPRC Ratio: original source values
Tested entityPrinted valueUncertaintyEvidence
PIDC · Configuration1.320264312 ratiostatus: unreportedAuthor-reported evaluation · source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 3, column 5
GENIE3 · Configuration1.252627651 ratiostatus: unreportedAuthor-reported evaluation · source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 4, column 5
GRNBOOST2 · Configuration1.258403675 ratiostatus: unreportedAuthor-reported evaluation · source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 5, column 5
PPCOR · Configuration1.374030802 ratiostatus: unreportedAuthor-reported evaluation · source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 6, column 5
SCODE · Configuration1.30613851 ratiostatus: unreportedAuthor-reported evaluation · source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 7, column 5
GRISLI · Configuration1.367750246 ratiostatus: unreportedAuthor-reported evaluation · source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 8, column 5
SINGE · Configuration1.214742181 ratiostatus: unreportedAuthor-reported evaluation · source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 9, column 5
SCNS · Configuration0.90036574 ratiostatus: unreportedAuthor-reported evaluation · source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 10, column 5
LEAP · Configuration1.162201873 ratiostatus: unreportedAuthor-reported evaluation · source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 11, column 5
SINCERITIES · Configuration1.128392301 ratiostatus: unreportedAuthor-reported evaluation · source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 12, column 5
GRNVBEM · Configuration1.28426324 ratiostatus: unreportedAuthor-reported evaluation · source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 13, column 5
SCRIBE · Configuration1.388307534 ratiostatus: unreportedAuthor-reported evaluation · source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 14, column 5
Scope and limitations
  • Source-specific evaluation. Input conditions: {}. No equivalence to other releases, protocols or model families is inferred.
  • Across-dataset stability is median pairwise top-k edge-set Jaccard index (paper Online Methods), not Spearman correlation. Not an independent experimental run.
  • Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.

Source transcription and grouping reviewed by automated source review on 2026-09-19. These experiments were not independently reproduced by rewire.

Tested entities and results

Release 2026-09-19-eb6149e5d766 · 12 evaluations · 48 metric rows. Different protocols are not a single leaderboard. Charts retain each source table’s protocol and dataset.

Results grouped by the exact reported evaluation
Metric and findingCoverage and uncertaintyEvidence
PPCOR · BEELINE 2020 Figure 4 · GSD

BEELINE 2020 Figure 4

Author-reported evaluation · Evaluation metadata: discovered

0.200960219 EPR Inhibition

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 6, column 17

Source checking is not independent reproduction.

1.374030802 AUPRC Ratio

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 6, column 5

Source checking is not independent reproduction.

SCRIBE · BEELINE 2020 Figure 4 · GSD

BEELINE 2020 Figure 4

Author-reported evaluation · Evaluation metadata: discovered

1.388307534 AUPRC Ratio

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 14, column 5

Source checking is not independent reproduction.

1.421052632 Early Precision Ratio

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 14, column 9

Source checking is not independent reproduction.

1.205761317 EPR Inhibition

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 14, column 17

Source checking is not independent reproduction.

SINGE · BEELINE 2020 Figure 4 · GSD

BEELINE 2020 Figure 4

Author-reported evaluation · Evaluation metadata: discovered

1.205761317 EPR Inhibition

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 9, column 17

Source checking is not independent reproduction.

1.214742181 AUPRC Ratio

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 9, column 5

Source checking is not independent reproduction.

GENIE3 · BEELINE 2020 Figure 4 · GSD

BEELINE 2020 Figure 4

Author-reported evaluation · Evaluation metadata: discovered

0.401920439 EPR Inhibition

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 4, column 17

Source checking is not independent reproduction.

2.099125364 EPR Activation

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 4, column 13

Source checking is not independent reproduction.

PIDC · BEELINE 2020 Figure 4 · GSD

BEELINE 2020 Figure 4

Author-reported evaluation · Evaluation metadata: discovered

0 EPR Inhibition

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 3, column 17

Source checking is not independent reproduction.

GRISLI · BEELINE 2020 Figure 4 · GSD

BEELINE 2020 Figure 4

Author-reported evaluation · Evaluation metadata: discovered

1.443148688 EPR Activation

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 8, column 13

Source checking is not independent reproduction.

1.367750246 AUPRC Ratio

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 8, column 5

Source checking is not independent reproduction.

1.264952153 Early Precision Ratio

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 8, column 9

Source checking is not independent reproduction.

SCODE · BEELINE 2020 Figure 4 · GSD

BEELINE 2020 Figure 4

Author-reported evaluation · Evaluation metadata: discovered

1.443148688 EPR Activation

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 7, column 13

Source checking is not independent reproduction.

1.509868421 Early Precision Ratio

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 7, column 9

Source checking is not independent reproduction.

GRNVBEM · BEELINE 2020 Figure 4 · GSD

BEELINE 2020 Figure 4

Author-reported evaluation · Evaluation metadata: discovered

1.28426324 AUPRC Ratio

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 13, column 5

Source checking is not independent reproduction.

1.771137026 EPR Activation

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 13, column 13

Source checking is not independent reproduction.

1.391447368 Early Precision Ratio

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 13, column 9

Source checking is not independent reproduction.

0.735930183 EPR Inhibition

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 13, column 17

Source checking is not independent reproduction.

SINCERITIES · BEELINE 2020 Figure 4 · GSD

BEELINE 2020 Figure 4

Author-reported evaluation · Evaluation metadata: discovered

0.918367347 EPR Activation

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 12, column 13

Source checking is not independent reproduction.

1.128392301 AUPRC Ratio

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 12, column 5

Source checking is not independent reproduction.

1.125 Early Precision Ratio

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 12, column 9

Source checking is not independent reproduction.

SCNS · BEELINE 2020 Figure 4 · GSD

BEELINE 2020 Figure 4

Author-reported evaluation · Evaluation metadata: discovered

0.90036574 AUPRC Ratio

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 10, column 5

Source checking is not independent reproduction.

0.520745488 EPR Activation

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 10, column 13

Source checking is not independent reproduction.

GRNBOOST2 · BEELINE 2020 Figure 4 · GSD

BEELINE 2020 Figure 4

Author-reported evaluation · Evaluation metadata: discovered

1.258403675 AUPRC Ratio

Unit: ratio · Direction: higher

Aggregation: Median across source-described simulation datasets

Uncertainty: status: unreported

Scored: Not reported · Eligible: Not reported

source checkedBEELINE: 10.1038/s41592-019-0690-6 source data published 2020 · Figure 4 source CSV row 5, column 5

Source checking is not independent reproduction.

Overview

Source-specific evaluation. Input conditions: {}. No equivalence to other releases, protocols or model families is inferred.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluation design

Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.

Benchmarks

These source-backed links do not make different protocols or scores interchangeable.

Recorded evaluations

Each evaluation records what was tested and under which conditions.

Run instructions

No runnable recipe has been reviewed for this protocol. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

1 evidence row matching the loaded filters

Claims, original sources and review scope · Release 2026-09-19-eb6149e5d766
Property and statementOriginal source and locationReview and provenance
Relationship: part of

discovery-benchmark-beeline

Individual claims
BEELINE: 10.1038/s41592-019-0690-6 source data published 2020

Original source ↗

Figure 4 source CSV row 3, column 5

Version: 10.1038/s41592-019-0690-6 source data published 2020
Retrieved: 2026-09-19

source checked

ai assisted source review · 2026-09-19

Audit details

Field: links:part_of:discovery-benchmark-beeline

Claim: acquired-membership-51460543bd24abdedce0

Source artifact SHA-256: 3582523c27176f7573e62fc3fa11843076568b9ce522e556cd2a6973029c90cb

Hash scope: Exact downloaded bytes, before optional gzip storage

Inspected artifact

Sources and history

View linked audit checks and correction history

Release 2026-09-19-eb6149e5d766 · Record review: discovered

1 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: acquired-protocol-25210daa0dccd840d2fb

source locator
Figure 4 source CSV row 3, column 5
procedure
BEELINE 2020 Figure 4
comparison panels
id: acquired-figure-30562c155236e9bcc04f; title: BEELINE 2020 Figure 4 · GSD · {}: AUPRC Ratio; protocol id: acquired-protocol-25210daa0dccd840d2fb; dataset id: acquired-dataset-8f5136850c1e5540ec38; metric: AUPRC Ratio; unit: ratio; direction: higher; result ids: acquired-result-aba856d741c06f2a9f73; acquired-result-a90b726657b571e284a3; acquired-result-5eb2a91c76e29cbbe8b2; acquired-result-6edf31ec515f1175c77b; acquired-result-c84e63f74b6caa0da89c; acquired-result-24f635dab96dc43b5f9b; acquired-result-0ade8b09dac4f3ee436c; acquired-result-48406e0b30e75de2b349; acquired-result-8a8e01713233baa3b0c6; acquired-result-56388f2bc388d1293f6c; acquired-result-38dbc2ae31a2d8b886db; acquired-result-028051e64e3f2814c401; source ids: acquired-source-3156602fda847ae943b4; source locator: Figure 4 source CSV row 3, column 5 through Figure 4 source CSV row 14, column 5; context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. Input conditions: {}. No equivalence to other releases, protocols or model families is inferred.; Across-dataset stability is median pairwise top-k edge-set Jaccard index (paper Online Methods), not Spearman correlation. Not an independent experimental run.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-f38684a03de525bc97ed; title: BEELINE 2020 Figure 4 · GSD · {}: Early Precision Ratio; protocol id: acquired-protocol-25210daa0dccd840d2fb; dataset id: acquired-dataset-8f5136850c1e5540ec38; metric: Early Precision Ratio; unit: ratio; direction: higher; result ids: acquired-result-db7ca87ca990a2603cab; acquired-result-da38c1093ccfd3849cae; acquired-result-80782252e5e6977f3440; acquired-result-75abc530c0fca6119850; acquired-result-3d87645c682a947e3619; acquired-result-317b50b35533af4fa204; acquired-result-8f1d46b75525f9986f72; acquired-result-fd6ce888f8952e0c4317; acquired-result-ce73defcddba7fb1f476; acquired-result-5d83ec55ce8e076b22db; acquired-result-580cfe185969739da5de; acquired-result-264fd1faede7f1261624; source ids: acquired-source-3156602fda847ae943b4; source locator: Figure 4 source CSV row 3, column 9 through Figure 4 source CSV row 14, column 9; context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. Input conditions: {}. No equivalence to other releases, protocols or model families is inferred.; Across-dataset stability is median pairwise top-k edge-set Jaccard index (paper Online Methods), not Spearman correlation. Not an independent experimental run.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-f1d028844fcd21374625; title: BEELINE 2020 Figure 4 · GSD · {}: EPR Activation; protocol id: acquired-protocol-25210daa0dccd840d2fb; dataset id: acquired-dataset-8f5136850c1e5540ec38; metric: EPR Activation; unit: ratio; direction: higher; result ids: acquired-result-ae2e551727c5208911fe; acquired-result-257429a05ed69b50aa4c; acquired-result-7b3fdb1ef5e92ac633d5; acquired-result-e18aab95c6fa84e63e07; acquired-result-2b875e112da56bd2eae6; acquired-result-19b369c636cb0f691d35; acquired-result-9af022fce50ffdcbd6a8; acquired-result-58f21db30f09edfabe09; acquired-result-9376077e01a93aa4988d; acquired-result-3a94b4cb333f9bd2c9d8; acquired-result-45151619a8d9d26babf7; acquired-result-de2dd74f0cebc8628555; source ids: acquired-source-3156602fda847ae943b4; source locator: Figure 4 source CSV row 3, column 13 through Figure 4 source CSV row 14, column 13; context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. Input conditions: {}. No equivalence to other releases, protocols or model families is inferred.; Across-dataset stability is median pairwise top-k edge-set Jaccard index (paper Online Methods), not Spearman correlation. Not an independent experimental run.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-1d72c33eb86b632170f1; title: BEELINE 2020 Figure 4 · GSD · {}: EPR Inhibition; protocol id: acquired-protocol-25210daa0dccd840d2fb; dataset id: acquired-dataset-8f5136850c1e5540ec38; metric: EPR Inhibition; unit: ratio; direction: higher; result ids: acquired-result-165b47919bad54511388; acquired-result-14edbe2f9b840af3f6c4; acquired-result-e3d6fc5c828a895c4c17; acquired-result-026f1fa2f8de0e037e77; acquired-result-eaa5c3d149aec7abc325; acquired-result-a9704bec05883b9715eb; acquired-result-04e30b70811bb5b75510; acquired-result-f538c28d2211eb9633a0; acquired-result-c5c042a667ffd3a82d47; acquired-result-e2f15d9df92b9c8ae121; acquired-result-6753ebe259ab53cc8a82; acquired-result-68dc4e71fb051e97fd2b; source ids: acquired-source-3156602fda847ae943b4; source locator: Figure 4 source CSV row 3, column 17 through Figure 4 source CSV row 14, column 17; context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. Input conditions: {}. No equivalence to other releases, protocols or model families is inferred.; Across-dataset stability is median pairwise top-k edge-set Jaccard index (paper Online Methods), not Spearman correlation. Not an independent experimental run.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19
scope limitations
Across-dataset stability is median pairwise top-k edge-set Jaccard index (paper Online Methods), not Spearman correlation. Not an independent experimental run.
Related records

Suggest a correction