Result

0.815 AUROC

SpliceAI 1.3.1 · mask 1 (S1): AUROC

Tested configuration: SpliceAI 1.3.1 · mask 1 (S1)
Protocol: MFASS: matched GENCODE 44 canonical annotation
Dataset subset: MFASS v2 test: matched canonical annotation coverage
Related family profiles: SpliceAI
Procedure: MFASS matched GENCODE 44 canonical annotation
Evaluation: SpliceAI 1.3.1 · mask 1 (S1) on MFASS matched annotation
Coverage: 8297/8324
Uncertainty: Not reported
Evidence: Rewire evaluation · source checkedMFASS matched canonical annotation v1: report.json; MFASS matched canonical annotation v1: manifest-v1.json; MFASS matched canonical annotation v1: verification.json; MFASS matched canonical annotation v1: provenance.json; MFASS matched canonical annotation v1: exclusion-verification.json · report.json: conditions.S1.metrics.auroc

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.

Reproduction

Split: split-v2 test
Adaptation: zero-shot pretrained specialists
Scoring implementation: 4030374ed11d38e523fc9991ddd792f8800e7739ac71588085bfff91f912d7f7

No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.

Access requirements and official instructions: MFASS: matched GENCODE 44 canonical annotation

Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.

Evidence

Source checking verifies the cited claim or transcription. It does not establish independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

5 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-09-25-d40cee0abe73
Property and statement	Original source and location	Review and provenance
Reported result 0.8148394159244446 Individual claims	MFASS matched canonical annotation v1: exclusion-verification.json Original source ↗ report.json: conditions.S1.metrics.auroc Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 4be7a98e2553fa2378c29625b13eb3e8ac2e58fb Retrieved: 2026-09-25T11:24:56Z	source checked automated execution evidence review · 2026-09-25T11:24:56Z rewire run Audit details Computational source, coverage and metric checks only; not independent human review or published-score reproduction. Field: `attributes.printed_value` Source artifact SHA-256: `5d2099db4cf6f01432fd88c7db949da89ab9917940705fd0eaa1fb7c9354d46a` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Reported result 0.8148394159244446 Individual claims	MFASS matched canonical annotation v1: manifest-v1.json Original source ↗ report.json: conditions.S1.metrics.auroc Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2 Retrieved: 2026-09-25T11:24:56Z	source checked automated execution evidence review · 2026-09-25T11:24:56Z rewire run Audit details Computational source, coverage and metric checks only; not independent human review or published-score reproduction. Field: `attributes.printed_value` Source artifact SHA-256: `3fce70dd0bd96cb92d9d0e41287f31e62ddc4ecb8d188615093a873e952433e8` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Reported result 0.8148394159244446 Individual claims	MFASS matched canonical annotation v1: provenance.json Original source ↗ report.json: conditions.S1.metrics.auroc Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2 Retrieved: 2026-09-25T11:24:56Z	source checked automated execution evidence review · 2026-09-25T11:24:56Z rewire run Audit details Computational source, coverage and metric checks only; not independent human review or published-score reproduction. Field: `attributes.printed_value` Source artifact SHA-256: `6304e9625e793f24cccdc2669d092e6cdcc7a508a7f789967e726816fffde062` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Reported result 0.8148394159244446 Individual claims	MFASS matched canonical annotation v1: report.json Original source ↗ report.json: conditions.S1.metrics.auroc Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2 Retrieved: 2026-09-25T11:24:56Z	source checked automated execution evidence review · 2026-09-25T11:24:56Z rewire run Audit details Computational source, coverage and metric checks only; not independent human review or published-score reproduction. Field: `attributes.printed_value` Source artifact SHA-256: `259eb542313914b9114c21b62891f022c0ec0d9e3337196b8d7b2c6d5ae54ef3` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact
Reported result 0.8148394159244446 Individual claims	MFASS matched canonical annotation v1: verification.json Original source ↗ report.json: conditions.S1.metrics.auroc Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: 093fd1ae198c80ce34408d84d6543bca4fc538f2 Retrieved: 2026-09-25T11:24:56Z	source checked automated execution evidence review · 2026-09-25T11:24:56Z rewire run Audit details Computational source, coverage and metric checks only; not independent human review or published-score reproduction. Field: `attributes.printed_value` Source artifact SHA-256: `13356c3f1bd7055b11cc0ab1b2b86a7ee586c51d0c984fad6e39ce8948d662fa` Hash scope: Hash scope not separately documented; inspect source record Inspected artifact

All evidence (CSV)All evidence (JSONL)How to read the evidence

Sources and history

View linked audit checks and correction history

Release 2026-09-25-d40cee0abe73 · Record review: source checked

5 source records and release history

MFASS matched canonical annotation v1: report.json · Original source · 093fd1ae198c80ce34408d84d6543bca4fc538f2
MFASS matched canonical annotation v1: manifest-v1.json · Original source · 093fd1ae198c80ce34408d84d6543bca4fc538f2
MFASS matched canonical annotation v1: verification.json · Original source · 093fd1ae198c80ce34408d84d6543bca4fc538f2
MFASS matched canonical annotation v1: provenance.json · Original source · 093fd1ae198c80ce34408d84d6543bca4fc538f2
MFASS matched canonical annotation v1: exclusion-verification.json · Original source · 4be7a98e2553fa2378c29625b13eb3e8ac2e58fb

Download this release

Technical metadata and extraction receipts

Stable ID: rewire-mfass-matched-v1-result-s1-auroc

areas: dna-genomes
metric: AUROC
metric key: auroc
metric direction: higher
unit: dimensionless
numeric value: 0.8148394159244446
printed value: 0.8148394159244446
eligible count: 8324
scored count: 8297
missing count: 27
coverage: 8297/8324
uncertainty: Not reported
source locator: report.json: conditions.S1.metrics.auroc
review: method: automated_execution_evidence_review; reviewed at: 2026-09-25T11:24:56Z; notes: Computational source, coverage and metric checks only; not independent human review or published-score reproduction.
missing metadata: uncertainty: Point estimate; paired contrast intervals are reported separately in the source and must not be used as intervals for this individual condition.

Related records

evaluation: SpliceAI 1.3.1 · mask 1 (S1) on MFASS matched annotation

Suggest a correction