evaluation · reproduced

SpliceAI 1.3.1 on MFASS v2

Evaluation procedure

Unchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset.

Metadata review: reproduced. Unreported conditions prevent automatic comparisons.

Release 2026-09-16-d74d282221a9 · 1 evaluation · 3 metric rows. Different protocols are not a single leaderboard.

Evaluated configurationMetricEvidence origin

Results grouped by the exact reported evaluation
Metric and finding	Coverage and uncertainty	Evidence
SpliceAI 1.3.1 on MFASS v2 Model: SpliceAI 1.3.1 · Benchmark: MFASS v2 · Dataset: MFASS v2 eligible assay cohort Unchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset. Rewire evaluation · Evaluation metadata: reproduced
0.8055241740253153 auroc Unit: fraction · Direction: higher	Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8194/8324	reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: auroc Source checking is not independent reproduction.
0.2986855472760137 average_precision Unit: fraction · Direction: higher	Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8194/8324	reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: average_precision Source checking is not independent reproduction.
0.64 precision_at_100 Unit: fraction · Direction: higher	Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8194/8324	reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: precision_at_100 Source checking is not independent reproduction.

Release 2026-09-16-d74d282221a9 · Record review: reproduced

MFASS v2 pinned rewire artifacts · Original source · bee9133b83f3aedaf2bbb9013f1875515845607e

Technical metadata and extraction receipts

Stable ID: rewire-evaluation-spliceai-1-3-1

areas: dna-genomes
origin: rewire_run
protocol: Unchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset.
version: bee9133b83f3aedaf2bbb9013f1875515845607e
run url: /benchmarks/runs/mfass-v2/
comparison: protocol id: mfass-v2; dataset version: bee9133b83f3aedaf2bbb9013f1875515845607e; split: split-v2.tsv; population: 8194/8324; inputs: Not reported; adaptation: Not reported; metric implementation: Not reported; aggregation: Not reported; budget: Not reported
coverage: 8194/8324
missing metadata: paired comparison: Refer to paired bootstrap artifacts; marginal scores are not paired comparisons.

Related records