This MFASS evaluation uses the official SpliceAI 1.3.1 five-model ensemble in genomic context.
Explanatory profile: source reviewed · Automated source review, 2026-09-16. This does not change the review status of its results.
| Property | Description and evidence |
|---|---|
| Version | SpliceAI 1.3.1, bundled five-model ensembleMFASS v2 pinned rewire artifacts · benchmarks/mfass/README.md, MFASS-v2 results; results/spliceai-1.3.1.json, description, config and notes at bee9133b83f3aedaf2bbb9013f1875515845607e |
| Score | Maximum of DS_AG, DS_AL, DS_DG and DS_DLMFASS v2 pinned rewire artifacts · benchmarks/mfass/README.md, MFASS-v2 results; results/spliceai-1.3.1.json, description, config and notes at bee9133b83f3aedaf2bbb9013f1875515845607e |
| Mask | M=0MFASS v2 pinned rewire artifacts · benchmarks/mfass/README.md, MFASS-v2 results; results/spliceai-1.3.1.json, description, config and notes at bee9133b83f3aedaf2bbb9013f1875515845607e |
| Model type | Not extracted or verified for this record. |
| Training data | Not extracted or verified for this record. |
| Context limits | Not extracted or verified for this record. |
| Access | Not extracted or verified for this record. |
| Code licence | Not extracted or verified for this record. |
| Weights licence | Not extracted or verified for this record. |
Schematic of the pinned MFASS configuration; this does not generalise to every member of the model family.
The runner scores variants against GRCh38 with bundled annotations and unmasked outputs. It ranks variants by the largest acceptor/donor gain or loss delta score. Its specialist predictions were retained unchanged for the corrected v2 comparison.
MFASS v2 pinned rewire artifacts · benchmarks/mfass/README.md, MFASS-v2 results; results/spliceai-1.3.1.json, description, config and notes at bee9133b83f3aedaf2bbb9013f1875515845607eRelease 2026-09-16-d74d282221a9 · 1 evaluation · 3 metric rows. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| SpliceAI 1.3.1 on MFASS v2 Unchanged specialist run in genomic context with bundled annotation; zero-shot on MFASS assay labels. Point metrics use the scored subset. Rewire evaluation · Evaluation metadata: reproduced | ||
| 0.8055241740253153 auroc Unit: fraction · Direction: higher | Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8194/8324 | reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: auroc Source checking is not independent reproduction. |
| 0.2986855472760137 average_precision Unit: fraction · Direction: higher | Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8194/8324 | reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: average_precision Source checking is not independent reproduction. |
| 0.64 precision_at_100 Unit: fraction · Direction: higher | Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8194/8324 | reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/spliceai-1.3.1.json :: precision_at_100 Source checking is not independent reproduction. |
Inspected the pinned runner README and result configuration with git show. No models were run; existing result and reproduction statuses are unchanged.
Stable record: rewire-model-spliceai-1-3-1Release 2026-09-16-d74d282221a9 · Record review: source checked
Stable ID: rewire-model-spliceai-1-3-1