This MFASS evaluation uses Pangolin with masking disabled, scoring variants in genomic context.
Explanatory profile: source reviewed · Automated source review, 2026-09-16. This does not change the review status of its results.
| Property | Description and evidence |
|---|---|
| Mask | FalseMFASS v2 pinned rewire artifacts · benchmarks/mfass/README.md, MFASS-v2 results; results/pangolin-maskFalse.json, config and notes at bee9133b83f3aedaf2bbb9013f1875515845607e |
| Assay-label adaptation | Zero-shot on MFASS labelsMFASS v2 pinned rewire artifacts · benchmarks/mfass/README.md, MFASS-v2 results; results/pangolin-maskFalse.json, config and notes at bee9133b83f3aedaf2bbb9013f1875515845607e |
| Model type | Not extracted or verified for this record. |
| Known versions | Not extracted or verified for this record. |
| Training data | Not extracted or verified for this record. |
| Context limits | Not extracted or verified for this record. |
| Access | Not extracted or verified for this record. |
| Code licence | Not extracted or verified for this record. |
| Weights licence | Not extracted or verified for this record. |
Schematic of the pinned MFASS configuration; this does not generalise to every member of the model family.
The runner uses the specified reference and GENCODE annotation to predict changes in splice strength. The mask=False choice retains changes that annotation-based masking would remove. These specialist predictions were retained unchanged in the corrected v2 comparison.
MFASS v2 pinned rewire artifacts · benchmarks/mfass/README.md, MFASS-v2 results; results/pangolin-maskFalse.json, config and notes at bee9133b83f3aedaf2bbb9013f1875515845607eRelease 2026-09-16-d74d282221a9 · 1 evaluation · 3 metric rows. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| Pangolin · mask=False on MFASS v2 Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset. Rewire evaluation · Evaluation metadata: reproduced | ||
| 0.8756851300560864 auroc Unit: fraction · Direction: higher | Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8301/8324 | reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: auroc Source checking is not independent reproduction. |
| 0.3887617543064248 average_precision Unit: fraction · Direction: higher | Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8301/8324 | reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: average_precision Source checking is not independent reproduction. |
| 0.65 precision_at_100 Unit: fraction · Direction: higher | Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8301/8324 | reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: precision_at_100 Source checking is not independent reproduction. |
Inspected the pinned runner README and result configuration with git show. No models were run; existing result and reproduction statuses are unchanged.
Stable record: rewire-model-pangolin-maskfalseRelease 2026-09-16-d74d282221a9 · Record review: source checked
Stable ID: rewire-model-pangolin-maskfalse