Strengths and considerations
No source-reviewed explanatory claims are recorded here yet.
MFASS v1 is a superseded historical protocol whose baseline used an incorrectly centred sequence window.
Explanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.
| Property | Description and evidence |
|---|---|
| Datasets | Historical MFASS exon-recognition evaluation; the correction notice documents a sequence-orientation mismatch in the v1 baseline.SourcesMFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e · Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot |
| Splits | The source distinguishes protocol versions from split versions. The earlier exon-only split-cost experiment requires a corrected rerun; its conclusions are withdrawn.SourcesMFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e · Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot |
| Metrics | Precision at a fixed review capacity, average precision and AUROC. Each method’s point estimates use its scored subset; paired comparisons use common scored variants.SourcesMFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e · Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot |
| Baselines | Historical baseline and specialist results are preserved for audit. The corrected v2 baseline and DNABERT-2 protocol must not be relabelled as v1.SourcesMFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e · Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot |
| Leakage controls | The v1 windowing defect invalidates its baseline comparisons as current evidence; this is separate from the grouped-split controls.SourcesMFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e · Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot |
| Uncertainty | The archived SpliceAI comparison records 2,000 paired bootstrap draws, 454 independent groups and 95% interval bounds. These quantify sampling uncertainty in the historical run; they do not correct its sequence-window error and must not be reused as current baseline evidence.Sources (2)Archived MFASS v1 SpliceAI comparison; MFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e · Archived JSON: independent_groups and paired.*.{draws,ci95_low,ci95_high}; README correction notice |
| Entity type | Superseded historical computational protocol.SourcesMFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e · Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot |
| Organisms | Human (Homo sapiens): naturally occurring ExAC variants in or beside human exons, measured in the MFASS minigene assay.SourcesMFASS original assay accession GSE120695 · GSE120695 SOFT: Series_summary and Sample_organism_ch1 fields |
| Assays | MFASS functional exon-recognition labels.SourcesMFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e · Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot |
| Allowed inputs | Historical baseline uses the incorrectly centered sequence window; corrected assay-oriented pairs belong to v2.SourcesMFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e · Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot |
| Adaptation | Historical supervised baseline; its comparisons and split-cost claims are withdrawn pending corrected reruns.SourcesMFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e · Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot |
Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.
Historical MFASS exon-recognition evaluation; the correction notice documents a sequence-orientation mismatch in the v1 baseline. The source distinguishes protocol versions from split versions. The earlier exon-only split-cost experiment requires a corrected rerun; its conclusions are withdrawn. Precision at a fixed review capacity, average precision and AUROC. Each method’s point estimates use its scored subset; paired comparisons use common scored variants. Historical baseline and specialist results are preserved for audit. The corrected v2 baseline and DNABERT-2 protocol must not be relabelled as v1. The v1 windowing defect invalidates its baseline comparisons as current evidence; this is separate from the grouped-split controls.
Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.
These source-backed links do not make different protocols or scores interchangeable.
Release 2026-09-17-d277315f7d76 · 0 evaluations · 0 metric rows. Different protocols are not a single leaderboard.
No evaluations linked in this release.
Last literature check: 2026-09-17. Dated primary-source discovery and protocol/table screening. Source checking does not mean experimental reproduction. Only separately extracted and independently reviewed numeric batches are publishable.
| Paper or primary resource | Version | Reference |
|---|---|---|
| MFASS benchmark: corrected v2 protocol and reproducibility instructions | Primary full-text snapshot retrieved 2026-09-17; exact bytes pinned by SHA-256 | Read source |
historical results preserved
No source-reviewed explanatory claims are recorded here yet.
Task-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced. Original assay organism checked against GEO SOFT metadata; v1 interval procedure checked against its immutable historical JSON without rehabilitating superseded comparisons.
Stable record: rewire-mfass-v1Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
19 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Diagram caption Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol. Individual claims | MFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsTask-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced. Original assay organism checked against GEO SOFT metadata; v1 interval procedure checked against its immutable historical JSON without rehabilitating superseded comparisons. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Diagram steps ["Input: Historical baseline uses the incorrectly centered sequence window; corrected assay-oriented pairs belong to v2.","Evaluation: Historical supervised baseline; its comparisons and split-cost claims are withdrawn pending corrected reruns.","Readout: Precision at a fixed review capacity, average precision and AUROC. Each method’s point estimates use its scored subset; paired comparisons use common scored variants."] Individual claims | MFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsTask-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced. Original assay organism checked against GEO SOFT metadata; v1 interval procedure checked against its immutable historical JSON without rehabilitating superseded comparisons. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Diagram title Computational evaluation flow Individual claims | MFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsTask-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced. Original assay organism checked against GEO SOFT metadata; v1 interval procedure checked against its immutable historical JSON without rehabilitating superseded comparisons. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Datasets Historical MFASS exon-recognition evaluation; the correction notice documents a sequence-orientation mismatch in the v1 baseline. Individual claims | MFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsTask-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced. Original assay organism checked against GEO SOFT metadata; v1 interval procedure checked against its immutable historical JSON without rehabilitating superseded comparisons. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Splits The source distinguishes protocol versions from split versions. The earlier exon-only split-cost experiment requires a corrected rerun; its conclusions are withdrawn. Individual claims | MFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsTask-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced. Original assay organism checked against GEO SOFT metadata; v1 interval procedure checked against its immutable historical JSON without rehabilitating superseded comparisons. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Adaptation Historical supervised baseline; its comparisons and split-cost claims are withdrawn pending corrected reruns. Individual claims | MFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsTask-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced. Original assay organism checked against GEO SOFT metadata; v1 interval procedure checked against its immutable historical JSON without rehabilitating superseded comparisons. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Metrics Precision at a fixed review capacity, average precision and AUROC. Each method’s point estimates use its scored subset; paired comparisons use common scored variants. Individual claims | MFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsTask-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced. Original assay organism checked against GEO SOFT metadata; v1 interval procedure checked against its immutable historical JSON without rehabilitating superseded comparisons. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Baselines Historical baseline and specialist results are preserved for audit. The corrected v2 baseline and DNABERT-2 protocol must not be relabelled as v1. Individual claims | MFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsTask-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced. Original assay organism checked against GEO SOFT metadata; v1 interval procedure checked against its immutable historical JSON without rehabilitating superseded comparisons. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Leakage controls The v1 windowing defect invalidates its baseline comparisons as current evidence; this is separate from the grouped-split controls. Individual claims | MFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e Pinned README: correction notice; Dataset; Cohort reconciliation; Split; MFASS-v2 results; Paired comparisons; Limits; Archived mfass-v1 snapshot Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsTask-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced. Original assay organism checked against GEO SOFT metadata; v1 interval procedure checked against its immutable historical JSON without rehabilitating superseded comparisons. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Uncertainty The archived SpliceAI comparison records 2,000 paired bootstrap draws, 454 independent groups and 95% interval bounds. These quantify sampling uncertainty in the historical run; they do not correct its sequence-window error and must not be reused as current baseline evidence. Individual claims | MFASS computational protocol README at bee9133b83f3aedaf2bbb9013f1875515845607e Archived JSON: independent_groups and paired.*.{draws,ci95_low,ci95_high}; README correction notice Shared locator for this statement’s cited sources; not a separate locator for each citation. Version: bee9133b83f3aedaf2bbb9013f1875515845607e | source checked automated source review · 2026-09-16 Audit detailsTask-specific computational methodology and field context checked in the cited primary-source artifact. Source-backed fields, inapplicable evaluator dimensions and unresolved details are distinguished. Numerical results were not reproduced. Original assay organism checked against GEO SOFT metadata; v1 interval procedure checked against its immutable historical JSON without rehabilitating superseded comparisons. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Release 2026-09-17-d277315f7d76 · Record review: superseded
Superseded by MFASS v2
Download this releaseStable ID: rewire-mfass-v1