Corrected k-mer / position baseline on MFASS v2
Evaluation procedure
Assay-oriented 21 bp k-mer window, exon position, allele identity and conservation features; gradient-boosted trees trained on the MFASS training split.
- Model
- Corrected k-mer / position baseline
- Benchmark
- MFASS v2
- Dataset
- MFASS v2 eligible assay cohort
- origin
- Rewire evaluation
- configuration
- bee9133b83f3aedaf2bbb9013f1875515845607e
- protocol id
- mfass-v2
- dataset version
- bee9133b83f3aedaf2bbb9013f1875515845607e
- split
- split-v2.tsv
- population
- 8324/8324
- inputs
- Not reported
- adaptation
- Not reported
- metric implementation
- Not reported
- aggregation
- Not reported
- budget
- Not reported
Metadata review: reproduced. Unreported conditions prevent automatic comparisons.
Evaluation results
Release 2026-09-16-d74d282221a9 · 1 evaluation · 3 metric rows. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| Corrected k-mer / position baseline on MFASS v2 Model: Corrected k-mer / position baseline · Benchmark: MFASS v2 · Dataset: MFASS v2 eligible assay cohort Assay-oriented 21 bp k-mer window, exon position, allele identity and conservation features; gradient-boosted trees trained on the MFASS training split. Rewire evaluation · Evaluation metadata: reproduced | ||
| 0.7779498064677238 auroc Unit: fraction · Direction: higher | Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8324/8324 | reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/baseline-kmer-position-v2.json :: auroc Source checking is not independent reproduction. |
| 0.28641674595892375 average_precision Unit: fraction · Direction: higher | Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8324/8324 | reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/baseline-kmer-position-v2.json :: average_precision Source checking is not independent reproduction. |
| 0.61 precision_at_100 Unit: fraction · Direction: higher | Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8324/8324 | reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/baseline-kmer-position-v2.json :: precision_at_100 Source checking is not independent reproduction. |
Sources and history
Release 2026-09-16-d74d282221a9 · Record review: reproduced
- MFASS v2 pinned rewire artifacts · Original source · bee9133b83f3aedaf2bbb9013f1875515845607e
Technical metadata and extraction receipts
Stable ID: rewire-evaluation-baseline-kmer-position-v2
- areas
- dna-genomes
- origin
- rewire_run
- protocol
- Assay-oriented 21 bp k-mer window, exon position, allele identity and conservation features; gradient-boosted trees trained on the MFASS training split.
- version
- bee9133b83f3aedaf2bbb9013f1875515845607e
- run url
- /benchmarks/runs/mfass-v2/
- comparison
- protocol id: mfass-v2; dataset version: bee9133b83f3aedaf2bbb9013f1875515845607e; split: split-v2.tsv; population: 8324/8324; inputs: Not reported; adaptation: Not reported; metric implementation: Not reported; aggregation: Not reported; budget: Not reported
- coverage
- 8324/8324
- missing metadata
- paired comparison: Refer to paired bootstrap artifacts; marginal scores are not paired comparisons.
Related records
- model: Corrected k-mer / position baseline
- benchmark: MFASS v2
- dataset: MFASS v2 eligible assay cohort
- evaluation: Corrected k-mer / position baseline · auroc
- evaluation: Corrected k-mer / position baseline · average_precision
- evaluation: Corrected k-mer / position baseline · precision_at_100