evaluation · reproduced

Pangolin · mask=False on MFASS v2

Evaluation procedure

Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset.

Metadata review: reproduced. Unreported conditions prevent automatic comparisons.

Release 2026-09-16-d74d282221a9 · 1 evaluation · 3 metric rows. Different protocols are not a single leaderboard.

Evaluated configurationMetricEvidence origin

Results grouped by the exact reported evaluation
Metric and finding	Coverage and uncertainty	Evidence
Pangolin · mask=False on MFASS v2 Model: Pangolin · mask=False · Benchmark: MFASS v2 · Dataset: MFASS v2 eligible assay cohort Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset. Rewire evaluation · Evaluation metadata: reproduced
0.8756851300560864 auroc Unit: fraction · Direction: higher	Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8301/8324	reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: auroc Source checking is not independent reproduction.
0.3887617543064248 average_precision Unit: fraction · Direction: higher	Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8301/8324	reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: average_precision Source checking is not independent reproduction.
0.65 precision_at_100 Unit: fraction · Direction: higher	Uncertainty: Point estimate; see paired-comparison artifacts. Coverage (scored/eligible): 8301/8324	reproducedMFASS v2 pinned rewire artifacts · benchmarks/mfass/results/pangolin-maskFalse.json :: precision_at_100 Source checking is not independent reproduction.

Release 2026-09-16-d74d282221a9 · Record review: reproduced

MFASS v2 pinned rewire artifacts · Original source · bee9133b83f3aedaf2bbb9013f1875515845607e

Technical metadata and extraction receipts

Stable ID: rewire-evaluation-pangolin-maskfalse

areas: dna-genomes
origin: rewire_run
protocol: Unchanged specialist run in genomic context with GENCODE v44; zero-shot on MFASS assay labels. Point metrics use the scored subset.
version: bee9133b83f3aedaf2bbb9013f1875515845607e
run url: /benchmarks/runs/mfass-v2/
comparison: protocol id: mfass-v2; dataset version: bee9133b83f3aedaf2bbb9013f1875515845607e; split: split-v2.tsv; population: 8301/8324; inputs: Not reported; adaptation: Not reported; metric implementation: Not reported; aggregation: Not reported; budget: Not reported
coverage: 8301/8324
missing metadata: paired comparison: Refer to paired bootstrap artifacts; marginal scores are not paired comparisons.

Related records