This paper-specific evaluation tests regulatory element identification using DART-Eval cCREs versus matched shuffled controls.
Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.
| Property | Description and evidence |
|---|---|
| Record type | Paper-specific task; protocol incompletely extractedDART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA · Table 3 (PDF page 5), DNABERT-2 row, Zero-Shot Accuracy column |
| Inputs | DART-Eval cCREs versus matched shuffled controlsDART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA · Table 3 (PDF page 5), DNABERT-2 row, Zero-Shot Accuracy column |
| Assessment | accuracyDART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA · Table 3 (PDF page 5), DNABERT-2 row, Zero-Shot Accuracy column |
| Recorded split or evaluation setting | paper evaluationDART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA · Table 3 (PDF page 5), DNABERT-2 row, Zero-Shot Accuracy column |
| Datasets | Not extracted or verified for this record. |
| Organisms | Not extracted or verified for this record. |
| Assays | Not extracted or verified for this record. |
| Adaptation | Not extracted or verified for this record. |
| Baselines | Not extracted or verified for this record. |
Outline of the existing paper extraction. Split membership, fitting details and scorer implementation remain incompletely reviewed.
The existing paper extraction describes: zero-shot likelihood ranking: higher likelihood for cCRE than matched control. This description is retained with the exact evaluation records; it is not a new protocol reconstruction.
DART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA · Table 3 (PDF page 5), DNABERT-2 row, Zero-Shot Accuracy columnRelease 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| DNABERT-2: regulatory element identification Model: DNABERT-2 · Benchmark: regulatory element identification · Dataset: DART-Eval cCREs versus matched shuffled controls zero-shot likelihood ranking: higher likelihood for cCRE than matched control Independent external evaluation · Evaluation metadata: needs review | ||
| 0.876 accuracy Unit: fraction · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedDART-Eval: A Comprehensive DNA Language Model Evaluation Benchmark on Regulatory DNA · Table 3 (PDF page 5), DNABERT-2 row, Zero-Shot Accuracy column Source checking is not independent reproduction. |
Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.
Stable record: reported-task-cdbee1c9285568Release 2026-09-16-d74d282221a9 · Record review: needs review
Stable ID: reported-task-cdbee1c9285568