Can a sequence method generalize beyond taxa present during fitting?
Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.
| Property | Description and evidence |
|---|---|
| Record type | Generic task; proposed designProkBERT official resource; METAGENE-1 official resource; Evo 2 official resource; Kraken2 official resource · Catalogue task scope and proposed comparison design; concrete source protocol has not yet been extracted |
| Inputs | Hold clades out of downstream fitting and reference databases; evaluate known ancestor labels or unknown-taxon detection, and audit pretraining overlap separately.ProkBERT official resource; METAGENE-1 official resource; Evo 2 official resource; Kraken2 official resource · Catalogue task scope and proposed comparison design; concrete source protocol has not yet been extracted |
| Assessment | No single dataset, split or scoring implementation is fixed by this task recordProkBERT official resource; METAGENE-1 official resource; Evo 2 official resource; Kraken2 official resource · Catalogue task scope and proposed comparison design; concrete source protocol has not yet been extracted |
| Datasets | Not extracted or verified for this record. |
| Organisms | Not extracted or verified for this record. |
| Assays | Not extracted or verified for this record. |
| Splits | Not extracted or verified for this record. |
| Adaptation | Not extracted or verified for this record. |
| Baselines | Not extracted or verified for this record. |
Conceptual design only. This generic task has no fixed executable protocol and does not imply a completed run.
Withhold the chosen clades from downstream training and reference databases, then separately audit overlap with model pretraining.
ProkBERT official resource; METAGENE-1 official resource; Evo 2 official resource; Kraken2 official resource · Catalogue task scope and proposed comparison design; concrete source protocol has not yet been extractedRelease 2026-09-16-d74d282221a9 · 0 evaluations · 0 metric rows. Different protocols are not a single leaderboard.
No evaluations linked in this release.
Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.
Stable record: catalog-task-heldout-cladeApplicability is distinct from a completed evaluation.
Release 2026-09-16-d74d282221a9 · Record review: discovered
Stable ID: catalog-task-heldout-clade