rewire.it
benchmark · task

unseen-species genus classification

Classify DNA barcodes from unseen species at the genus level.

1 evaluations · 1 metric rows

At a glance

Explanatory profile: source reviewed · Automated source review, 2026-09-16. This does not change the review status of its results.

Data, procedure and scoring
PropertyDescription and evidence
Record typePaper-specific nearest-neighbour protocolBarcodeBERT: transformers for biodiversity analyses · BarcodeBERT paper: 3.1 Dataset / Data partitioning; genus-level 1-NN probing paragraph; Table 1
InputsDNA barcodes from the Canadian invertebrate reference libraryBarcodeBERT: transformers for biodiversity analyses · BarcodeBERT paper: 3.1 Dataset / Data partitioning; genus-level 1-NN probing paragraph; Table 1
AssessmentGenus-level classification accuracyBarcodeBERT: transformers for biodiversity analyses · BarcodeBERT paper: 3.1 Dataset / Data partitioning; genus-level 1-NN probing paragraph; Table 1
Reported configurationBarcodeBERT (4–4–4); genus-level 1-NN probe, distinct from fine-tuned species classificationBarcodeBERT: transformers for biodiversity analyses · Table 1, BarcodeBERT (4–4–4) row; 1-NN probe column
DatasetsNot extracted or verified for this record.
OrganismsNot extracted or verified for this record.
AssaysNot extracted or verified for this record.
SplitsNot extracted or verified for this record.
AdaptationNot extracted or verified for this record.
BaselinesNot extracted or verified for this record.

How it works

Procedure overview

Conceptual overview, not an executable specification.

Procedure overviewSeen reference barcodes. Then: Embed unseen-species queries. Then: Cosine nearest neighbour. Then: Score genus labelsSeen reference barcodesEmbed unseen-species queriesCosine nearest neighbourScore genus labels
Read the diagram as text
  1. Seen reference barcodes
  2. Embed unseen-species queries
  3. Cosine nearest neighbour
  4. Score genus labels
BarcodeBERT: transformers for biodiversity analyses · BarcodeBERT paper: 3.1 Dataset / Data partitioning; genus-level 1-NN probing paragraph; Table 1

Procedure

Use the training subset of the Seen partition as the reference and the Unseen partition as queries. Compare frozen sequence representations with cosine similarity and assign the label of the single nearest reference. Species are absent from other partitions, while their genera occur in the reference.

BarcodeBERT: transformers for biodiversity analyses · BarcodeBERT paper: 3.1 Dataset / Data partitioning; genus-level 1-NN probing paragraph; Table 1

Tested models and results

Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.

Results grouped by the exact reported evaluation
Metric and findingCoverage and uncertaintyEvidence
BarcodeBERT (4–4-4): unseen-species genus classification

genus-level nearest-neighbor probe on species unseen in training

Author-reported evaluation · Evaluation metadata: needs review

78.5% accuracy

Unit: percent · Direction: unknown

Uncertainty: not reported in legacy extract

Scored: Not reported · Eligible: Not reported

source checkedBarcodeBERT: transformers for biodiversity analyses · Table 1, BarcodeBERT (4–4-4) row, unseen-species genus-level 1-NN Acc (%) column

Source checking is not independent reproduction.

Strengths and limitations

Limitations and conditions

  • This is not unseen-genus classification or universal metagenomic recognition. BLAST is a relevant alignment comparator in the same paper.BarcodeBERT: transformers for biodiversity analyses · BarcodeBERT paper: 3.1 Dataset / Data partitioning; genus-level 1-NN probing paragraph; Table 1
Profile review details

Primary-source description checked by an automated research assistant. This is profile review, not independent execution or numerical reproduction.

Stable record: reported-task-4a54ce01b5a855

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: needs review

Download this release
Technical metadata and extraction receipts

Stable ID: reported-task-4a54ce01b5a855

areas
dna-genomes
tasks
unseen-species genus classification
entity level
task
version
Not reported
task
unseen-species genus classification
scope note
Paper-specific evaluation task; protocol completeness requires further extraction.
missing metadata
protocol version: not_reported_in_legacy_extract
Related records

Suggest a correction