benchmark · task

CAMI II superkingdom read classification

This paper-specific evaluation tests CAMI II superkingdom read classification using CAMI II Sample_0 10,000-read subsample.

1 evaluations · 1 metric rows

At a glance

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.

Data, procedure and scoring
Property	Description and evidence
Record type	Paper-specific task; protocol incompletely extractedNormalized compression distance for DNA classification · Table 5, NCD Superkingdom row, F1 column
Inputs	CAMI II Sample_0 10,000-read subsampleNormalized compression distance for DNA classification · Table 5, NCD Superkingdom row, F1 column
Assessment	Macro F1Normalized compression distance for DNA classification · Table 5, NCD Superkingdom row, F1 column
Recorded split or evaluation setting	UnextractedNormalized compression distance for DNA classification · Table 5, NCD Superkingdom row, F1 column
Datasets	Not extracted or verified for this record.
Organisms	Not extracted or verified for this record.
Assays	Not extracted or verified for this record.
Adaptation	Not extracted or verified for this record.
Baselines	Not extracted or verified for this record.

How it works

Reported evaluation outline

Outline of the existing paper extraction. Split membership, fitting details and scorer implementation remain incompletely reviewed.

Read the diagram as text

CAMI II Sample_0 10,000-read subsample
Recorded fitting or scoring procedure
Assess Macro F1

Normalized compression distance for DNA classification · Table 5, NCD Superkingdom row, F1 column

Evaluation context

The existing paper extraction describes: Superkingdom-level macro-averaged F1; NCD assigns every read. This description is retained with the exact evaluation records; it is not a new protocol reconstruction.

Normalized compression distance for DNA classification · Table 5, NCD Superkingdom row, F1 column

Tested models and results

Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.

Evaluated configurationMetricEvidence origin

Results grouped by the exact reported evaluation
Metric and finding	Coverage and uncertainty	Evidence
NCD-gzip: CAMI II superkingdom read classification Model: NCD-gzip · Benchmark: CAMI II superkingdom read classification · Dataset: CAMI II Sample_0 10,000-read subsample Superkingdom-level macro-averaged F1; NCD assigns every read. Author-reported evaluation · Evaluation metadata: needs review
0.9804 Macro F1 Unit: unitless · Direction: unknown	Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported	source checkedNormalized compression distance for DNA classification · Table 5, NCD Superkingdom row, F1 column Source checking is not independent reproduction.

Strengths and limitations

Strengths and considerations

The linked evaluation identifies the paper-specific dataset and assessment rather than treating the task name as a universal benchmark.Normalized compression distance for DNA classification · Table 5, NCD Superkingdom row, F1 column

Limitations and conditions

The numerical table check does not establish the full data-processing, fitting or leakage-control protocol.Normalized compression distance for DNA classification · Table 5, NCD Superkingdom row, F1 column

Profile review details

Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.

Stable record: reported-task-a2c37b8c420bc3

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: needs review

Normalized compression distance for DNA classification · Original source · version of record

Download this release

Technical metadata and extraction receipts

Stable ID: reported-task-a2c37b8c420bc3

areas: microbes-communities
tasks: CAMI II superkingdom read classification
entity level: task
version: Not reported
task: CAMI II superkingdom read classification
scope note: Paper-specific evaluation task; protocol completeness requires further extraction.
missing metadata: protocol version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract

Related records

dataset: CAMI II Sample_0 10,000-read subsample
benchmark: NCD-gzip: CAMI II superkingdom read classification

Suggest a correction