rewire.it
benchmark · task

CAMI II phylum read classification

This paper-specific evaluation tests CAMI II phylum read classification using CAMI II Sample_0 10,000-read subsample.

1 evaluations · 1 metric rows

At a glance

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.

Data, procedure and scoring
PropertyDescription and evidence
Record typePaper-specific task; protocol incompletely extractedNormalized compression distance for DNA classification · Table 5, NCD Phylum row, F1 column
InputsCAMI II Sample_0 10,000-read subsampleNormalized compression distance for DNA classification · Table 5, NCD Phylum row, F1 column
AssessmentMacro F1Normalized compression distance for DNA classification · Table 5, NCD Phylum row, F1 column
Recorded split or evaluation settingUnextractedNormalized compression distance for DNA classification · Table 5, NCD Phylum row, F1 column
DatasetsNot extracted or verified for this record.
OrganismsNot extracted or verified for this record.
AssaysNot extracted or verified for this record.
AdaptationNot extracted or verified for this record.
BaselinesNot extracted or verified for this record.

How it works

Reported evaluation outline

Outline of the existing paper extraction. Split membership, fitting details and scorer implementation remain incompletely reviewed.

Reported evaluation outlineCAMI II Sample_0 10,000-read subsample. Then: Recorded fitting or scoring procedure. Then: Assess Macro F1CAMI II Sample_0 10,000-readsubsampleRecorded fitting or scoringprocedureAssess Macro F1
Read the diagram as text
  1. CAMI II Sample_0 10,000-read subsample
  2. Recorded fitting or scoring procedure
  3. Assess Macro F1
Normalized compression distance for DNA classification · Table 5, NCD Phylum row, F1 column

Evaluation context

The existing paper extraction describes: Phylum-level macro-averaged F1; distinct taxonomic rank from the other row. This description is retained with the exact evaluation records; it is not a new protocol reconstruction.

Normalized compression distance for DNA classification · Table 5, NCD Phylum row, F1 column

Tested models and results

Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.

Results grouped by the exact reported evaluation
Metric and findingCoverage and uncertaintyEvidence
NCD-gzip: CAMI II phylum read classification

Phylum-level macro-averaged F1; distinct taxonomic rank from the other row.

Author-reported evaluation · Evaluation metadata: needs review

0.1263 Macro F1

Unit: unitless · Direction: unknown

Uncertainty: not reported in legacy extract

Scored: Not reported · Eligible: Not reported

source checkedNormalized compression distance for DNA classification · Table 5, NCD Phylum row, F1 column

Source checking is not independent reproduction.

Strengths and limitations

Profile review details

Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.

Stable record: reported-task-45105e1c486251

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: needs review

Download this release
Technical metadata and extraction receipts

Stable ID: reported-task-45105e1c486251

areas
microbes-communities
tasks
CAMI II phylum read classification
entity level
task
version
Not reported
task
CAMI II phylum read classification
scope note
Paper-specific evaluation task; protocol completeness requires further extraction.
missing metadata
protocol version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract
Related records

Suggest a correction