rewire.it
result · source checked

0.9804 Macro F1

NCD-gzip · Macro F1 · CAMI II Sample_0 10,000-read subsample

Tested model
NCD-gzip
Task or benchmark
CAMI II superkingdom read classification
Dataset
CAMI II Sample_0 10,000-read subsample
Procedure
Superkingdom-level macro-averaged F1; NCD assigns every read.
Evaluation
NCD-gzip: CAMI II superkingdom read classification
Evidence
Author-reported evaluation · source checkedNormalized compression distance for DNA classification · Table 5, NCD Superkingdom row, F1 column

A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.

Evaluation results

Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.

Results grouped by the exact reported evaluation
Metric and findingCoverage and uncertaintyEvidence
NCD-gzip: CAMI II superkingdom read classification
Model: NCD-gzip · Benchmark: CAMI II superkingdom read classification · Dataset: CAMI II Sample_0 10,000-read subsample

Superkingdom-level macro-averaged F1; NCD assigns every read.

Author-reported evaluation · Evaluation metadata: needs review

0.9804 Macro F1

Unit: unitless · Direction: unknown

Uncertainty: not reported in legacy extract

Scored: Not reported · Eligible: Not reported

source checkedNormalized compression distance for DNA classification · Table 5, NCD Superkingdom row, F1 column

Source checking is not independent reproduction.

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: source checked

Download this release
Technical metadata and extraction receipts

Stable ID: lit-b3-023

areas
microbes-communities
tasks
CAMI II superkingdom read classification
printed value
0.9804
numeric value
0.9804
metric
Macro F1
metric direction
unknown
unit
unitless
uncertainty
Not reported
source locator
Table 5, NCD Superkingdom row, F1 column
review
method: independent_ai_table_review; reviewer: Codex omics research agent; independent source-table review, not human review; reviewed at: 2026-09-16T10:44:03.414806+00:00; notes: NCD rank-specific table 5, F1 column; Superkingdom and Phylum are different classification granularities. Source check verifies central value and table context, not experiment reproduction or all metadata.; evidence: {"table_xml_id": "table-5", "row_cells": ["Superkingdom", "0.9616", "1.0000", "0.9804", "0.9616"], "selected_cell_zero_based": 3, "selected_cell_xml": "<td rowspan=\"1\" colspan=\"1\">0.9804</td>", "caption": "Taxonomic classification on the CAMI II 10,000-read subsample (Sample_0).Metrics are macro-averaged (recall, precision, F1) and micro-averaged (accuracy). NCD uses genome fragmentation (‘Genome fragmentation’) and assigns every read; Kraken2 uses low-confidence assignments and leaves 61.4% unclassified."}; artifact sha256: 10e9ba780c45e7787baff9b81ef7b45c014d7fe6c716d6c759e14d89a813dc1c; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12884959/fullTextXML
legacy id
lit-b3-023
legacy row
id: lit-b3-023; paper id: ncd-metagenomics-2026; domain id: microbes-communities; task: CAMI II superkingdom read classification; model: NCD-gzip; model version: Not reported; dataset: CAMI II Sample_0 10,000-read subsample; dataset version: 10,000 reads; split: Not reported; metric: Macro F1; value: 0.9804; unit: unitless; uncertainty: Not reported; protocol: Superkingdom-level macro-averaged F1; NCD assigns every read.; source locator: Table 5, NCD Superkingdom row, F1 column; source url: https://pmc.ncbi.nlm.nih.gov/articles/PMC12884959/; evaluation origin: author_reported; reviewed utc: 2026-09-15T23:29:32Z
missing metadata
model version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract; uncertainty: not_reported_in_legacy_extract
Related records

Suggest a correction