result · source checked
89.80 Genus-level F1
GTDB-Tk · Genus-level F1 · Real mock community MAGs
- Tested model
- GTDB-Tk
- Task or benchmark
- Mock-community MAG taxonomy classification
- Dataset
- Real mock community MAGs
- Procedure
- Genus classification of the same MAG set.
- Evaluation
- GTDB-Tk: Mock-community MAG taxonomy classification
- Evidence
- Independent external evaluation · source checkedkMetaShot: a fast and reliable taxonomy classifier for metagenome-assembled genomes · Table 2, F1-score % row, Genus Gtk column
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.
Evaluation results
Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| GTDB-Tk: Mock-community MAG taxonomy classification Model: GTDB-Tk · Benchmark: Mock-community MAG taxonomy classification · Dataset: Real mock community MAGs Genus classification of the same MAG set. Independent external evaluation · Evaluation metadata: needs review | ||
| 89.80 Genus-level F1 Unit: % · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedkMetaShot: a fast and reliable taxonomy classifier for metagenome-assembled genomes · Table 2, F1-score % row, Genus Gtk column Source checking is not independent reproduction. |
Sources and history
Release 2026-09-16-d74d282221a9 · Record review: source checked
- kMetaShot: a fast and reliable taxonomy classifier for metagenome-assembled genomes · Original source · PMC archival version PMC11695915.1
Technical metadata and extraction receipts
Stable ID: lit-b3-030
- areas
- microbes-communities
- tasks
- Mock-community MAG taxonomy classification
- printed value
- 89.80
- numeric value
- 89.80
- metric
- Genus-level F1
- metric direction
- unknown
- unit
- %
- uncertainty
- Not reported
- source locator
- Table 2, F1-score % row, Genus Gtk column
- review
- method: independent_ai_table_review; reviewer: Codex omics research agent; independent source-table review, not human review; reviewed at: 2026-09-16T10:44:03.418914+00:00; notes: Real mock sequencing table, F1-score percentage row; Genus is final three-column block, selecting kMS or Gtk rather than Species/Strain. Source check verifies central value and table context, not experiment reproduction or all metadata.; evidence: {"table_xml_id": "TB2", "row_cells": ["F1-score %", "28.13", "85.42", "86.24", "87.18", "87.72", "95.83", "89.80", "94.85"], "selected_cell_zero_based": 7, "selected_cell_xml": "<td align=\"left\" rowspan=\"1\" colspan=\"1\">89.80</td>", "caption": "Classification performance metrics measured on the real mock sequencing data."}; artifact sha256: 4584e93ea035c1170b8756a0a52cbe99fe72e70bd09b5f1dee639ee104f78247; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC11695915/fullTextXML
- legacy id
- lit-b3-030
- legacy row
- id: lit-b3-030; paper id: kmetashot-2025; domain id: microbes-communities; task: Mock-community MAG taxonomy classification; model: GTDB-Tk; model version: Not reported; dataset: Real mock community MAGs; dataset version: Not reported; split: Not reported; metric: Genus-level F1; value: 89.80; unit: %; uncertainty: Not reported; protocol: Genus classification of the same MAG set.; source locator: Table 2, F1-score % row, Genus Gtk column; source url: https://pmc.ncbi.nlm.nih.gov/articles/PMC11695915/; evaluation origin: independent_paper; reviewed utc: 2026-09-15T23:29:32Z
- missing metadata
- model version: not_reported_in_legacy_extract; dataset version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract; uncertainty: not_reported_in_legacy_extract