rewire.it
benchmark · task

Mock-community MAG taxonomy classification

This paper-specific evaluation tests Mock-community MAG taxonomy classification using Real mock community MAGs.

2 evaluations · 2 metric rows

At a glance

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.

Data, procedure and scoring
PropertyDescription and evidence
Record typePaper-specific task; protocol incompletely extractedkMetaShot: a fast and reliable taxonomy classifier for metagenome-assembled genomes · Table 2, F1-score % row, Genus kMS column; Table 2, F1-score % row, Genus Gtk column
InputsReal mock community MAGskMetaShot: a fast and reliable taxonomy classifier for metagenome-assembled genomes · Table 2, F1-score % row, Genus kMS column; Table 2, F1-score % row, Genus Gtk column
AssessmentGenus-level F1kMetaShot: a fast and reliable taxonomy classifier for metagenome-assembled genomes · Table 2, F1-score % row, Genus kMS column; Table 2, F1-score % row, Genus Gtk column
Recorded split or evaluation settingUnextractedkMetaShot: a fast and reliable taxonomy classifier for metagenome-assembled genomes · Table 2, F1-score % row, Genus kMS column; Table 2, F1-score % row, Genus Gtk column
DatasetsNot extracted or verified for this record.
OrganismsNot extracted or verified for this record.
AssaysNot extracted or verified for this record.
AdaptationNot extracted or verified for this record.
BaselinesNot extracted or verified for this record.

How it works

Reported evaluation outline

Outline of the existing paper extraction. Split membership, fitting details and scorer implementation remain incompletely reviewed.

Reported evaluation outlineReal mock community MAGs. Then: Recorded fitting or scoring procedure. Then: Assess Genus-level F1Real mock community MAGsRecorded fitting or scoringprocedureAssess Genus-level F1
Read the diagram as text
  1. Real mock community MAGs
  2. Recorded fitting or scoring procedure
  3. Assess Genus-level F1
kMetaShot: a fast and reliable taxonomy classifier for metagenome-assembled genomes · Table 2, F1-score % row, Genus kMS column; Table 2, F1-score % row, Genus Gtk column

Evaluation context

The existing paper extraction describes: Genus classification of MAGs from MegaHIT contigs; uncorrected kMetaShot.; Genus classification of the same MAG set. This description is retained with the exact evaluation records; it is not a new protocol reconstruction.

kMetaShot: a fast and reliable taxonomy classifier for metagenome-assembled genomes · Table 2, F1-score % row, Genus kMS column; Table 2, F1-score % row, Genus Gtk column

Tested models and results

Release 2026-09-16-d74d282221a9 · 2 evaluations · 2 metric rows. Different protocols are not a single leaderboard.

Results grouped by the exact reported evaluation
Metric and findingCoverage and uncertaintyEvidence
kMetaShot: Mock-community MAG taxonomy classification

Genus classification of MAGs from MegaHIT contigs; uncorrected kMetaShot.

Author-reported evaluation · Evaluation metadata: needs review

95.83 Genus-level F1

Unit: % · Direction: unknown

Uncertainty: not reported in legacy extract

Scored: Not reported · Eligible: Not reported

source checkedkMetaShot: a fast and reliable taxonomy classifier for metagenome-assembled genomes · Table 2, F1-score % row, Genus kMS column

Source checking is not independent reproduction.

GTDB-Tk: Mock-community MAG taxonomy classification

Genus classification of the same MAG set.

Independent external evaluation · Evaluation metadata: needs review

89.80 Genus-level F1

Unit: % · Direction: unknown

Uncertainty: not reported in legacy extract

Scored: Not reported · Eligible: Not reported

source checkedkMetaShot: a fast and reliable taxonomy classifier for metagenome-assembled genomes · Table 2, F1-score % row, Genus Gtk column

Source checking is not independent reproduction.

Strengths and limitations

Profile review details

Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.

Stable record: reported-task-8406b6aabfb8c0

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: needs review

Download this release
Technical metadata and extraction receipts

Stable ID: reported-task-8406b6aabfb8c0

areas
microbes-communities
tasks
Mock-community MAG taxonomy classification
entity level
task
version
Not reported
task
Mock-community MAG taxonomy classification
scope note
Paper-specific evaluation task; protocol completeness requires further extraction.
missing metadata
protocol version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract
Related records

Suggest a correction