rewire.it
benchmark · task

Long-read taxonomic profiling

This paper-specific evaluation tests Long-read taxonomic profiling using Zymo LOG 10%.

2 evaluations · 2 metric rows

At a glance

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.

Data, procedure and scoring
PropertyDescription and evidence
Record typePaper-specific task; protocol incompletely extractedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 3, LOG 10% / Lemur row, F1 column; Table 3, LOG 10% / Kraken 2 row, F1 column
InputsZymo LOG 10%Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 3, LOG 10% / Lemur row, F1 column; Table 3, LOG 10% / Kraken 2 row, F1 column
AssessmentF1Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 3, LOG 10% / Lemur row, F1 column; Table 3, LOG 10% / Kraken 2 row, F1 column
Recorded split or evaluation settingUnextractedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 3, LOG 10% / Lemur row, F1 column; Table 3, LOG 10% / Kraken 2 row, F1 column
DatasetsNot extracted or verified for this record.
OrganismsNot extracted or verified for this record.
AssaysNot extracted or verified for this record.
AdaptationNot extracted or verified for this record.
BaselinesNot extracted or verified for this record.

How it works

Reported evaluation outline

Outline of the existing paper extraction. Split membership, fitting details and scorer implementation remain incompletely reviewed.

Reported evaluation outlineZymo LOG 10%. Then: Recorded fitting or scoring procedure. Then: Assess F1Zymo LOG 10%Recorded fitting or scoringprocedureAssess F1
Read the diagram as text
  1. Zymo LOG 10%
  2. Recorded fitting or scoring procedure
  3. Assess F1
Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 3, LOG 10% / Lemur row, F1 column; Table 3, LOG 10% / Kraken 2 row, F1 column

Evaluation context

The existing paper extraction describes: Mean across five replicate runs on Zymo LOG 10%. This description is retained with the exact evaluation records; it is not a new protocol reconstruction.

Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 3, LOG 10% / Lemur row, F1 column; Table 3, LOG 10% / Kraken 2 row, F1 column

Tested models and results

Release 2026-09-16-d74d282221a9 · 2 evaluations · 2 metric rows. Different protocols are not a single leaderboard.

Results grouped by the exact reported evaluation
Metric and findingCoverage and uncertaintyEvidence
Lemur: Long-read taxonomic profiling

Mean across five replicate runs on Zymo LOG 10%.

Author-reported evaluation · Evaluation metadata: needs review

0.376 F1

Unit: unitless · Direction: unknown

Uncertainty: not reported in legacy extract

Scored: Not reported · Eligible: Not reported

source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 3, LOG 10% / Lemur row, F1 column

Source checking is not independent reproduction.

Kraken 2: Long-read taxonomic profiling

Mean across five replicate runs on Zymo LOG 10%.

Independent external evaluation · Evaluation metadata: needs review

0.375 F1

Unit: unitless · Direction: unknown

Uncertainty: not reported in legacy extract

Scored: Not reported · Eligible: Not reported

source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 3, LOG 10% / Kraken 2 row, F1 column

Source checking is not independent reproduction.

Strengths and limitations

Profile review details

Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.

Stable record: reported-task-6330d593980b5b

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: needs review

Download this release
Technical metadata and extraction receipts

Stable ID: reported-task-6330d593980b5b

areas
microbes-communities
tasks
Long-read taxonomic profiling
entity level
task
version
Not reported
task
Long-read taxonomic profiling
scope note
Paper-specific evaluation task; protocol completeness requires further extraction.
missing metadata
protocol version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract
Related records

Suggest a correction