Strengths and considerations
No source-reviewed explanatory claims are recorded here yet.
Species profiling on Dilthey2019 simulated long reads · Table 1:. Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp.
Explanatory profile: limited source coverage · Automated source review, 2026-09-17. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.
| Property | Description and evidence |
|---|---|
| Datasets | Not extracted or verified for this record. |
| Organisms | Not extracted or verified for this record. |
| Assays | Not extracted or verified for this record. |
| Splits | Not extracted or verified for this record. |
| Allowed inputs | Not extracted or verified for this record. |
| Adaptation | Not extracted or verified for this record. |
| Metrics | Not extracted or verified for this record. |
| Baselines | Not extracted or verified for this record. |
Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp.
Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.
These source-backed links do not make different protocols or scores interchangeable.
Each evaluation records what was tested and under which conditions.
Explore the results reported under one evaluation protocol. Each figure keeps its source, dataset and metric together; it is not a ranking across studies.
Recall (fraction) · Higher values are better for this metric.
Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp.
Evaluation protocol · Species profiling on Dilthey2019 simulated long reads
Source order is preserved. Plotted marks show point estimates; uncertainty, where reported, is retained in the printed values and table. Differences do not establish statistical significance.
Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads| Tested entity | Printed value | Uncertainty | Evidence |
|---|---|---|---|
| Lemur · Configuration | 0.951 fraction | Not reported | Author-reported evaluation · source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Lemur, column Recall; XML row2 column2 |
| Lemur + Magnet · Configuration | 0.927 fraction | Not reported | Author-reported evaluation · source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Lemur + Magnet, column Recall; XML row3 column2 |
| Melon · Configuration | 0.963 fraction | Not reported | Independent external evaluation · source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Melon, column Recall; XML row4 column2 |
| MetaMaps · Configuration | 1.000 fraction | Not reported | Result quoted from another source · source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row MetaMaps, column Recall; XML row5 column2 |
| Sourmash · Configuration | 0.927 fraction | Not reported | Independent external evaluation · source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Sourmash, column Recall; XML row6 column2 |
| Centrifuger · Configuration | 0.774 fraction | Not reported | Independent external evaluation · source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Centrifuger, column Recall; XML row7 column2 |
| Kraken 2 · Configuration | 0.976 fraction | Not reported | Independent external evaluation · source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Kraken 2, column Recall; XML row8 column2 |
Source transcription and grouping reviewed by automated source review on 2026-09-17. These experiments were not independently reproduced by rewire.
Release 2026-09-17-d277315f7d76 · 7 evaluations · 21 metric rows. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| Sourmash: Species profiling on Dilthey2019 simulated long reads Configuration: SourmashProtocol: Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling)Dataset: Species profiling on Dilthey2019 simulated long reads Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Independent external evaluation · Evaluation metadata: needs review | ||
| 0.932 F1 score Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Sourmash, column F1 score; XML row6 column4 Source checking is not independent reproduction. |
| 0.927 Recall Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Sourmash, column Recall; XML row6 column2 Source checking is not independent reproduction. |
| 0.938 Precision Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Sourmash, column Precision; XML row6 column3 Source checking is not independent reproduction. |
| Lemur + Magnet: Species profiling on Dilthey2019 simulated long reads Configuration: Lemur + MagnetProtocol: Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling)Dataset: Species profiling on Dilthey2019 simulated long reads Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Author-reported evaluation · Evaluation metadata: needs review | ||
| 0.950 Precision Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Lemur + Magnet, column Precision; XML row3 column3 Source checking is not independent reproduction. |
| 0.938 F1 score Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Lemur + Magnet, column F1 score; XML row3 column4 Source checking is not independent reproduction. |
| 0.927 Recall Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Lemur + Magnet, column Recall; XML row3 column2 Source checking is not independent reproduction. |
| Kraken 2: Species profiling on Dilthey2019 simulated long reads Configuration: Kraken 2Protocol: Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling)Dataset: Species profiling on Dilthey2019 simulated long reads Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Independent external evaluation · Evaluation metadata: needs review | ||
| 0.055 Precision Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Kraken 2, column Precision; XML row8 column3 Source checking is not independent reproduction. |
| 0.976 Recall Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Kraken 2, column Recall; XML row8 column2 Source checking is not independent reproduction. |
| 0.104 F1 score Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Kraken 2, column F1 score; XML row8 column4 Source checking is not independent reproduction. |
| Lemur: Species profiling on Dilthey2019 simulated long reads Configuration: LemurProtocol: Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling)Dataset: Species profiling on Dilthey2019 simulated long reads Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Author-reported evaluation · Evaluation metadata: needs review | ||
| 0.703 Precision Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Lemur, column Precision; XML row2 column3 Source checking is not independent reproduction. |
| 0.808 F1 score Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Lemur, column F1 score; XML row2 column4 Source checking is not independent reproduction. |
| 0.951 Recall Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Lemur, column Recall; XML row2 column2 Source checking is not independent reproduction. |
| Melon: Species profiling on Dilthey2019 simulated long reads Configuration: MelonProtocol: Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling)Dataset: Species profiling on Dilthey2019 simulated long reads Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Independent external evaluation · Evaluation metadata: needs review | ||
| 0.946 F1 score Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Melon, column F1 score; XML row4 column4 Source checking is not independent reproduction. |
| 0.929 Precision Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Melon, column Precision; XML row4 column3 Source checking is not independent reproduction. |
| 0.963 Recall Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Melon, column Recall; XML row4 column2 Source checking is not independent reproduction. |
| Centrifuger: Species profiling on Dilthey2019 simulated long reads Configuration: CentrifugerProtocol: Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling)Dataset: Species profiling on Dilthey2019 simulated long reads Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Independent external evaluation · Evaluation metadata: needs review | ||
| 0.774 Recall Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Centrifuger, column Recall; XML row7 column2 Source checking is not independent reproduction. |
| 0.050 Precision Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Centrifuger, column Precision; XML row7 column3 Source checking is not independent reproduction. |
| 0.093 F1 score Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Centrifuger, column F1 score; XML row7 column4 Source checking is not independent reproduction. |
| MetaMaps: Species profiling on Dilthey2019 simulated long reads Configuration: MetaMapsProtocol: Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling)Dataset: Species profiling on Dilthey2019 simulated long reads Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Result quoted from another source · Evaluation metadata: needs review | ||
| 0.862 Precision Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row MetaMaps, column Precision; XML row5 column3 Source checking is not independent reproduction. |
| 1.000 Recall Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row MetaMaps, column Recall; XML row5 column2 Source checking is not independent reproduction. |
| 0.926 F1 score Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row MetaMaps, column F1 score; XML row5 column4 Source checking is not independent reproduction. |
Last literature check: 2026-09-17. Primary-source discovery and table/protocol screening; source checked is not independently reproduced. Raw acquisitions not automatically numerical publication approval.
| Paper or primary resource | Version | Reference |
|---|---|---|
| Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet | PMC archival version PMC11185576.2 | Read source DOI: 10.1101/2024.06.01.596961 |
complete comparison tables extracted pending publication review
No source-reviewed explanatory claims are recorded here yet.
No source-reviewed explanatory claims are recorded here yet.
Primary-source transcription and separate automated review. No human sign-off or experimental reproduction.
Stable record: paper-protocol-1080592b8d6a8ce0bdTrace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
3 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Evaluation in this paper Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Individual claims | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads Version: PMC archival version PMC11185576.2 | source checked automated source review · 2026-09-17 Audit detailsPrimary-source transcription and separate automated review. No human sign-off or experimental reproduction. Field: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Introduction Species profiling on Dilthey2019 simulated long reads · Table 1:. Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Individual claims | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads Version: PMC archival version PMC11185576.2 | source checked automated source review · 2026-09-17 Audit detailsPrimary-source transcription and separate automated review. No human sign-off or experimental reproduction. Field: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| Relationship: evaluates task reported-task-6330d593980b5b Individual claims | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads Version: PMC archival version PMC11185576.2 | source checked automated source review · 2026-09-17 Audit detailsField: Claim: paper-claim-4e9825e29807055d9c Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Release 2026-09-17-d277315f7d76 · Record review: needs review
Stable ID: paper-protocol-1080592b8d6a8ce0bd