Lemur: Species profiling on Dilthey2019 simulated long reads
Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp.
Evaluation procedure
Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp.
- Configuration
- Lemur
- Protocol
- Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling)
- Dataset
- Species profiling on Dilthey2019 simulated long reads
- origin
- Author-reported evaluation
- configuration
- Paper-specific evaluated pipeline; exact checkpoint not inferred from label
- protocol id
- paper-protocol-1080592b8d6a8ce0bd
- dataset version
- Not reported
- split
- 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp.
- subset
- Species profiling on Dilthey2019 simulated long reads
- population
- Not reported
- aggregation
- Not reported
- inputs
- Not reported
- adaptation
- Paper-specific evaluated pipeline; exact checkpoint not inferred from label
- budget
- Not reported
- metric implementation
- Not reported
Metadata review: needs review. Unreported conditions prevent automatic comparisons.
Evaluation results
Release 2026-09-17-d277315f7d76 · 1 evaluation · 3 metric rows. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| Lemur: Species profiling on Dilthey2019 simulated long reads Configuration: LemurProtocol: Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling)Dataset: Species profiling on Dilthey2019 simulated long reads Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Author-reported evaluation · Evaluation metadata: needs review | ||
| 0.703 Precision Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Lemur, column Precision; XML row2 column3 Source checking is not independent reproduction. |
| 0.808 F1 score Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Lemur, column F1 score; XML row2 column4 Source checking is not independent reproduction. |
| 0.951 Recall Unit: fraction · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 1:, row Lemur, column Recall; XML row2 column2 Source checking is not independent reproduction. |
Evidence table
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
19 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.comparison.adaptation Paper-specific evaluated pipeline; exact checkpoint not inferred from label Context-only references | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads Version: PMC archival version PMC11185576.2 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.aggregation No value recorded Context-only references | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads Version: PMC archival version PMC11185576.2 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.budget No value recorded Context-only references | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads Version: PMC archival version PMC11185576.2 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.dataset_version No value recorded Context-only references | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads Version: PMC archival version PMC11185576.2 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.inputs No value recorded Context-only references | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads Version: PMC archival version PMC11185576.2 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.metric_implementation No value recorded Context-only references | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads Version: PMC archival version PMC11185576.2 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.population No value recorded Context-only references | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads Version: PMC archival version PMC11185576.2 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.protocol_id paper-protocol-1080592b8d6a8ce0bd Context-only references | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads Version: PMC archival version PMC11185576.2 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.split 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp. Context-only references | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads Version: PMC archival version PMC11185576.2 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.subset Species profiling on Dilthey2019 simulated long reads Context-only references | Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads Version: PMC archival version PMC11185576.2 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
Release 2026-09-17-d277315f7d76 · Record review: needs review
- Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Original source · PMC archival version PMC11185576.2
Technical metadata and extraction receipts
Stable ID: paper-evaluation-42cde439685749a74a
- areas
- microbes-communities
- tasks
- Long-read taxonomic profiling
- origin
- author_reported
- protocol
- Species-level recall/precision/F 1. MetaMaps results copied from original manuscript; other tool versions reported in Methods. 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp.
- version
- Paper-specific evaluated pipeline; exact checkpoint not inferred from label
- comparison
- protocol id: paper-protocol-1080592b8d6a8ce0bd; dataset version: Not reported; split: 200,114 reads;96 strain design,94 strains with RefSeq species representatives; average read 4,997 bp.; subset: Species profiling on Dilthey2019 simulated long reads; population: Not reported; aggregation: Not reported; inputs: Not reported; adaptation: Paper-specific evaluated pipeline; exact checkpoint not inferred from label; budget: Not reported; metric implementation: Not reported
- source locator
- Table 1:: Recall, Species profiling on Dilthey2019 simulated long reads
- missing metadata
- checkpoint revision: unextracted; budget: unreported; split manifest: unextracted
Related records
- model: Lemur
- benchmark: Species profiling on Dilthey2019 simulated long reads (Long-read taxonomic profiling)
- dataset: Species profiling on Dilthey2019 simulated long reads
- evaluation: Lemur: Precision on Species profiling on Dilthey2019 simulated long reads
- evaluation: Lemur: F1 score on Species profiling on Dilthey2019 simulated long reads
- evaluation: Lemur: Recall on Species profiling on Dilthey2019 simulated long reads