result · source checked
0.376 F1
Lemur · F1 · Zymo LOG 10%
- Tested model
- Lemur
- Task or benchmark
- Long-read taxonomic profiling
- Dataset
- Zymo LOG 10%
- Procedure
- Mean across five replicate runs on Zymo LOG 10%.
- Evaluation
- Lemur: Long-read taxonomic profiling
- Evidence
- Author-reported evaluation · source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 3, LOG 10% / Lemur row, F1 column
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.
Evaluation results
Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| Lemur: Long-read taxonomic profiling Mean across five replicate runs on Zymo LOG 10%. Author-reported evaluation · Evaluation metadata: needs review | ||
| 0.376 F1 Unit: unitless · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedLightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Table 3, LOG 10% / Lemur row, F1 column Source checking is not independent reproduction. |
Sources and history
Release 2026-09-16-d74d282221a9 · Record review: source checked
- Lightweight taxonomic profiling of long-read metagenomic datasets with Lemur and Magnet · Original source · PMC archival version PMC11185576.2
Technical metadata and extraction receipts
Stable ID: lit-b3-031
- areas
- microbes-communities
- tasks
- Long-read taxonomic profiling
- printed value
- 0.376
- numeric value
- 0.376
- metric
- F1
- metric direction
- unknown
- unit
- unitless
- uncertainty
- Not reported
- source locator
- Table 3, LOG 10% / Lemur row, F1 column
- review
- method: independent_ai_table_review; reviewer: Codex omics research agent; independent source-table review, not human review; reviewed at: 2026-09-16T10:44:03.420493+00:00; notes: LOG 10% first block, F1 column. Kraken 2 row inherits dataset via rowspan; not LOG 75% or abundance Spearman. Source check verifies central value and table context, not experiment reproduction or all metadata.; evidence: {"table_xml_id": "T3", "row_cells": ["LOG 10%", "Lemur", "0.500", "0.301", "0.376", "0.984"], "selected_cell_zero_based": 4, "selected_cell_xml": "<td align=\"right\" valign=\"top\" rowspan=\"1\" colspan=\"1\">0.376</td>", "caption": "Mean performance and standard deviation across 5 replicate runs of all methods on Zymo LOG, bold values show best performance. Magnet does not report relative abundance, so the Spearman’s ρ cannot be computed. Tools listed below the horizontal dashed lines (for LOG 10% and LOG 75%) focus on the taxonomic classification of reads."}; artifact sha256: 4afb9195da447916eb6f733816e3640741c7ade08ea8920d205c3be7b3cce27a; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC11185576/fullTextXML
- legacy id
- lit-b3-031
- legacy row
- id: lit-b3-031; paper id: lemur-magnet-2024; domain id: microbes-communities; task: Long-read taxonomic profiling; model: Lemur; model version: Not reported; dataset: Zymo LOG 10%; dataset version: Not reported; split: Not reported; metric: F1; value: 0.376; unit: unitless; uncertainty: Not reported; protocol: Mean across five replicate runs on Zymo LOG 10%.; source locator: Table 3, LOG 10% / Lemur row, F1 column; source url: https://pmc.ncbi.nlm.nih.gov/articles/PMC11185576/; evaluation origin: author_reported; reviewed utc: 2026-09-15T23:29:32Z
- missing metadata
- model version: not_reported_in_legacy_extract; dataset version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract; uncertainty: not_reported_in_legacy_extract
Related records
- evaluation: Lemur: Long-read taxonomic profiling
- subject: Reported F1 for Lemur