MetaWRAP 1.2.3 (D1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded; marmgCAMI2_short_read_pooled_gold_standard_assembly. Source checked, not independently reproduced.
Evaluation results
Release 2026-09-19-eb6149e5d766 · 1 evaluation · 16 metric rows. Different protocols are not a single leaderboard. Charts retain each source table’s protocol and dataset.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| MetaWRAP 1.2.3 (D1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Configuration: MetaWRAP 1.2.3 (D1)Protocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 0.7064894881186181 Purity (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Purity (bp) Source checking is not independent reproduction. |
| 0.9005102403934291 Percentage of binned bp Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Percentage of binned bp Source checking is not independent reproduction. |
| 0.7396913422814557 F1 score (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column F1 score (bp) Source checking is not independent reproduction. |
| 0.7069990725368035 Average completeness (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: kind: standard error; printed value: 0.010700358239018912; source column: Std error of av. completeness (bp) Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Average completeness (bp) Source checking is not independent reproduction. |
| 0.7755536364026424 Average purity (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: kind: standard error; printed value: 0.01179015364215489; source column: Std error of av. purity (bp) Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Average purity (bp) Source checking is not independent reproduction. |
| 0.6250487466653721 F1 score (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column F1 score (seq) Source checking is not independent reproduction. |
| 0.7296452772750053 Average purity (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: kind: standard error; printed value: 0.012812205062330807; source column: Std error of av. purity (seq) Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Average purity (seq) Source checking is not independent reproduction. |
| 0.7557652049337784 Completeness (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Completeness (bp) Source checking is not independent reproduction. |
| 0.2758805929338007 Adjusted Rand index (seq) Unit: dimensionless · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Adjusted Rand index (seq) Source checking is not independent reproduction. |
| 0.4925135524405734 Purity (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Purity (seq) Source checking is not independent reproduction. |
| 0.4461431220604364 Percentage of binned sequences Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Percentage of binned sequences Source checking is not independent reproduction. |
| 0.2628836681159759 Completeness (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Completeness (seq) Source checking is not independent reproduction. |
| 0.637175577887253 Accuracy (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (bp) Source checking is not independent reproduction. |
| 0.5020910437200843 Adjusted Rand index (bp) Unit: dimensionless · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Adjusted Rand index (bp) Source checking is not independent reproduction. |
| 0.21965539021023942 Accuracy (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (seq) Source checking is not independent reproduction. |
| 0.5466806647193542 Average completeness (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: kind: standard error; printed value: 0.01142969058312827; source column: Std error of av. completeness (seq) Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Average completeness (seq) Source checking is not independent reproduction. |
Methods and reproduction
CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded; marmgCAMI2_short_read_pooled_gold_standard_assembly. Source checked, not independently reproduced.
- configuration
- MetaWRAP 1.2.3 (D1)
- protocol
- CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- dataset subset
- marmgCAMI2_short_read_pooled_gold_standard_assembly
- Split
- marmgCAMI2_short_read_pooled_gold_standard_assembly
- Adaptation
- unreported
- Scoring implementation
- Not reported
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evaluation procedure
CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded
- Configuration
- MetaWRAP 1.2.3 (D1)
- Protocol
- CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- Dataset subset
- marmgCAMI2_short_read_pooled_gold_standard_assembly
- origin
- Independent external evaluation
- configuration
- Not reported
- protocol id
- acquired-protocol-f443b5fdaee9129f2b7a
- dataset version
- 501b543f65d62e5c1d6c3813be0badcac5e079ca
- split
- marmgCAMI2_short_read_pooled_gold_standard_assembly
- population
- marmgCAMI2_short_read_pooled_gold_standard_assembly
- inputs
- unreported
- adaptation
- unreported
- aggregation
- metric-specific; inspect each result
Metadata review: discovered. Unreported conditions prevent automatic comparisons.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
22 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.comparison.adaptation unreported Context-only references | CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (bp) Version: 501b543f65d62e5c1d6c3813be0badcac5e079ca | missing or unspecified No individual claim review recorded independent paper Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.comparison.aggregation metric-specific; inspect each result Context-only references | CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (bp) Version: 501b543f65d62e5c1d6c3813be0badcac5e079ca | not individually reviewed No individual claim review recorded independent paper Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.comparison.dataset_version 501b543f65d62e5c1d6c3813be0badcac5e079ca Context-only references | CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (bp) Version: 501b543f65d62e5c1d6c3813be0badcac5e079ca | not individually reviewed No individual claim review recorded independent paper Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.comparison.inputs unreported Context-only references | CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (bp) Version: 501b543f65d62e5c1d6c3813be0badcac5e079ca | missing or unspecified No individual claim review recorded independent paper Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.comparison.population marmgCAMI2_short_read_pooled_gold_standard_assembly Context-only references | CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (bp) Version: 501b543f65d62e5c1d6c3813be0badcac5e079ca | not individually reviewed No individual claim review recorded independent paper Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.comparison.protocol_id acquired-protocol-f443b5fdaee9129f2b7a Context-only references | CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (bp) Version: 501b543f65d62e5c1d6c3813be0badcac5e079ca | not individually reviewed No individual claim review recorded independent paper Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.comparison.split marmgCAMI2_short_read_pooled_gold_standard_assembly Context-only references | CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (bp) Version: 501b543f65d62e5c1d6c3813be0badcac5e079ca | not individually reviewed No individual claim review recorded independent paper Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.conditions.binning_type genome Context-only references | CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (bp) Version: 501b543f65d62e5c1d6c3813be0badcac5e079ca | not individually reviewed No individual claim review recorded independent paper Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.conditions.circular_elements excluded by -k circular element Context-only references | CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (bp) Version: 501b543f65d62e5c1d6c3813be0badcac5e079ca | not individually reviewed No individual claim review recorded independent paper Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.conditions.edition CAMI II Context-only references | CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (bp) Version: 501b543f65d62e5c1d6c3813be0badcac5e079ca | not individually reviewed No individual claim review recorded independent paper Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
Sources and history
View linked audit checks and correction history
Release 2026-09-19-eb6149e5d766 · Record review: discovered
1 source records and release history
- CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · Original source · 501b543f65d62e5c1d6c3813be0badcac5e079ca
Technical metadata and extraction receipts
Stable ID: acquired-evaluation-46e720228fc1b71ac46f
- origin
- independent_paper
- protocol
- CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded
- source locator
- line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (bp)
- conditions
- edition: CAMI II; evaluator: AMBER; binning type: genome; rank: NA; circular elements: excluded by -k circular element; input: pooled short-read gold-standard assembly; gold standard reference: false
- comparison
- protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset version: 501b543f65d62e5c1d6c3813be0badcac5e079ca; split: marmgCAMI2_short_read_pooled_gold_standard_assembly; population: marmgCAMI2_short_read_pooled_gold_standard_assembly; inputs: unreported; adaptation: unreported; aggregation: metric-specific; inspect each result
- missing metadata
- checkpoint revision: unreported; scored count: unreported
Related records
- model: MetaWRAP 1.2.3 (D1)
- benchmark: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- dataset: marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Purity (bp) · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Percentage of binned bp · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · F1 score (bp) · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Average completeness (bp) · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Average purity (bp) · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · F1 score (seq) · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Average purity (seq) · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Completeness (bp) · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Adjusted Rand index (seq) · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Purity (seq) · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Percentage of binned sequences · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Completeness (seq) · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Accuracy (bp) · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Adjusted Rand index (bp) · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Accuracy (seq) · marmgCAMI2_short_read_pooled_gold_standard_assembly
- evaluation: MetaWRAP 1.2.3 (D1) · Average completeness (seq) · marmgCAMI2_short_read_pooled_gold_standard_assembly