CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.
Published comparisons
Each figure keeps its source, protocol, dataset and metric together. Results from different protocols are shown separately, without a pooled ranking.
CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Accuracy (bp)
Accuracy (bp) (fraction) · Higher values are better for this metric.
Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.
Evaluation protocol · marmgCAMI2_short_read_pooled_gold_standard_assembly
- Gold standard · Method · Independent external evaluation1.0
- MetaBAT 2.13-33 (A1) · Configuration · Independent external evaluation0.3147446797498672
- MetaBAT 2.13-33 (A2) · Configuration · Independent external evaluation0.31753919023083904
- MetaBAT 0.25.4 (A3) · Configuration · Independent external evaluation0.2048804524394679
- MetaBinner 1.0 (B1) · Configuration · Independent external evaluation0.6440255341029176
- MetaBinner 1.0 (B2) · Configuration · Independent external evaluation0.6453560117758843
- MetaBinner 1.0 (B3) · Configuration · Independent external evaluation0.6582858839180927
- Autometa cami2-146383e (C1) · Configuration · Independent external evaluation0.4141031010253946
- Autometa cami2-146383e (C2) · Configuration · Independent external evaluation0.36076580658373963
- MetaWRAP 1.2.3 (D1) · Configuration · Independent external evaluation0.637175577887253
- UltraBinner 1.0 (E1) · Configuration · Independent external evaluation0.633980785512857
- MaxBin 2.2.7 (F1) · Configuration · Independent external evaluation0.5135878833925902
- MaxBin 2.0.2 (F2) · Configuration · Independent external evaluation0.5120367643474136
- CONCOCT 1.1.0 (G1) · Configuration · Independent external evaluation0.43228325985199567
- CONCOCT 0.4.1 (G2) · Configuration · Independent external evaluation0.42914829064808335
- Vamb fa045c0 (J1) · Configuration · Independent external evaluation0.6209479883720791
Source order is preserved. Plotted marks show point estimates; uncertainty, where reported, is retained in the printed values and table. Differences do not establish statistical significance.
CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 2; Tool=Gold standard; column Accuracy (bp) through line 17; Tool=Vamb fa045c0 (J1); column Accuracy (bp)Values, uncertainty and evidence
| Tested entity | Printed value | Uncertainty | Evidence |
|---|---|---|---|
| Gold standard · Method | 1.0 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 2; Tool=Gold standard; column Accuracy (bp) |
| MetaBAT 2.13-33 (A1) · Configuration | 0.3147446797498672 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 3; Tool=MetaBAT 2.13-33 (A1); column Accuracy (bp) |
| MetaBAT 2.13-33 (A2) · Configuration | 0.31753919023083904 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 4; Tool=MetaBAT 2.13-33 (A2); column Accuracy (bp) |
| MetaBAT 0.25.4 (A3) · Configuration | 0.2048804524394679 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 5; Tool=MetaBAT 0.25.4 (A3); column Accuracy (bp) |
| MetaBinner 1.0 (B1) · Configuration | 0.6440255341029176 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 6; Tool=MetaBinner 1.0 (B1); column Accuracy (bp) |
| MetaBinner 1.0 (B2) · Configuration | 0.6453560117758843 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 7; Tool=MetaBinner 1.0 (B2); column Accuracy (bp) |
| MetaBinner 1.0 (B3) · Configuration | 0.6582858839180927 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 8; Tool=MetaBinner 1.0 (B3); column Accuracy (bp) |
| Autometa cami2-146383e (C1) · Configuration | 0.4141031010253946 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 9; Tool=Autometa cami2-146383e (C1); column Accuracy (bp) |
| Autometa cami2-146383e (C2) · Configuration | 0.36076580658373963 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 10; Tool=Autometa cami2-146383e (C2); column Accuracy (bp) |
| MetaWRAP 1.2.3 (D1) · Configuration | 0.637175577887253 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Accuracy (bp) |
| UltraBinner 1.0 (E1) · Configuration | 0.633980785512857 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 12; Tool=UltraBinner 1.0 (E1); column Accuracy (bp) |
| MaxBin 2.2.7 (F1) · Configuration | 0.5135878833925902 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 13; Tool=MaxBin 2.2.7 (F1); column Accuracy (bp) |
| MaxBin 2.0.2 (F2) · Configuration | 0.5120367643474136 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 14; Tool=MaxBin 2.0.2 (F2); column Accuracy (bp) |
| CONCOCT 1.1.0 (G1) · Configuration | 0.43228325985199567 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 15; Tool=CONCOCT 1.1.0 (G1); column Accuracy (bp) |
| CONCOCT 0.4.1 (G2) · Configuration | 0.42914829064808335 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 16; Tool=CONCOCT 0.4.1 (G2); column Accuracy (bp) |
| Vamb fa045c0 (J1) · Configuration | 0.6209479883720791 fraction | Not reported | Independent external evaluation · source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 17; Tool=Vamb fa045c0 (J1); column Accuracy (bp) |
Scope and limitations
- Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.
- Exact source-defined evaluation scope; reported scores are not rewire reproductions.
- Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.
Source transcription and grouping reviewed by automated source review on 2026-09-19. These experiments were not independently reproduced by rewire.
Tested entities and results
Release 2026-09-19-eb6149e5d766 · 16 evaluations · 256 metric rows. Different protocols are not a single leaderboard. Charts retain each source table’s protocol and dataset.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| MetaBinner 1.0 (B1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Configuration: MetaBinner 1.0 (B1)Protocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 0.6084137138717145 Average completeness (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: kind: standard error; printed value: 0.014403632321349544; source column: Std error of av. completeness (bp) Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 6; Tool=MetaBinner 1.0 (B1); column Average completeness (bp) Source checking is not independent reproduction. |
| 0.3814401900138871 Adjusted Rand index (seq) Unit: dimensionless · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 6; Tool=MetaBinner 1.0 (B1); column Adjusted Rand index (seq) Source checking is not independent reproduction. |
| 0.12592109747084257 Completeness (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 6; Tool=MetaBinner 1.0 (B1); column Completeness (seq) Source checking is not independent reproduction. |
| MetaBAT 0.25.4 (A3) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Configuration: MetaBAT 0.25.4 (A3)Protocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 0.17746775777174825 Adjusted Rand index (seq) Unit: dimensionless · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 5; Tool=MetaBAT 0.25.4 (A3); column Adjusted Rand index (seq) Source checking is not independent reproduction. |
| 0.3447647193859873 Average completeness (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: kind: standard error; printed value: 0.014372468036824378; source column: Std error of av. completeness (bp) Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 5; Tool=MetaBAT 0.25.4 (A3); column Average completeness (bp) Source checking is not independent reproduction. |
| 0.3840074086351594 F1 score (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 5; Tool=MetaBAT 0.25.4 (A3); column F1 score (seq) Source checking is not independent reproduction. |
| UltraBinner 1.0 (E1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Configuration: UltraBinner 1.0 (E1)Protocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 0.8759479515881573 Adjusted Rand index (bp) Unit: dimensionless · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 12; Tool=UltraBinner 1.0 (E1); column Adjusted Rand index (bp) Source checking is not independent reproduction. |
| 0.7137610613949689 Percentage of binned bp Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 12; Tool=UltraBinner 1.0 (E1); column Percentage of binned bp Source checking is not independent reproduction. |
| MetaBAT 2.13-33 (A1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Configuration: MetaBAT 2.13-33 (A1)Protocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 0.4918997046053971 F1 score (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 3; Tool=MetaBAT 2.13-33 (A1); column F1 score (bp) Source checking is not independent reproduction. |
| Vamb fa045c0 (J1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Configuration: Vamb fa045c0 (J1)Protocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 0.5560185796381223 Average completeness (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: kind: standard error; printed value: 0.015359501805006384; source column: Std error of av. completeness (bp) Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 17; Tool=Vamb fa045c0 (J1); column Average completeness (bp) Source checking is not independent reproduction. |
| CONCOCT 0.4.1 (G2) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Configuration: CONCOCT 0.4.1 (G2)Protocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 0.8040914601240539 Percentage of binned bp Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 16; Tool=CONCOCT 0.4.1 (G2); column Percentage of binned bp Source checking is not independent reproduction. |
| 0.6889444038645799 Average purity (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: kind: standard error; printed value: 0.015617786994356736; source column: Std error of av. purity (bp) Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 16; Tool=CONCOCT 0.4.1 (G2); column Average purity (bp) Source checking is not independent reproduction. |
| MaxBin 2.2.7 (F1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Configuration: MaxBin 2.2.7 (F1)Protocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 0.4537356779424566 F1 score (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 13; Tool=MaxBin 2.2.7 (F1); column F1 score (seq) Source checking is not independent reproduction. |
| 0.48517741107501566 Average purity (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: kind: standard error; printed value: 0.015915380604604554; source column: Std error of av. purity (seq) Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 13; Tool=MaxBin 2.2.7 (F1); column Average purity (seq) Source checking is not independent reproduction. |
| MetaWRAP 1.2.3 (D1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Configuration: MetaWRAP 1.2.3 (D1)Protocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 0.7064894881186181 Purity (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Purity (bp) Source checking is not independent reproduction. |
| 0.9005102403934291 Percentage of binned bp Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 11; Tool=MetaWRAP 1.2.3 (D1); column Percentage of binned bp Source checking is not independent reproduction. |
| MaxBin 2.0.2 (F2) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Configuration: MaxBin 2.0.2 (F2)Protocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 0.5440503721270749 Completeness (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 14; Tool=MaxBin 2.0.2 (F2); column Completeness (bp) Source checking is not independent reproduction. |
| 0.5265929162851877 Purity (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 14; Tool=MaxBin 2.0.2 (F2); column Purity (seq) Source checking is not independent reproduction. |
| 0.450602519386329 F1 score (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 14; Tool=MaxBin 2.0.2 (F2); column F1 score (seq) Source checking is not independent reproduction. |
| Autometa cami2-146383e (C1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Configuration: Autometa cami2-146383e (C1)Protocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 0.4012010687441718 Average completeness (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: kind: standard error; printed value: 0.014033596091873091; source column: Std error of av. completeness (seq) Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 9; Tool=Autometa cami2-146383e (C1); column Average completeness (seq) Source checking is not independent reproduction. |
| MetaBinner 1.0 (B3) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Configuration: MetaBinner 1.0 (B3)Protocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 0.765598805134076 Adjusted Rand index (bp) Unit: dimensionless · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 8; Tool=MetaBinner 1.0 (B3); column Adjusted Rand index (bp) Source checking is not independent reproduction. |
| MetaBAT 2.13-33 (A2) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Configuration: MetaBAT 2.13-33 (A2)Protocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 0.4032256994374802 F1 score (seq) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 4; Tool=MetaBAT 2.13-33 (A2); column F1 score (seq) Source checking is not independent reproduction. |
| 0.31753919023083904 Accuracy (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 4; Tool=MetaBAT 2.13-33 (A2); column Accuracy (bp) Source checking is not independent reproduction. |
| 0.796619603563313 Purity (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 4; Tool=MetaBAT 2.13-33 (A2); column Purity (bp) Source checking is not independent reproduction. |
| Gold standard · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly Method: Gold standardProtocol: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assemblyDataset subset: marmgCAMI2_short_read_pooled_gold_standard_assembly CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded Independent external evaluation · Evaluation metadata: discovered | ||
| 1.0 Average completeness (bp) Unit: fraction · Direction: higher Aggregation: source aggregate over pooled assembly, not sample averaging | Uncertainty: kind: standard error; printed value: 0.0; source column: Std error of av. completeness (bp) Scored: Not reported · Eligible: Not reported | source checkedCAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · line 2; Tool=Gold standard; column Average completeness (bp) Source checking is not independent reproduction. |
Overview
Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.
Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.
Evaluation design
Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.
Benchmarks
These source-backed links do not make different protocols or scores interchangeable.
Recorded evaluations
Each evaluation records what was tested and under which conditions.
- MetaBinner 1.0 (B2) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- MaxBin 2.0.2 (F2) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- MetaWRAP 1.2.3 (D1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- Gold standard · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- MetaBinner 1.0 (B3) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- MetaBAT 0.25.4 (A3) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- MetaBAT 2.13-33 (A1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- CONCOCT 0.4.1 (G2) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- MaxBin 2.2.7 (F1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- UltraBinner 1.0 (E1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- Vamb fa045c0 (J1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- Autometa cami2-146383e (C1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
Run instructions
No runnable recipe has been reviewed for this protocol. Dataset access, model requirements, licences and compute requirements must be checked against its sources before execution.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
1 evidence row matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Relationship: part of discovery-benchmark-cami Individual claims | CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca line 2; Tool=Gold standard; column Accuracy (bp) Version: 501b543f65d62e5c1d6c3813be0badcac5e079ca | source checked ai assisted source review · 2026-09-19 Audit detailsField: Claim: acquired-membership-b72d30b9f2e8f2cb48ab Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
Sources and history
View linked audit checks and correction history
Release 2026-09-19-eb6149e5d766 · Record review: discovered
1 source records and release history
- CAMI: 501b543f65d62e5c1d6c3813be0badcac5e079ca · Original source · 501b543f65d62e5c1d6c3813be0badcac5e079ca
Technical metadata and extraction receipts
Stable ID: acquired-protocol-f443b5fdaee9129f2b7a
- source locator
- line 2; Tool=Gold standard; column Accuracy (bp)
- procedure
- CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded
- comparison panels
- id: acquired-figure-0f344fb35e8f48d62e2c; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Accuracy (bp); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Accuracy (bp); unit: fraction; direction: higher; result ids: acquired-result-5daa9501d8f08de0db2d; acquired-result-ddd0d1cf4f5e388ffb15; acquired-result-156a469deeb8a3abd31e; acquired-result-8797b60869558d20d4df; acquired-result-5617c8c8c585b9805105; acquired-result-69794fafe321888f3276; acquired-result-baed571f338cdcb4ae43; acquired-result-af8dc1fa04df18136d2b; acquired-result-a77f940292ea560f1a14; acquired-result-b387154f84a823220fbe; acquired-result-5e559dc700efff1749fd; acquired-result-d6ce1f07e9c91b2d0319; acquired-result-81903eb35963478c6444; acquired-result-3798083edce4316bd7de; acquired-result-2bdadb67285fc81452a3; acquired-result-eb61b93754c8f37ec874; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Accuracy (bp) through line 17; Tool=Vamb fa045c0 (J1); column Accuracy (bp); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-22d0344ab306bd0c87bd; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Accuracy (seq); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Accuracy (seq); unit: fraction; direction: higher; result ids: acquired-result-8c5cb9081ffb93cd7608; acquired-result-7c9bc32206b8b127af70; acquired-result-c0d6ac6b345175f2ce23; acquired-result-f0248860d41459c2c5fa; acquired-result-b4063a7201781bb0be44; acquired-result-66e3377dc8cc1a627463; acquired-result-33f8df86051a8af162b8; acquired-result-72b3dd23d353e9b4c00c; acquired-result-fdd7b7a080ab1f26fc34; acquired-result-b98290a8fa685938fcab; acquired-result-fa7d7e8c59ab7bc6c5a6; acquired-result-fb97119978969054e191; acquired-result-475d1a204b4ee2b75184; acquired-result-cfb0d78e24efafdeab4b; acquired-result-c4dcfe1a47dfa1fad3e6; acquired-result-2ad60b3d27a9cb75c521; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Accuracy (seq) through line 17; Tool=Vamb fa045c0 (J1); column Accuracy (seq); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-3f44eb1d191b27fbe9d0; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Adjusted Rand index (bp); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Adjusted Rand index (bp); unit: dimensionless; direction: higher; result ids: acquired-result-36056d130d9cd6631440; acquired-result-7a0e25c03402709c5c8e; acquired-result-404b2dd6c773f6522caf; acquired-result-8c1898a1814c114bcabf; acquired-result-1b76983dba27d05e0c8a; acquired-result-da15aab29a2d99557ffb; acquired-result-1328ec376a2970299b8a; acquired-result-f1c7f8ccdf9ae848f82d; acquired-result-9c317ab9a8386c357ad0; acquired-result-b4cb268f4d116a9c61bf; acquired-result-01bb4053ce292cceddab; acquired-result-8abe3c0023f52b14ea12; acquired-result-4500bd066fb7ae4e6653; acquired-result-566bdd78ef77504daf52; acquired-result-f53eb3f135367bf757ca; acquired-result-ae1532cacb0f95722deb; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Adjusted Rand index (bp) through line 17; Tool=Vamb fa045c0 (J1); column Adjusted Rand index (bp); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-fc41a9ea6556cc6754fa; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Adjusted Rand index (seq); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Adjusted Rand index (seq); unit: dimensionless; direction: higher; result ids: acquired-result-ff2bda874b3b789cf416; acquired-result-f29516c0abc34d5a76cc; acquired-result-200622a2a44f28a0b922; acquired-result-00f809040c5bc5bfac65; acquired-result-08dcdf1f9bd6e59fbfd3; acquired-result-87a8ea971b97bd703ff0; acquired-result-9a1ddb5802c151a9741f; acquired-result-c44dc90e0875f657d80f; acquired-result-2795c346046cf37e21f9; acquired-result-7e92e378313cf7211875; acquired-result-216ae8b9df80b6cc672c; acquired-result-6ce6b7a5faee2c574142; acquired-result-d63bf8969644d213d13d; acquired-result-3b3b0735f60f2b016994; acquired-result-34719fde93e69f87c7ba; acquired-result-b0d8773745ddbfb45172; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Adjusted Rand index (seq) through line 17; Tool=Vamb fa045c0 (J1); column Adjusted Rand index (seq); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-0f96245d3f7fbb94ad1c; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Average completeness (bp); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Average completeness (bp); unit: fraction; direction: higher; result ids: acquired-result-1a1a5bf00484ff52b506; acquired-result-2e7f78fa71f921409c0b; acquired-result-d2813767cf68490c2b18; acquired-result-075e26f528bbae35e41f; acquired-result-00387aaf19bd34d662f5; acquired-result-23079d87167e90662eba; acquired-result-419cbec8980ed7fbac8f; acquired-result-79ba4b83308896126423; acquired-result-fe79b5c7d072507449a7; acquired-result-2633b5baa2f013cc791a; acquired-result-68f5d332d0d443944f80; acquired-result-23c972811e114255d1b4; acquired-result-4db456a7dd13ad1e43ab; acquired-result-61b6873af28a4d36acdb; acquired-result-dffdff31030c5f14ea3b; acquired-result-050c771e52ee824b5cd9; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Average completeness (bp) through line 17; Tool=Vamb fa045c0 (J1); column Average completeness (bp); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-e54a995cc70811981a52; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Average completeness (seq); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Average completeness (seq); unit: fraction; direction: higher; result ids: acquired-result-9e7080de6eda74c86f81; acquired-result-ca4b8efedabc471bd708; acquired-result-96c129bfd32247ec3f30; acquired-result-9cdbe35c3943ad051e7c; acquired-result-3f12dbc0fd910fbfdddb; acquired-result-4a774e104193f7f02235; acquired-result-a19b7bfa8bf9ab901b9a; acquired-result-1044f34ee53fce8671e8; acquired-result-ae90f9a3f81ff7d30120; acquired-result-d07ffa3fa32b0556534f; acquired-result-fae256b9f4cd77281e7c; acquired-result-ffa527f49018a2c337be; acquired-result-8ee864efd5f8465a2521; acquired-result-9cf3ea4778f977be49cd; acquired-result-ee31542412b5c699f123; acquired-result-b046026182f84f00c7ec; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Average completeness (seq) through line 17; Tool=Vamb fa045c0 (J1); column Average completeness (seq); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-90099e538e7d28f1730a; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Average purity (bp); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Average purity (bp); unit: fraction; direction: higher; result ids: acquired-result-a9b63fc430a854749ad0; acquired-result-aaad21d449875f3a0fe3; acquired-result-1e3077fd9361b65f9404; acquired-result-5e67ead8568e0ed45e98; acquired-result-6141eca4fda56f555bf8; acquired-result-a1343c39074eb1b87ed9; acquired-result-d7ee2544479033684c2c; acquired-result-7d11cea96168a96fed1c; acquired-result-27295f9b57bd36fb0f20; acquired-result-2c491b12ad7c90f71f82; acquired-result-58ff6d661803ce2f8807; acquired-result-32a694ecdb3102dfeb94; acquired-result-ebd218754f0b13a8b70b; acquired-result-84a44f1355351fa7a6c3; acquired-result-168ef575b5f71785a10f; acquired-result-d6c5e7a611138f461d36; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Average purity (bp) through line 17; Tool=Vamb fa045c0 (J1); column Average purity (bp); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-358e72d88ae829801594; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Average purity (seq); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Average purity (seq); unit: fraction; direction: higher; result ids: acquired-result-2d228753b978ca2066ba; acquired-result-721e900892d4638aeac0; acquired-result-f5afdbad322d46659d3c; acquired-result-5e6be8de491c396c34d5; acquired-result-464da0183a1cae2ec4e5; acquired-result-b28a32bdd3dc9f58d752; acquired-result-a0066a4926ddb9189813; acquired-result-8625c2a7b9e402a5137a; acquired-result-ef978261223802494182; acquired-result-4b06c117dd3d4c9dde40; acquired-result-5ee5060e850725cd1519; acquired-result-0ab38414b2984a43e51f; acquired-result-f5dc2abca85d14c9f7a2; acquired-result-c3bbe2d03da6440555c9; acquired-result-4018957f66bfb7c3606c; acquired-result-50da59a2224c347cdf42; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Average purity (seq) through line 17; Tool=Vamb fa045c0 (J1); column Average purity (seq); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-a8a081d8f2a4db908447; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Completeness (bp); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Completeness (bp); unit: fraction; direction: higher; result ids: acquired-result-8b0eee9fdd120a98c35a; acquired-result-2958adceff9c9536b6e1; acquired-result-3bf2e18fc09dccc41a55; acquired-result-4c95a9e1a8bee7caf19c; acquired-result-84007e97d7f5839e16d7; acquired-result-bc076b39334a1490f0dc; acquired-result-be304b6ada34859e81c8; acquired-result-ecf8857821da20506a60; acquired-result-875baf74aee532e1dec9; acquired-result-4e2b92435ae3fee40c18; acquired-result-46adb6dbe91f20897bcf; acquired-result-dfea1c195e403e52b3c2; acquired-result-0c512395730178a2f231; acquired-result-af8ab4208c6ee0912d79; acquired-result-20577a46406a1abfc448; acquired-result-897d3d167508e3062e65; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Completeness (bp) through line 17; Tool=Vamb fa045c0 (J1); column Completeness (bp); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-847eed561a9e09b37639; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Completeness (seq); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Completeness (seq); unit: fraction; direction: higher; result ids: acquired-result-f41d4d536b89151301f2; acquired-result-b380311525f53a2777c5; acquired-result-59049ddcd83c068efd59; acquired-result-4824206548634aa65452; acquired-result-16258237b153d634f73a; acquired-result-eb37a285075fea83551a; acquired-result-b596e1473ebe191a0d09; acquired-result-20c66fd48766ef64e710; acquired-result-c27dc040f482e9b9fbb5; acquired-result-9fa0c23e9fb54d6efa92; acquired-result-86c4cd4682c9e9cc8be3; acquired-result-6258642bb1d7d14fe4a5; acquired-result-70736eb162a93a9a1302; acquired-result-63ec2f8870f2edd5fb1b; acquired-result-5db168a86f7cf9e81327; acquired-result-c8d46d59078f98497584; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Completeness (seq) through line 17; Tool=Vamb fa045c0 (J1); column Completeness (seq); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-7d99a4765dd62dcc7df6; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: F1 score (bp); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: F1 score (bp); unit: fraction; direction: higher; result ids: acquired-result-6fee6fd69ec6211bcae7; acquired-result-03bac26a9e5c15ab7c1f; acquired-result-ff1a1245a96fa182a4a4; acquired-result-4532aa03e84cbea1c41b; acquired-result-53d8dfba4ec3b3706ea1; acquired-result-8b942ac96879ad5825b8; acquired-result-a5c27b37c449fbd550f8; acquired-result-99081a66e792a8d4d4a8; acquired-result-3d9649434ed5d681470a; acquired-result-1be3a6924ecd0c2560b8; acquired-result-20ec75e582e0d75c26f0; acquired-result-7feec973b155e8aef8ae; acquired-result-8baa96a2704d1325bd9b; acquired-result-74011b130f0a23237dc4; acquired-result-7fc7f22f4789853f85a5; acquired-result-a30aa3645ee3835d2cf3; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column F1 score (bp) through line 17; Tool=Vamb fa045c0 (J1); column F1 score (bp); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-8842f10d09ff776f7b2b; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: F1 score (seq); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: F1 score (seq); unit: fraction; direction: higher; result ids: acquired-result-737889abffd25a38179e; acquired-result-6ce55896619d3b47bf40; acquired-result-14dce89c88b2db15adf2; acquired-result-11f449ebe33e045759c4; acquired-result-6bd87f2805e7aaf3636e; acquired-result-f7ac4a4602754f945b10; acquired-result-a93ab9e49e41d5148c8e; acquired-result-1fa46707fd9bbe1000f5; acquired-result-3e1499e307dffbd80073; acquired-result-34c6d8715ed2449f32d8; acquired-result-648ce0d4dc4136314eb8; acquired-result-07a211aab595f82af5a3; acquired-result-0eec898e9358833fcb2c; acquired-result-421a02e85368cbc65b9e; acquired-result-4f7aced6ff205aeb3f94; acquired-result-5c5836f0cd01540826f1; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column F1 score (seq) through line 17; Tool=Vamb fa045c0 (J1); column F1 score (seq); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-2e9a50449c62668fb520; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Purity (bp); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Purity (bp); unit: fraction; direction: higher; result ids: acquired-result-94a9aa46f28b58e589e8; acquired-result-9d471a39a9508363d2b4; acquired-result-1b47683de6f006dab256; acquired-result-7cda84c0333baa15765b; acquired-result-a323ee4fee5830a1f5ea; acquired-result-ac5f753e199d4237a131; acquired-result-dc4f7fe5efe4d4938ad6; acquired-result-4925b4d225ea7f86280a; acquired-result-b8827050da429ecf9eeb; acquired-result-08965b4244e95a552687; acquired-result-5ae4ca4e8f168f8a0375; acquired-result-a6221db9c66eb986f3d8; acquired-result-ebb50ca396dd649d9675; acquired-result-6bb110fd7c168d9b1894; acquired-result-3c75fb08e47c35d4aa06; acquired-result-4e7727aa76f565344b07; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Purity (bp) through line 17; Tool=Vamb fa045c0 (J1); column Purity (bp); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-5d5051e0da1def0f8d24; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Purity (seq); protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Purity (seq); unit: fraction; direction: higher; result ids: acquired-result-f3666a2634b7117757c5; acquired-result-551be7422d49481c71a9; acquired-result-1d77b698796eea320f8a; acquired-result-d9682f2d6319bf95e2a4; acquired-result-6cad0e74d48e4973cb41; acquired-result-d4ab464360195e4df806; acquired-result-dc4f699bdadbd803a3e0; acquired-result-91422249d258efbc0645; acquired-result-5705ce49de4cab09fccb; acquired-result-80beacb768e567fb0c15; acquired-result-cd43dee64544ad6a4f55; acquired-result-a24ca1184d6ee3cc7d74; acquired-result-0d53a111f5225827eee6; acquired-result-2212a44c304405278670; acquired-result-f4520b8c9d8d6f6d8ce0; acquired-result-37e891fbbac3637cdb70; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Purity (seq) through line 17; Tool=Vamb fa045c0 (J1); column Purity (seq); context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-f4a4face3bce065dc318; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Percentage of binned bp; protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Percentage of binned bp; unit: fraction; direction: higher; result ids: acquired-result-ca25441f268c49cab921; acquired-result-458dab9c59678fd927d8; acquired-result-a4f73c36087d0354094c; acquired-result-402e97e324f0537ecf84; acquired-result-9d2af629a88bc94826bc; acquired-result-c515d02f0952193f6111; acquired-result-b27adc1887dd4b62835f; acquired-result-e1dead54d48859f02904; acquired-result-648811c41a0b2585b5da; acquired-result-17865a0f750dcdbde72f; acquired-result-04288c8378266d6ace66; acquired-result-588098f72468e47abb7d; acquired-result-49ce35a5bc67ca8af877; acquired-result-a624356321962b6c31d0; acquired-result-06ef00335d9733159335; acquired-result-aca1b6da78ac9095dbbf; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Percentage of binned bp through line 17; Tool=Vamb fa045c0 (J1); column Percentage of binned bp; context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19; id: acquired-figure-2a7374c2b7137bc06dd8; title: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly: Percentage of binned sequences; protocol id: acquired-protocol-f443b5fdaee9129f2b7a; dataset id: acquired-dataset-b3002a2c940171eead1a; metric: Percentage of binned sequences; unit: fraction; direction: higher; result ids: acquired-result-29aad20f9f9e632cb84f; acquired-result-fec4c66b969239049dae; acquired-result-7be592bafaf24cb2d7ae; acquired-result-d22e7b0912b777ee3210; acquired-result-58be1106d4f4ed3ef02a; acquired-result-cb7915c45557c3baacd9; acquired-result-b66fca01aa11885af057; acquired-result-f616e1fd5d45af758f90; acquired-result-45755cae2bc55c40d586; acquired-result-90259a69d3f05b689347; acquired-result-4311d16781c381a706db; acquired-result-1ce45335d553473a1fa4; acquired-result-2ae697a96f805ee67b60; acquired-result-385419ef9990808fd38c; acquired-result-db103627c7f2a3dfe356; acquired-result-65ccd43e9b4e46bd8377; source ids: acquired-source-f64302952624afe35a58; source locator: line 2; Tool=Gold standard; column Percentage of binned sequences through line 17; Tool=Vamb fa045c0 (J1); column Percentage of binned sequences; context: Complete selected source table is retained across source-order panels. These point estimates do not establish statistical significance or a universal ranking.; caveats: Source-specific evaluation. No equivalence to other releases, protocols or model families is inferred.; Exact source-defined evaluation scope; reported scores are not rewire reproductions.; Missing source cells and quarantined conflicts are recorded in acquisition and audit tables. Per-result scoring denominators may be unreported.; review: method: automated_source_review; date: 2026-09-19
- scope limitations
- Exact source-defined evaluation scope; reported scores are not rewire reproductions.
Related records
- part of: CAMI
- benchmark: MetaBinner 1.0 (B2) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: MaxBin 2.0.2 (F2) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: MetaWRAP 1.2.3 (D1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: Gold standard · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: MetaBinner 1.0 (B3) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: MetaBAT 0.25.4 (A3) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: MetaBAT 2.13-33 (A1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: CONCOCT 0.4.1 (G2) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: MaxBin 2.2.7 (F1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: UltraBinner 1.0 (E1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: Vamb fa045c0 (J1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: Autometa cami2-146383e (C1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: CONCOCT 1.1.0 (G1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: Autometa cami2-146383e (C2) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: MetaBAT 2.13-33 (A2) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- benchmark: MetaBinner 1.0 (B1) · CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded · marmgCAMI2_short_read_pooled_gold_standard_assembly
- subject: CAMI II marine genome binning; pooled short-read gold-standard assembly; circular elements excluded: benchmark membership