Evaluation

Nucleotide Transformers V2: Natural versus GenomeOcean-generated DNA classification

DNABERT 2 and NTv 2 standard fine-tuning; GenomeOcean LoRA. Negatives generated by GenomeOcean itself. CAMI 2 train 18,000/validation 2,000; GTDB test 20,000; balanced natural/artificial 2 kb sequences.

Evaluation procedure

Configuration: Nucleotide Transformers V2
Protocol: Natural versus GenomeOcean-generated DNA classification (Natural vs artificial microbial genome sequence)
Dataset: GenomeOcean natural/artificial sequence test

origin: Author-reported evaluation
configuration: Paper-specific evaluated pipeline; exact checkpoint not inferred from label
protocol id: paper-protocol-a8c67b393443253db5
dataset version: Not reported
split: CAMI 2 train 18,000/validation 2,000; GTDB test 20,000; balanced natural/artificial 2 kb sequences.
subset: Natural versus GenomeOcean-generated DNA classification
population: Not reported
aggregation: Not reported
inputs: Not reported
adaptation: Paper-specific evaluated pipeline; exact checkpoint not inferred from label
budget: Not reported
metric implementation: Not reported

Metadata review: needs review. Unreported conditions prevent automatic comparisons.

Evaluation results

Release 2026-09-17-d277315f7d76 · 1 evaluation · 3 metric rows. Different protocols are not a single leaderboard.

Evaluation setupMetricEvidence origin

Results grouped by the exact reported evaluation
Metric and finding	Coverage and uncertainty	Evidence
Nucleotide Transformers V2: Natural versus GenomeOcean-generated DNA classification Configuration: Nucleotide Transformers V2Protocol: Natural versus GenomeOcean-generated DNA classification (Natural vs artificial microbial genome sequence)Dataset: GenomeOcean natural/artificial sequence test DNABERT 2 and NTv 2 standard fine-tuning; GenomeOcean LoRA. Negatives generated by GenomeOcean itself. CAMI 2 train 18,000/validation 2,000; GTDB test 20,000; balanced natural/artificial 2 kb sequences. Author-reported evaluation · Evaluation metadata: needs review
83.14 F1 Unit: % · Direction: higher	Uncertainty: unreported Scored: Not reported · Eligible: Not reported	source checkedGenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies · Table 2:, row Nucleotide Transformers V2, column F1; XML row3 column4 Source checking is not independent reproduction.
82.97% Recall Unit: percent · Direction: higher	Uncertainty: unreported Scored: Not reported · Eligible: Not reported	source checkedGenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies · Table 2:, row Nucleotide Transformers V2, column Recall; XML row3 column3 Source checking is not independent reproduction.
83.31% Precision Unit: percent · Direction: higher	Uncertainty: unreported Scored: Not reported · Eligible: Not reported	source checkedGenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies · Table 2:, row Nucleotide Transformers V2, column Precision; XML row3 column2 Source checking is not independent reproduction.

Evidence table

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

19 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-09-17-d277315f7d76
Property and statement	Original source and location	Review and provenance
attributes.comparison.adaptation Paper-specific evaluated pipeline; exact checkpoint not inferred from label Context-only references	GenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies Original source ↗ Table 2:: Precision, Natural versus GenomeOcean-generated DNA classification Version: preprint archived 2025-02-05 Retrieved: 2026-09-17T07:56:18.823068+00:00	not individually reviewed No individual claim review recorded author reported Audit details Field: `attributes.comparison.adaptation` Source artifact SHA-256: `3cc0df52522fccda23e3958f069c916b87ee50bb5c9a992fa37e25256546e145` Hash scope: Exact retrieved primary paper artifact bytes. Inspected artifact
attributes.comparison.aggregation No value recorded Context-only references	GenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies Original source ↗ Table 2:: Precision, Natural versus GenomeOcean-generated DNA classification Version: preprint archived 2025-02-05 Retrieved: 2026-09-17T07:56:18.823068+00:00	missing or unspecified No individual claim review recorded author reported Audit details Field: `attributes.comparison.aggregation` Source artifact SHA-256: `3cc0df52522fccda23e3958f069c916b87ee50bb5c9a992fa37e25256546e145` Hash scope: Exact retrieved primary paper artifact bytes. Inspected artifact
attributes.comparison.budget No value recorded Context-only references	GenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies Original source ↗ Table 2:: Precision, Natural versus GenomeOcean-generated DNA classification Version: preprint archived 2025-02-05 Retrieved: 2026-09-17T07:56:18.823068+00:00	missing or unspecified No individual claim review recorded author reported Audit details Field: `attributes.comparison.budget` Source artifact SHA-256: `3cc0df52522fccda23e3958f069c916b87ee50bb5c9a992fa37e25256546e145` Hash scope: Exact retrieved primary paper artifact bytes. Inspected artifact
attributes.comparison.dataset_version No value recorded Context-only references	GenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies Original source ↗ Table 2:: Precision, Natural versus GenomeOcean-generated DNA classification Version: preprint archived 2025-02-05 Retrieved: 2026-09-17T07:56:18.823068+00:00	missing or unspecified No individual claim review recorded author reported Audit details Field: `attributes.comparison.dataset_version` Source artifact SHA-256: `3cc0df52522fccda23e3958f069c916b87ee50bb5c9a992fa37e25256546e145` Hash scope: Exact retrieved primary paper artifact bytes. Inspected artifact
attributes.comparison.inputs No value recorded Context-only references	GenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies Original source ↗ Table 2:: Precision, Natural versus GenomeOcean-generated DNA classification Version: preprint archived 2025-02-05 Retrieved: 2026-09-17T07:56:18.823068+00:00	missing or unspecified No individual claim review recorded author reported Audit details Field: `attributes.comparison.inputs` Source artifact SHA-256: `3cc0df52522fccda23e3958f069c916b87ee50bb5c9a992fa37e25256546e145` Hash scope: Exact retrieved primary paper artifact bytes. Inspected artifact
attributes.comparison.metric_implementation No value recorded Context-only references	GenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies Original source ↗ Table 2:: Precision, Natural versus GenomeOcean-generated DNA classification Version: preprint archived 2025-02-05 Retrieved: 2026-09-17T07:56:18.823068+00:00	missing or unspecified No individual claim review recorded author reported Audit details Field: `attributes.comparison.metric_implementation` Source artifact SHA-256: `3cc0df52522fccda23e3958f069c916b87ee50bb5c9a992fa37e25256546e145` Hash scope: Exact retrieved primary paper artifact bytes. Inspected artifact
attributes.comparison.population No value recorded Context-only references	GenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies Original source ↗ Table 2:: Precision, Natural versus GenomeOcean-generated DNA classification Version: preprint archived 2025-02-05 Retrieved: 2026-09-17T07:56:18.823068+00:00	missing or unspecified No individual claim review recorded author reported Audit details Field: `attributes.comparison.population` Source artifact SHA-256: `3cc0df52522fccda23e3958f069c916b87ee50bb5c9a992fa37e25256546e145` Hash scope: Exact retrieved primary paper artifact bytes. Inspected artifact
attributes.comparison.protocol_id paper-protocol-a8c67b393443253db5 Context-only references	GenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies Original source ↗ Table 2:: Precision, Natural versus GenomeOcean-generated DNA classification Version: preprint archived 2025-02-05 Retrieved: 2026-09-17T07:56:18.823068+00:00	not individually reviewed No individual claim review recorded author reported Audit details Field: `attributes.comparison.protocol_id` Source artifact SHA-256: `3cc0df52522fccda23e3958f069c916b87ee50bb5c9a992fa37e25256546e145` Hash scope: Exact retrieved primary paper artifact bytes. Inspected artifact
attributes.comparison.split CAMI 2 train 18,000/validation 2,000; GTDB test 20,000; balanced natural/artificial 2 kb sequences. Context-only references	GenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies Original source ↗ Table 2:: Precision, Natural versus GenomeOcean-generated DNA classification Version: preprint archived 2025-02-05 Retrieved: 2026-09-17T07:56:18.823068+00:00	not individually reviewed No individual claim review recorded author reported Audit details Field: `attributes.comparison.split` Source artifact SHA-256: `3cc0df52522fccda23e3958f069c916b87ee50bb5c9a992fa37e25256546e145` Hash scope: Exact retrieved primary paper artifact bytes. Inspected artifact
attributes.comparison.subset Natural versus GenomeOcean-generated DNA classification Context-only references	GenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies Original source ↗ Table 2:: Precision, Natural versus GenomeOcean-generated DNA classification Version: preprint archived 2025-02-05 Retrieved: 2026-09-17T07:56:18.823068+00:00	not individually reviewed No individual claim review recorded author reported Audit details Field: `attributes.comparison.subset` Source artifact SHA-256: `3cc0df52522fccda23e3958f069c916b87ee50bb5c9a992fa37e25256546e145` Hash scope: Exact retrieved primary paper artifact bytes. Inspected artifact

All evidence (CSV)All evidence (JSONL)How to read the evidence

Sources and history

Release 2026-09-17-d277315f7d76 · Record review: needs review

GenomeOcean: An Efficient Genome Foundation Model Trained on Large-Scale Metagenomic Assemblies · Original source · preprint archived 2025-02-05

Download this release

Technical metadata and extraction receipts

Stable ID: paper-evaluation-4120142bd750b31e8c

areas: microbes-communities
tasks: Natural vs artificial microbial genome sequence
origin: author_reported
protocol: DNABERT 2 and NTv 2 standard fine-tuning; GenomeOcean LoRA. Negatives generated by GenomeOcean itself. CAMI 2 train 18,000/validation 2,000; GTDB test 20,000; balanced natural/artificial 2 kb sequences.
version: Paper-specific evaluated pipeline; exact checkpoint not inferred from label
comparison: protocol id: paper-protocol-a8c67b393443253db5; dataset version: Not reported; split: CAMI 2 train 18,000/validation 2,000; GTDB test 20,000; balanced natural/artificial 2 kb sequences.; subset: Natural versus GenomeOcean-generated DNA classification; population: Not reported; aggregation: Not reported; inputs: Not reported; adaptation: Paper-specific evaluated pipeline; exact checkpoint not inferred from label; budget: Not reported; metric implementation: Not reported
source locator: Table 2:: Precision, Natural versus GenomeOcean-generated DNA classification
missing metadata: checkpoint revision: unextracted; budget: unreported; split manifest: unextracted

Related records

Suggest a correction