rewire.it
benchmark · suite

GUE

GUE tests genome understanding across multiple datasets, tasks and species.

0 evaluations · 0 metric rows

At a glance

Explanatory profile: source reviewed · Automated source review, 2026-09-16. This does not change the review status of its results.

Data, procedure and scoring
PropertyDescription and evidence
Record typeTask suiteMAGICS-LAB/DNABERT_2 official source · README: 2.1 GUE: Genome Understanding Evaluation; 6.1 Evaluate models on GUE
InputsGenomic sequences and dataset-specific labelsMAGICS-LAB/DNABERT_2 official source · README: 2.1 GUE: Genome Understanding Evaluation; 6.1 Evaluate models on GUE
Outputs and assessmentGenome task classification resultsMAGICS-LAB/DNABERT_2 official source · README: 2.1 GUE: Genome Understanding Evaluation; 6.1 Evaluate models on GUE
DatasetsNot extracted or verified for this record.
OrganismsNot extracted or verified for this record.
AssaysNot extracted or verified for this record.
SplitsNot extracted or verified for this record.
AdaptationNot extracted or verified for this record.
BaselinesNot extracted or verified for this record.

How it works

Procedure overview

Conceptual overview of the cited procedure; consult the pinned source for executable settings.

Procedure overviewChoose GUE dataset. Then: Run model-specific fine-tuning. Then: Select checkpoint. Then: Evaluate held-out dataChoose GUE datasetRun model-specific fine-tuningSelect checkpointEvaluate held-out data
Read the diagram as text
  1. Choose GUE dataset
  2. Run model-specific fine-tuning
  3. Select checkpoint
  4. Evaluate held-out data
MAGICS-LAB/DNABERT_2 official source · README: 2.1 GUE: Genome Understanding Evaluation; 6.1 Evaluate models on GUE

Procedure

Use the released GUE data and model-specific evaluation scripts. Record the particular dataset, fine-tuning setup and selected checkpoint for each comparison.

MAGICS-LAB/DNABERT_2 official source · README: 2.1 GUE: Genome Understanding Evaluation; 6.1 Evaluate models on GUE

Tested models and results

Release 2026-09-16-d74d282221a9 · 0 evaluations · 0 metric rows. Different protocols are not a single leaderboard.

No evaluations linked in this release.

Strengths and limitations

Strengths supported by sources

Limitations and conditions

  • The suite-level name does not establish that all model runs used identical checkpoint selection or adaptation.MAGICS-LAB/DNABERT_2 official source · README: 2.1 GUE: Genome Understanding Evaluation; 6.1 Evaluate models on GUE
Profile review details

Primary-source description checked by an automated research assistant. This is a profile review, not an independent execution or numerical reproduction.

Stable record: discovery-benchmark-gue

Applicable tests and references

Applicability is distinct from a completed evaluation.

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: discovered

Download this release
Technical metadata and extraction receipts

Stable ID: discovery-benchmark-gue

areas
genomics
entity level
suite
missing metadata
dataset release: unextracted; metric implementation: unextracted; split manifest: unextracted; version: unextracted
scope note
Specialist molecular or omics evaluation; protocol details require review before numerical comparison.
task
Multi-species genome understanding tasks
version
Not reported
Related records

Suggest a correction