evaluation · needs review

Geneformer: Cell-type annotation

Evaluation procedure

Zero-shot setting; source caption says some comparator rows come from GenePT.

Metadata review: needs review. Unreported conditions prevent automatic comparisons.

Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.

Evaluated configurationMetricEvidence origin

Results grouped by the exact reported evaluation
Metric and finding	Coverage and uncertainty	Evidence
Geneformer: Cell-type annotation Model: Geneformer · Benchmark: Cell-type annotation · Dataset: hPancreas Zero-shot setting; source caption says some comparator rows come from GenePT. Result quoted from another source · Evaluation metadata: needs review
0.270 F1 Unit: unitless · Direction: unknown	Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported	source checkedscELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis · Table 1, hPancreas zero-shot / Geneformer (z) row, F1 column Source checking is not independent reproduction.

Release 2026-09-16-d74d282221a9 · Record review: needs review

Technical metadata and extraction receipts

Stable ID: evaluation-lit-030

areas: cells-tissues
tasks: Cell-type annotation
origin: paper_compilation
protocol: Zero-shot setting; source caption says some comparator rows come from GenePT.
version: Not reported
comparison: protocol id: Not reported; dataset version: Not reported; split: Not reported; population: Not reported; inputs: Not reported; adaptation: Not reported; metric implementation: Not reported; aggregation: Not reported; budget: Not reported
missing metadata: model version: not_reported_in_legacy_extract; dataset version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract; original evaluation: not_reported_in_legacy_extract

Related records