result · source checked
0.270 F1
Geneformer · F1 · hPancreas
- Tested model
- Geneformer
- Task or benchmark
- Cell-type annotation
- Dataset
- hPancreas
- Procedure
- Zero-shot setting; source caption says some comparator rows come from GenePT.
- Evaluation
- Geneformer: Cell-type annotation
- Evidence
- Result quoted from another source · source checkedscELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis · Table 1, hPancreas zero-shot / Geneformer (z) row, F1 column
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.
Evaluation results
Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| Geneformer: Cell-type annotation Zero-shot setting; source caption says some comparator rows come from GenePT. Result quoted from another source · Evaluation metadata: needs review | ||
| 0.270 F1 Unit: unitless · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedscELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis · Table 1, hPancreas zero-shot / Geneformer (z) row, F1 column Source checking is not independent reproduction. |
Sources and history
Release 2026-09-16-d74d282221a9 · Record review: source checked
- scELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis · Original source · preprint archived 2025-08-23
Technical metadata and extraction receipts
Stable ID: lit-030
- areas
- cells-tissues
- tasks
- Cell-type annotation
- printed value
- 0.270
- numeric value
- 0.270
- metric
- F1
- metric direction
- unknown
- unit
- unitless
- uncertainty
- Not reported
- source locator
- Table 1, hPancreas zero-shot / Geneformer (z) row, F1 column
- review
- method: independent_ai_table_review; reviewer: Codex omics research agent; independent source-table review, not human review; reviewed at: 2026-09-16T10:41:16.539630+00:00; notes: Selected first hPancreas zero-shot block and F1 last column. Caption says some scores are copied from GenePT; this is source checking of the reported table, not independent experimental evidence. This verifies the central score at its source location, not every metadata field or an experimental reproduction.; evidence: {"table_xml_id": "T1", "row_cells": ["Geneformer (z)", "0.500", "0.250", "0.340", "0.270"], "selected_cell_zero_based": 4, "selected_cell_xml": "<td align=\"right\" valign=\"top\" rowspan=\"1\" colspan=\"1\">0.270</td>", "caption": "Scores of cell-type annotation task under different settings. Parts of the results are directly extracted from GenePT. Here PCA represents principal component analysis, and scELMo+random emb represents fine-tuning scELMo with random numbers as meaningless gene embeddings. Average ranks of all methods across datasets are summarized in Extended Data Figure 6 (b). We boldfaced the highest score of each metric for each dataset."}; artifact sha256: ef75f0d63a567f5e9d7132fd847f44838a82a9741ae55323437e1d1812d86316; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12393277/fullTextXML
- legacy id
- lit-030
- legacy row
- id: lit-030; paper id: scelmo-2025; domain id: cells-tissues; task: Cell-type annotation; model: Geneformer; model version: Not reported; dataset: hPancreas; dataset version: Not reported; split: Not reported; metric: F1; value: 0.270; unit: unitless; uncertainty: Not reported; protocol: Zero-shot setting; source caption says some comparator rows come from GenePT.; source locator: Table 1, hPancreas zero-shot / Geneformer (z) row, F1 column; source url: https://pmc.ncbi.nlm.nih.gov/articles/PMC12393277/; evaluation origin: paper_compilation; reviewed utc: 2026-09-15T23:25:00Z
- missing metadata
- model version: not_reported_in_legacy_extract; dataset version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract; uncertainty: not_reported_in_legacy_extract
Related records
- evaluation: Geneformer: Cell-type annotation
- subject: Reported F1 for Geneformer