result · source checked
74.48 F1
Human-Geneformer · F1 · Human thymus scRNA-seq
- Tested model
- Human-Geneformer
- Task or benchmark
- Human thymus cell-type classification
- Dataset
- Human thymus scRNA-seq
- Procedure
- Native human model; zero-shot setting.
- Evaluation
- Human-Geneformer: Human thymus cell-type classification
- Evidence
- Independent external evaluation · source checkedMouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility · Table 4, h/ Thymus row, Human-Geneformer Zero-shot F1 column
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.
Evaluation results
Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| Human-Geneformer: Human thymus cell-type classification Model: Human-Geneformer · Benchmark: Human thymus cell-type classification · Dataset: Human thymus scRNA-seq Native human model; zero-shot setting. Independent external evaluation · Evaluation metadata: needs review | ||
| 74.48 F1 Unit: % · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedMouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility · Table 4, h/ Thymus row, Human-Geneformer Zero-shot F1 column Source checking is not independent reproduction. |
Sources and history
Release 2026-09-16-d74d282221a9 · Record review: source checked
- Mouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility · Original source · version of record
Technical metadata and extraction receipts
Stable ID: lit-b3-004
- areas
- cells-tissues
- tasks
- Human thymus cell-type classification
- printed value
- 74.48
- numeric value
- 74.48
- metric
- F1
- metric direction
- unknown
- unit
- %
- uncertainty
- Not reported
- source locator
- Table 4, h/ Thymus row, Human-Geneformer Zero-shot F1 column
- review
- method: independent_ai_table_review; reviewer: Codex omics research agent; independent source-table review, not human review; reviewed at: 2026-09-16T10:44:03.394073+00:00; notes: h/ Thymus row, four human cell types; zero-shot model blocks use Acc then F1, not fine-tuned scores. Ortholog-based conversion evaluated, not mouse cell annotation. Source check verifies central value and table context, not experiment reproduction or all metadata.; evidence: {"table_xml_id": "pgen.1011420.t004", "row_cells": ["h/ Thymus", "4", "82.74", "48.57", "95.59", "87.81", "87.27", "74.48", "95.44", "87.79", "92.04", "82.37"], "selected_cell_zero_based": 7, "selected_cell_xml": "<td align=\"left\" rowspan=\"1\" colspan=\"1\">74.48</td>", "caption": "Human cell type classification using mouse-Geneformer via ortholog-based gene name conversion, compared to native human models (human-Geneformer and scGPT)."}; artifact sha256: ef6c68f5c9b47c2f89598ddf647f05b72e4155e8b33609ebff23936a84bbd41d; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC11964219/fullTextXML
- legacy id
- lit-b3-004
- legacy row
- id: lit-b3-004; paper id: mouse-geneformer-2025; domain id: cells-tissues; task: Human thymus cell-type classification; model: Human-Geneformer; model version: Not reported; dataset: Human thymus scRNA-seq; dataset version: Not reported; split: Not reported; metric: F1; value: 74.48; unit: %; uncertainty: Not reported; protocol: Native human model; zero-shot setting.; source locator: Table 4, h/ Thymus row, Human-Geneformer Zero-shot F1 column; source url: https://pmc.ncbi.nlm.nih.gov/articles/PMC11964219/; evaluation origin: independent_paper; reviewed utc: 2026-09-15T23:29:32Z
- missing metadata
- model version: not_reported_in_legacy_extract; dataset version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract; uncertainty: not_reported_in_legacy_extract