benchmark · task

Human thymus cell-type classification

This paper-specific evaluation tests Human thymus cell-type classification using Human thymus scRNA-seq.

At a glance

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.

Data, procedure and scoring
Property	Description and evidence
Record type	Paper-specific task; protocol incompletely extractedMouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility · Table 4, h/ Thymus row, Mouse-Geneformer Zero-shot F1 column; Table 4, h/ Thymus row, Human-Geneformer Zero-shot F1 column
Inputs	Human thymus scRNA-seqMouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility · Table 4, h/ Thymus row, Mouse-Geneformer Zero-shot F1 column; Table 4, h/ Thymus row, Human-Geneformer Zero-shot F1 column
Assessment	F1Mouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility · Table 4, h/ Thymus row, Mouse-Geneformer Zero-shot F1 column; Table 4, h/ Thymus row, Human-Geneformer Zero-shot F1 column
Recorded split or evaluation setting	UnextractedMouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility · Table 4, h/ Thymus row, Mouse-Geneformer Zero-shot F1 column; Table 4, h/ Thymus row, Human-Geneformer Zero-shot F1 column
Datasets	Not extracted or verified for this record.
Organisms	Not extracted or verified for this record.
Assays	Not extracted or verified for this record.
Adaptation	Not extracted or verified for this record.
Baselines	Not extracted or verified for this record.

How it works

Reported evaluation outline

Outline of the existing paper extraction. Split membership, fitting details and scorer implementation remain incompletely reviewed.

Read the diagram as text

Human thymus scRNA-seq
Recorded fitting or scoring procedure
Assess F1

Mouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility · Table 4, h/ Thymus row, Mouse-Geneformer Zero-shot F1 column; Table 4, h/ Thymus row, Human-Geneformer Zero-shot F1 column

Evaluation context

The existing paper extraction describes: Ortholog-based gene conversion; zero-shot mouse model on human cells.; Native human model; zero-shot setting. This description is retained with the exact evaluation records; it is not a new protocol reconstruction.

Tested models and results

Release 2026-09-16-d74d282221a9 · 2 evaluations · 2 metric rows. Different protocols are not a single leaderboard.

Evaluated configurationMetricEvidence origin

Results grouped by the exact reported evaluation
Metric and finding	Coverage and uncertainty	Evidence
Mouse-Geneformer: Human thymus cell-type classification Model: Mouse-Geneformer · Benchmark: Human thymus cell-type classification · Dataset: Human thymus scRNA-seq Ortholog-based gene conversion; zero-shot mouse model on human cells. Author-reported evaluation · Evaluation metadata: needs review
48.57 F1 Unit: % · Direction: unknown	Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported	source checkedMouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility · Table 4, h/ Thymus row, Mouse-Geneformer Zero-shot F1 column Source checking is not independent reproduction.
Human-Geneformer: Human thymus cell-type classification Model: Human-Geneformer · Benchmark: Human thymus cell-type classification · Dataset: Human thymus scRNA-seq Native human model; zero-shot setting. Independent external evaluation · Evaluation metadata: needs review
74.48 F1 Unit: % · Direction: unknown	Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported	source checkedMouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility · Table 4, h/ Thymus row, Human-Geneformer Zero-shot F1 column Source checking is not independent reproduction.

Strengths and limitations

Strengths and considerations

The linked evaluation identifies the paper-specific dataset and assessment rather than treating the task name as a universal benchmark.Mouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility · Table 4, h/ Thymus row, Mouse-Geneformer Zero-shot F1 column; Table 4, h/ Thymus row, Human-Geneformer Zero-shot F1 column

Limitations and conditions

The numerical table check does not establish the full data-processing, fitting or leakage-control protocol.Mouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility · Table 4, h/ Thymus row, Mouse-Geneformer Zero-shot F1 column; Table 4, h/ Thymus row, Human-Geneformer Zero-shot F1 column

Profile review details

Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.

Stable record: reported-task-031186b57c62de

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: needs review

Mouse-Geneformer: A deep learning model for mouse single-cell transcriptome and its cross-species utility · Original source · version of record

Download this release

Technical metadata and extraction receipts

Stable ID: reported-task-031186b57c62de

areas: cells-tissues
tasks: Human thymus cell-type classification
entity level: task
version: Not reported
task: Human thymus cell-type classification
scope note: Paper-specific evaluation task; protocol completeness requires further extraction.
missing metadata: protocol version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract

Related records

dataset: Human thymus scRNA-seq
benchmark: Mouse-Geneformer: Human thymus cell-type classification
benchmark: Human-Geneformer: Human thymus cell-type classification

Suggest a correction