This paper-specific evaluation tests Cell-type annotation using hPancreas.
Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.
| Property | Description and evidence |
|---|---|
| Record type | Paper-specific task; protocol incompletely extractedscELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis · Table 1, hPancreas zero-shot / scGPT (z) row, F1 column; Table 1, hPancreas zero-shot / Geneformer (z) row, F1 column |
| Inputs | hPancreasscELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis · Table 1, hPancreas zero-shot / scGPT (z) row, F1 column; Table 1, hPancreas zero-shot / Geneformer (z) row, F1 column |
| Assessment | F1scELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis · Table 1, hPancreas zero-shot / scGPT (z) row, F1 column; Table 1, hPancreas zero-shot / Geneformer (z) row, F1 column |
| Recorded split or evaluation setting | UnextractedscELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis · Table 1, hPancreas zero-shot / scGPT (z) row, F1 column; Table 1, hPancreas zero-shot / Geneformer (z) row, F1 column |
| Datasets | Not extracted or verified for this record. |
| Organisms | Not extracted or verified for this record. |
| Assays | Not extracted or verified for this record. |
| Adaptation | Not extracted or verified for this record. |
| Baselines | Not extracted or verified for this record. |
Outline of the existing paper extraction. Split membership, fitting details and scorer implementation remain incompletely reviewed.
The existing paper extraction describes: Zero-shot setting; source caption says some comparator rows come from GenePT. This description is retained with the exact evaluation records; it is not a new protocol reconstruction.
scELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis · Table 1, hPancreas zero-shot / scGPT (z) row, F1 column; Table 1, hPancreas zero-shot / Geneformer (z) row, F1 columnRelease 2026-09-16-d74d282221a9 · 2 evaluations · 2 metric rows. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| scGPT: Cell-type annotation Zero-shot setting; source caption says some comparator rows come from GenePT. Result quoted from another source · Evaluation metadata: needs review | ||
| 0.550 F1 Unit: unitless · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedscELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis · Table 1, hPancreas zero-shot / scGPT (z) row, F1 column Source checking is not independent reproduction. |
| Geneformer: Cell-type annotation Zero-shot setting; source caption says some comparator rows come from GenePT. Result quoted from another source · Evaluation metadata: needs review | ||
| 0.270 F1 Unit: unitless · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedscELMo: Embeddings from Language Models are Good Learners for Single-cell Data Analysis · Table 1, hPancreas zero-shot / Geneformer (z) row, F1 column Source checking is not independent reproduction. |
Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.
Stable record: reported-task-660753ec94e631Release 2026-09-16-d74d282221a9 · Record review: needs review
Stable ID: reported-task-660753ec94e631