evaluation · needs review
scGPT: Cell-type structure in frozen embeddings
Evaluation procedure
k-means on pretrained cell embeddings; agreement with original cell-type labels.
- Model
- scGPT
- Benchmark
- Cell-type structure in frozen embeddings
- Dataset
- Aorta single-cell dataset
- origin
- Independent external evaluation
- configuration
- Not reported
- protocol id
- Not reported
- dataset version
- Not reported
- split
- Not reported
- population
- Not reported
- inputs
- Not reported
- adaptation
- Not reported
- metric implementation
- Not reported
- aggregation
- Not reported
- budget
- Not reported
Metadata review: needs review. Unreported conditions prevent automatic comparisons.
Evaluation results
Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| scGPT: Cell-type structure in frozen embeddings Model: scGPT · Benchmark: Cell-type structure in frozen embeddings · Dataset: Aorta single-cell dataset k-means on pretrained cell embeddings; agreement with original cell-type labels. Independent external evaluation · Evaluation metadata: needs review | ||
| 0.47 Adjusted Rand Index Unit: unitless · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedGenePT: A Simple But Effective Foundation Model for Genes and Cells Built From ChatGPT · Table 2, Aorta / Cell type row, scGPT ARI column Source checking is not independent reproduction. |
Sources and history
Release 2026-09-16-d74d282221a9 · Record review: needs review
- GenePT: A Simple But Effective Foundation Model for Genes and Cells Built From ChatGPT · Original source · PMC archival version PMC10614824.2
Technical metadata and extraction receipts
Stable ID: evaluation-lit-b3-012
- areas
- cells-tissues
- tasks
- Cell-type structure in frozen embeddings
- origin
- independent_paper
- protocol
- k-means on pretrained cell embeddings; agreement with original cell-type labels.
- version
- Not reported
- comparison
- protocol id: Not reported; dataset version: Not reported; split: Not reported; population: Not reported; inputs: Not reported; adaptation: Not reported; metric implementation: Not reported; aggregation: Not reported; budget: Not reported
- missing metadata
- model version: not_reported_in_legacy_extract; dataset version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract
Related records
- model: scGPT
- benchmark: Cell-type structure in frozen embeddings
- dataset: Aorta single-cell dataset
- evaluation: scGPT · Adjusted Rand Index · Aorta single-cell dataset