This paper-specific evaluation tests Cell-type structure in frozen embeddings using Aorta single-cell dataset.
Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.
| Property | Description and evidence |
|---|---|
| Record type | Paper-specific task; protocol incompletely extractedGenePT: A Simple But Effective Foundation Model for Genes and Cells Built From ChatGPT · Table 2, Aorta / Cell type row, GenePT-w ARI column; Table 2, Aorta / Cell type row, scGPT ARI column |
| Inputs | Aorta single-cell datasetGenePT: A Simple But Effective Foundation Model for Genes and Cells Built From ChatGPT · Table 2, Aorta / Cell type row, GenePT-w ARI column; Table 2, Aorta / Cell type row, scGPT ARI column |
| Assessment | Adjusted Rand IndexGenePT: A Simple But Effective Foundation Model for Genes and Cells Built From ChatGPT · Table 2, Aorta / Cell type row, GenePT-w ARI column; Table 2, Aorta / Cell type row, scGPT ARI column |
| Recorded split or evaluation setting | UnextractedGenePT: A Simple But Effective Foundation Model for Genes and Cells Built From ChatGPT · Table 2, Aorta / Cell type row, GenePT-w ARI column; Table 2, Aorta / Cell type row, scGPT ARI column |
| Datasets | Not extracted or verified for this record. |
| Organisms | Not extracted or verified for this record. |
| Assays | Not extracted or verified for this record. |
| Adaptation | Not extracted or verified for this record. |
| Baselines | Not extracted or verified for this record. |
Outline of the existing paper extraction. Split membership, fitting details and scorer implementation remain incompletely reviewed.
The existing paper extraction describes: k-means on pretrained cell embeddings; agreement with original cell-type labels. This description is retained with the exact evaluation records; it is not a new protocol reconstruction.
GenePT: A Simple But Effective Foundation Model for Genes and Cells Built From ChatGPT · Table 2, Aorta / Cell type row, GenePT-w ARI column; Table 2, Aorta / Cell type row, scGPT ARI columnRelease 2026-09-16-d74d282221a9 · 2 evaluations · 2 metric rows. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| GenePT-w: Cell-type structure in frozen embeddings Model: GenePT-w · Benchmark: Cell-type structure in frozen embeddings · Dataset: Aorta single-cell dataset k-means on pretrained cell embeddings; agreement with original cell-type labels. Author-reported evaluation · Evaluation metadata: needs review | ||
| 0.54 Adjusted Rand Index Unit: unitless · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedGenePT: A Simple But Effective Foundation Model for Genes and Cells Built From ChatGPT · Table 2, Aorta / Cell type row, GenePT-w ARI column Source checking is not independent reproduction. |
| scGPT: Cell-type structure in frozen embeddings Model: scGPT · Benchmark: Cell-type structure in frozen embeddings · Dataset: Aorta single-cell dataset k-means on pretrained cell embeddings; agreement with original cell-type labels. Independent external evaluation · Evaluation metadata: needs review | ||
| 0.47 Adjusted Rand Index Unit: unitless · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedGenePT: A Simple But Effective Foundation Model for Genes and Cells Built From ChatGPT · Table 2, Aorta / Cell type row, scGPT ARI column Source checking is not independent reproduction. |
Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.
Stable record: reported-task-4df1fb456d3debRelease 2026-09-16-d74d282221a9 · Record review: needs review
Stable ID: reported-task-4df1fb456d3deb