result · source checked
0.631 Partial-label accuracy
C2S (GPT-2 Large) · Partial-label accuracy · L1000
- Tested model
- C2S (GPT-2 Large)
- Task or benchmark
- Combinatorial cell-label classification
- Dataset
- L1000
- Procedure
- Partial-credit labels including cell type, perturbation, and dose.
- Evaluation
- C2S (GPT-2 Large): Combinatorial cell-label classification
- Evidence
- Author-reported evaluation · source checkedCell2Sentence: Teaching Large Language Models the Language of Biology · Table 3, Partial label / C2S (GPT-2 Large) row, L1000 Acc column
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.
Evaluation results
Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| C2S (GPT-2 Large): Combinatorial cell-label classification Partial-credit labels including cell type, perturbation, and dose. Author-reported evaluation · Evaluation metadata: needs review | ||
| 0.631 Partial-label accuracy Unit: unitless · Direction: unknown | Uncertainty: ± 0.0031 Scored: Not reported · Eligible: Not reported | source checkedCell2Sentence: Teaching Large Language Models the Language of Biology · Table 3, Partial label / C2S (GPT-2 Large) row, L1000 Acc column Source checking is not independent reproduction. |
Sources and history
Release 2026-09-16-d74d282221a9 · Record review: source checked
- Cell2Sentence: Teaching Large Language Models the Language of Biology · Original source · preprint archived 2024-10-29
Technical metadata and extraction receipts
Stable ID: lit-027
- areas
- cells-tissues
- tasks
- Combinatorial cell-label classification
- printed value
- 0.631
- numeric value
- 0.631
- metric
- Partial-label accuracy
- metric direction
- unknown
- unit
- unitless
- uncertainty
- ± 0.0031
- source locator
- Table 3, Partial label / C2S (GPT-2 Large) row, L1000 Acc column
- review
- method: independent_ai_table_review; reviewer: Codex omics research agent; independent source-table review, not human review; reviewed at: 2026-09-16T10:41:16.533640+00:00; notes: Read inline small-caps/bold XML in document order, restoring Geneformer and GPT-2 Large labels. Selected Partial label (first block), L1000 > Acc, not AUROC or Full label. This verifies the central score at its source location, not every metadata field or an experimental reproduction.; evidence: {"table_xml_id": "T3", "row_cells": ["C2S (GPT-2 Large)", "0.639 ± 0.0049", "0.767 ± 0.0049", "0.631 ± 0.0031", "0.768 ± 0.0021", "0.575 ± 0.0035", "0.713 ± 0.0014"], "selected_cell_zero_based": 3, "selected_cell_xml": "<td align=\"center\" valign=\"middle\" rowspan=\"1\" colspan=\"1\"><bold>0.631</bold> ± <bold>0.0031</bold></td>", "caption": "Experimental results on downstream cell label classification. Cell labels are composed of multiple combinatorial metadata parts, including cell type, perturbations, and dosage information. Accuracy and area under ROC curve is computed on model predictions versus ground truth combinatorial labels, with partial credit given for partial misclassifications."}; artifact sha256: e088727d6e04857fccb7033a9b074e1850f775e86e7d2e99e603dde09558ab02; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC11565894/fullTextXML
- legacy id
- lit-027
- legacy row
- id: lit-027; paper id: cell2sentence-2024; domain id: cells-tissues; task: Combinatorial cell-label classification; model: C2S (GPT-2 Large); model version: GPT-2 Large; dataset: L1000; dataset version: Not reported; split: Not reported; metric: Partial-label accuracy; value: 0.631; unit: unitless; uncertainty: ± 0.0031; protocol: Partial-credit labels including cell type, perturbation, and dose.; source locator: Table 3, Partial label / C2S (GPT-2 Large) row, L1000 Acc column; source url: https://pmc.ncbi.nlm.nih.gov/articles/PMC11565894/; evaluation origin: author_reported; reviewed utc: 2026-09-15T23:25:00Z
- missing metadata
- dataset version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract