rewire.it
benchmark · task

Combinatorial cell-label classification

This paper-specific evaluation tests Combinatorial cell-label classification using L1000.

2 evaluations · 2 metric rows

At a glance

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.

Data, procedure and scoring
PropertyDescription and evidence
Record typePaper-specific task; protocol incompletely extractedCell2Sentence: Teaching Large Language Models the Language of Biology · Table 3, Partial label / C2S (GPT-2 Large) row, L1000 Acc column; Table 3, Partial label / Geneformer row, L1000 Acc column
InputsL1000Cell2Sentence: Teaching Large Language Models the Language of Biology · Table 3, Partial label / C2S (GPT-2 Large) row, L1000 Acc column; Table 3, Partial label / Geneformer row, L1000 Acc column
AssessmentPartial-label accuracyCell2Sentence: Teaching Large Language Models the Language of Biology · Table 3, Partial label / C2S (GPT-2 Large) row, L1000 Acc column; Table 3, Partial label / Geneformer row, L1000 Acc column
Recorded split or evaluation settingUnextractedCell2Sentence: Teaching Large Language Models the Language of Biology · Table 3, Partial label / C2S (GPT-2 Large) row, L1000 Acc column; Table 3, Partial label / Geneformer row, L1000 Acc column
DatasetsNot extracted or verified for this record.
OrganismsNot extracted or verified for this record.
AssaysNot extracted or verified for this record.
AdaptationNot extracted or verified for this record.
BaselinesNot extracted or verified for this record.

How it works

Reported evaluation outline

Outline of the existing paper extraction. Split membership, fitting details and scorer implementation remain incompletely reviewed.

Reported evaluation outlineL1000. Then: Recorded fitting or scoring procedure. Then: Assess Partial-label accuracyL1000Recorded fitting or scoringprocedureAssess Partial-label accuracy
Read the diagram as text
  1. L1000
  2. Recorded fitting or scoring procedure
  3. Assess Partial-label accuracy
Cell2Sentence: Teaching Large Language Models the Language of Biology · Table 3, Partial label / C2S (GPT-2 Large) row, L1000 Acc column; Table 3, Partial label / Geneformer row, L1000 Acc column

Evaluation context

The existing paper extraction describes: Partial-credit labels including cell type, perturbation, and dose. This description is retained with the exact evaluation records; it is not a new protocol reconstruction.

Cell2Sentence: Teaching Large Language Models the Language of Biology · Table 3, Partial label / C2S (GPT-2 Large) row, L1000 Acc column; Table 3, Partial label / Geneformer row, L1000 Acc column

Tested models and results

Release 2026-09-16-d74d282221a9 · 2 evaluations · 2 metric rows. Different protocols are not a single leaderboard.

Results grouped by the exact reported evaluation
Metric and findingCoverage and uncertaintyEvidence
C2S (GPT-2 Large): Combinatorial cell-label classification

Partial-credit labels including cell type, perturbation, and dose.

Author-reported evaluation · Evaluation metadata: needs review

0.631 Partial-label accuracy

Unit: unitless · Direction: unknown

Uncertainty: ± 0.0031

Scored: Not reported · Eligible: Not reported

source checkedCell2Sentence: Teaching Large Language Models the Language of Biology · Table 3, Partial label / C2S (GPT-2 Large) row, L1000 Acc column

Source checking is not independent reproduction.

Geneformer: Combinatorial cell-label classification

Partial-credit labels including cell type, perturbation, and dose.

Independent external evaluation · Evaluation metadata: needs review

0.419 Partial-label accuracy

Unit: unitless · Direction: unknown

Uncertainty: ± 0.0153

Scored: Not reported · Eligible: Not reported

source checkedCell2Sentence: Teaching Large Language Models the Language of Biology · Table 3, Partial label / Geneformer row, L1000 Acc column

Source checking is not independent reproduction.

Strengths and limitations

Strengths and considerations

Profile review details

Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.

Stable record: reported-task-7efe245cc94ee5

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: needs review

Download this release
Technical metadata and extraction receipts

Stable ID: reported-task-7efe245cc94ee5

areas
cells-tissues
tasks
Combinatorial cell-label classification
entity level
task
version
Not reported
task
Combinatorial cell-label classification
scope note
Paper-specific evaluation task; protocol completeness requires further extraction.
missing metadata
protocol version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract
Related records

Suggest a correction