rewire.it
benchmark · task

Cell-type identification

This paper-specific evaluation tests Cell-type identification using M.S. single-cell dataset.

2 evaluations · 2 metric rows

At a glance

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.

Data, procedure and scoring
PropertyDescription and evidence
Record typePaper-specific task; protocol incompletely extractedParameter-Efficient Fine-Tuning Enhances Adaptation of Single Cell Large Language Model for Cell Type Identification · Table 2, M.S. / scGPT row, F1-Score column; Table 2, M.S. / Geneformer row, F1-Score column
InputsM.S. single-cell datasetParameter-Efficient Fine-Tuning Enhances Adaptation of Single Cell Large Language Model for Cell Type Identification · Table 2, M.S. / scGPT row, F1-Score column; Table 2, M.S. / Geneformer row, F1-Score column
AssessmentF1-ScoreParameter-Efficient Fine-Tuning Enhances Adaptation of Single Cell Large Language Model for Cell Type Identification · Table 2, M.S. / scGPT row, F1-Score column; Table 2, M.S. / Geneformer row, F1-Score column
Recorded split or evaluation settingUnextractedParameter-Efficient Fine-Tuning Enhances Adaptation of Single Cell Large Language Model for Cell Type Identification · Table 2, M.S. / scGPT row, F1-Score column; Table 2, M.S. / Geneformer row, F1-Score column
DatasetsNot extracted or verified for this record.
OrganismsNot extracted or verified for this record.
AssaysNot extracted or verified for this record.
AdaptationNot extracted or verified for this record.
BaselinesNot extracted or verified for this record.

How it works

Reported evaluation outline

Outline of the existing paper extraction. Split membership, fitting details and scorer implementation remain incompletely reviewed.

Reported evaluation outlineM.S. single-cell dataset. Then: Recorded fitting or scoring procedure. Then: Assess F1-ScoreM.S. single-cell datasetRecorded fitting or scoringprocedureAssess F1-Score
Read the diagram as text
  1. M.S. single-cell dataset
  2. Recorded fitting or scoring procedure
  3. Assess F1-Score
Parameter-Efficient Fine-Tuning Enhances Adaptation of Single Cell Large Language Model for Cell Type Identification · Table 2, M.S. / scGPT row, F1-Score column; Table 2, M.S. / Geneformer row, F1-Score column

Evaluation context

The existing paper extraction describes: Native scLLM cell-type identification as reported in Table 2. This description is retained with the exact evaluation records; it is not a new protocol reconstruction.

Parameter-Efficient Fine-Tuning Enhances Adaptation of Single Cell Large Language Model for Cell Type Identification · Table 2, M.S. / scGPT row, F1-Score column; Table 2, M.S. / Geneformer row, F1-Score column

Tested models and results

Release 2026-09-16-d74d282221a9 · 2 evaluations · 2 metric rows. Different protocols are not a single leaderboard.

Results grouped by the exact reported evaluation
Metric and findingCoverage and uncertaintyEvidence
scGPT: Cell-type identification

Native scLLM cell-type identification as reported in Table 2.

Independent external evaluation · Evaluation metadata: needs review

0.734 F1-Score

Unit: unitless · Direction: unknown

Uncertainty: not reported in legacy extract

Scored: Not reported · Eligible: Not reported

source checkedParameter-Efficient Fine-Tuning Enhances Adaptation of Single Cell Large Language Model for Cell Type Identification · Table 2, M.S. / scGPT row, F1-Score column

Source checking is not independent reproduction.

Geneformer: Cell-type identification

Native scLLM cell-type identification as reported in Table 2.

Independent external evaluation · Evaluation metadata: needs review

0.388 F1-Score

Unit: unitless · Direction: unknown

Uncertainty: not reported in legacy extract

Scored: Not reported · Eligible: Not reported

source checkedParameter-Efficient Fine-Tuning Enhances Adaptation of Single Cell Large Language Model for Cell Type Identification · Table 2, M.S. / Geneformer row, F1-Score column

Source checking is not independent reproduction.

Strengths and limitations

Profile review details

Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.

Stable record: reported-task-5b929593eefc76

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: needs review

Download this release
Technical metadata and extraction receipts

Stable ID: reported-task-5b929593eefc76

areas
cells-tissues
tasks
Cell-type identification
entity level
task
version
Not reported
task
Cell-type identification
scope note
Paper-specific evaluation task; protocol completeness requires further extraction.
missing metadata
protocol version: not_reported_in_legacy_extract; split: not_reported_in_legacy_extract
Related records

Suggest a correction