rewire.it
benchmark · task

Donor-held-out reference mapping

Can cells from an unseen donor be assigned to the correct reference cell types?

0 evaluations · 0 metric rows

At a glance

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.

Data, procedure and scoring
PropertyDescription and evidence
Record typeGeneric task; proposed designGeneformer official resource; scGPT official resource; scFoundation official resource; scVI official resource · Catalogue task scope and proposed comparison design; concrete source protocol has not yet been extracted
InputsMap unseen donors to a labelled cell-type reference.Geneformer official resource; scGPT official resource; scFoundation official resource; scVI official resource · Catalogue task scope and proposed comparison design; concrete source protocol has not yet been extracted
AssessmentNo single dataset, split or scoring implementation is fixed by this task recordGeneformer official resource; scGPT official resource; scFoundation official resource; scVI official resource · Catalogue task scope and proposed comparison design; concrete source protocol has not yet been extracted
DatasetsNot extracted or verified for this record.
OrganismsNot extracted or verified for this record.
AssaysNot extracted or verified for this record.
SplitsNot extracted or verified for this record.
AdaptationNot extracted or verified for this record.
BaselinesNot extracted or verified for this record.

How it works

Proposed evaluation design

Conceptual design only. This generic task has no fixed executable protocol and does not imply a completed run.

Proposed evaluation designLabel reference cells. Then: Withhold query donors. Then: Map query cells to reference. Then: Check labels and unknown typesLabel reference cellsWithhold query donorsMap query cells to referenceCheck labels and unknown types
Read the diagram as text
  1. Label reference cells
  2. Withhold query donors
  3. Map query cells to reference
  4. Check labels and unknown types
Geneformer official resource; scGPT official resource; scFoundation official resource; scVI official resource · Catalogue task scope and proposed comparison design; concrete source protocol has not yet been extracted

Proposed comparison design

Build a labelled reference and keep query donors outside downstream fitting. Record whether novel cell types can be rejected instead of forced into a known label.

Geneformer official resource; scGPT official resource; scFoundation official resource; scVI official resource · Catalogue task scope and proposed comparison design; concrete source protocol has not yet been extracted

Tested models and results

Release 2026-09-16-d74d282221a9 · 0 evaluations · 0 metric rows. Different protocols are not a single leaderboard.

No evaluations linked in this release.

Strengths and limitations

Profile review details

Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.

Stable record: catalog-task-cell-reference-mapping

Applicable tests and references

Applicability is distinct from a completed evaluation.

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: discovered

Download this release
Technical metadata and extraction receipts

Stable ID: catalog-task-cell-reference-mapping

areas
cells-tissues
entity level
task
version
Not reported
task
Donor-held-out reference mapping
scope note
Map unseen donors to a labelled cell-type reference.
missing metadata
protocol version: not_yet_extracted
Related records

Suggest a correction