rewire.it
benchmark · suite

PerturBench

PerturBench standardizes cellular perturbation prediction workflows.

0 evaluations · 0 metric rows

At a glance

Explanatory profile: source reviewed · Automated source review, 2026-09-16. This does not change the review status of its results.

Data, procedure and scoring
PropertyDescription and evidence
Record typeBenchmark frameworkaltoslabs/perturbench official source · README: Downloading and Preparing Datasets / Data Splitting; Usage / Evaluator Class; Automated Evaluation
InputsSingle-cell expression, perturbation metadata and predicted responsesaltoslabs/perturbench official source · README: Downloading and Preparing Datasets / Data Splitting; Usage / Evaluator Class; Automated Evaluation
Outputs and assessmentMetrics on aggregated expression or response changesaltoslabs/perturbench official source · README: Downloading and Preparing Datasets / Data Splitting; Usage / Evaluator Class; Automated Evaluation
DatasetsNot extracted or verified for this record.
OrganismsNot extracted or verified for this record.
AssaysNot extracted or verified for this record.
SplitsNot extracted or verified for this record.
AdaptationNot extracted or verified for this record.
BaselinesNot extracted or verified for this record.

How it works

Procedure overview

Conceptual overview of the cited procedure; consult the pinned source for executable settings.

Procedure overviewCurated perturbation data. Then: Select released split. Then: Predict response. Then: Aggregate and evaluateCurated perturbation dataSelect released splitPredict responseAggregate and evaluate
Read the diagram as text
  1. Curated perturbation data
  2. Select released split
  3. Predict response
  4. Aggregate and evaluate
altoslabs/perturbench official source · README: Downloading and Preparing Datasets / Data Splitting; Usage / Evaluator Class; Automated Evaluation

Procedure

Load a curated single-cell dataset and its defined split, produce predicted perturbed expression, then evaluate an explicitly chosen aggregation and metric pipeline. Some datasets use generated splits; others require released manual partitions.

altoslabs/perturbench official source · README: Downloading and Preparing Datasets / Data Splitting; Usage / Evaluator Class; Automated Evaluation

Tested models and results

Release 2026-09-16-d74d282221a9 · 0 evaluations · 0 metric rows. Different protocols are not a single leaderboard.

No evaluations linked in this release.

Strengths and limitations

Strengths supported by sources

  • Separates expression aggregation, distance or correlation metrics and optional ranking assessment.altoslabs/perturbench official source · README: Downloading and Preparing Datasets / Data Splitting; Usage / Evaluator Class; Automated Evaluation

Limitations and conditions

  • Means, log-fold changes and other representations answer different questions; the exact aggregation and split must accompany the score.altoslabs/perturbench official source · README: Downloading and Preparing Datasets / Data Splitting; Usage / Evaluator Class; Automated Evaluation
Profile review details

Primary-source description checked by an automated research assistant. This is a profile review, not an independent execution or numerical reproduction.

Stable record: discovery-benchmark-perturbench

Applicable tests and references

Applicability is distinct from a completed evaluation.

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: discovered

Download this release
Technical metadata and extraction receipts

Stable ID: discovery-benchmark-perturbench

areas
single-cell
entity level
suite
missing metadata
dataset release: unextracted; metric implementation: unextracted; split manifest: unextracted; version: unextracted
scope note
Specialist molecular or omics evaluation; protocol details require review before numerical comparison.
task
Predicting cellular perturbation responses
version
Not reported
Related records

Suggest a correction