scanvi_embed · scIB official RNA metrics export · pancreas
scIB official RNA metrics export; pancreas. Source checked, not independently reproduced.
Evaluation results
Release 2026-09-19-eb6149e5d766 · 1 evaluation · 12 metric rows. Different protocols are not a single leaderboard. Charts retain each source table’s protocol and dataset.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| scanvi_embed · scIB official RNA metrics export · pancreas Configuration: scanvi_embed · full_feature, unscaledProtocol: scIB official RNA metrics export · pancreasDataset subset: pancreas scIB official RNA metrics export Author-reported evaluation · Evaluation metadata: discovered | ||
| 0.5584926120936871 isolated_label_silhouette Unit: score · Direction: higher Aggregation: unreported | Uncertainty: status: unreported Scored: Not reported · Eligible: Not reported | source checkedscIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f · data/metrics.csv row 243, column 9 (isolated_label_silhouette) Source checking is not independent reproduction. |
| 0.8979026254981701 NMI_cluster/label Unit: score · Direction: higher Aggregation: unreported | Uncertainty: status: unreported Scored: Not reported · Eligible: Not reported | source checkedscIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f · data/metrics.csv row 243, column 2 (NMI_cluster/label) Source checking is not independent reproduction. |
| 0.5925235748291021 ASW_label Unit: score · Direction: higher Aggregation: unreported | Uncertainty: status: unreported Scored: Not reported · Eligible: Not reported | source checkedscIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f · data/metrics.csv row 243, column 4 (ASW_label) Source checking is not independent reproduction. |
| 0.9532281842447192 graph_conn Unit: score · Direction: higher Aggregation: unreported | Uncertainty: status: unreported Scored: Not reported · Eligible: Not reported | source checkedscIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f · data/metrics.csv row 243, column 10 (graph_conn) Source checking is not independent reproduction. |
| 0.9403492307358752 ARI_cluster/label Unit: score · Direction: higher Aggregation: unreported | Uncertainty: status: unreported Scored: Not reported · Eligible: Not reported | source checkedscIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f · data/metrics.csv row 243, column 3 (ARI_cluster/label) Source checking is not independent reproduction. |
| 0.3303362198945989 kBET Unit: score · Direction: higher Aggregation: unreported | Uncertainty: status: unreported Scored: Not reported · Eligible: Not reported | source checkedscIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f · data/metrics.csv row 243, column 11 (kBET) Source checking is not independent reproduction. |
| 0.8592847757856709 PCR_batch Unit: score · Direction: higher Aggregation: unreported | Uncertainty: status: unreported Scored: Not reported · Eligible: Not reported | source checkedscIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f · data/metrics.csv row 243, column 6 (PCR_batch) Source checking is not independent reproduction. |
| 0.999219481683595 cLISI Unit: score · Direction: higher Aggregation: unreported | Uncertainty: status: unreported Scored: Not reported · Eligible: Not reported | source checkedscIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f · data/metrics.csv row 243, column 13 (cLISI) Source checking is not independent reproduction. |
| 0.181487313906364 iLISI Unit: score · Direction: higher Aggregation: unreported | Uncertainty: status: unreported Scored: Not reported · Eligible: Not reported | source checkedscIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f · data/metrics.csv row 243, column 12 (iLISI) Source checking is not independent reproduction. |
| 0.627919444190445 cell_cycle_conservation Unit: score · Direction: higher Aggregation: unreported | Uncertainty: status: unreported Scored: Not reported · Eligible: Not reported | source checkedscIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f · data/metrics.csv row 243, column 7 (cell_cycle_conservation) Source checking is not independent reproduction. |
| 0.8580273944723491 ASW_label/batch Unit: score · Direction: higher Aggregation: unreported | Uncertainty: status: unreported Scored: Not reported · Eligible: Not reported | source checkedscIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f · data/metrics.csv row 243, column 5 (ASW_label/batch) Source checking is not independent reproduction. |
| 0.1007194244604319 isolated_label_F1 Unit: score · Direction: higher Aggregation: unreported | Uncertainty: status: unreported Scored: Not reported · Eligible: Not reported | source checkedscIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f · data/metrics.csv row 243, column 8 (isolated_label_F1) Source checking is not independent reproduction. |
Methods and reproduction
scIB official RNA metrics export; pancreas. Source checked, not independently reproduced.
- configuration
- scanvi_embed · full_feature, unscaled
- protocol
- scIB official RNA metrics export · pancreas
- dataset subset
- pancreas
- Split
- pancreas
- Adaptation
- unreported
- Scoring implementation
- Not reported
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evaluation procedure
scIB official RNA metrics export
- Configuration
- scanvi_embed · full_feature, unscaled
- Protocol
- scIB official RNA metrics export · pancreas
- Dataset subset
- pancreas
- origin
- Author-reported evaluation
- configuration
- Not reported
- protocol id
- acquired-protocol-3f6fa62242423922b5f2
- dataset version
- 3afbffd3674726e5146797be21cf6bd7470a2c5f
- split
- pancreas
- population
- pancreas
- inputs
- unreported
- adaptation
- unreported
- aggregation
- metric-specific; inspect each result
Metadata review: discovered. Unreported conditions prevent automatic comparisons.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
22 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.comparison.adaptation unreported Context-only references | scIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f data/metrics.csv row 243, column 2 (NMI_cluster/label) Version: 3afbffd3674726e5146797be21cf6bd7470a2c5f | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.comparison.aggregation metric-specific; inspect each result Context-only references | scIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f data/metrics.csv row 243, column 2 (NMI_cluster/label) Version: 3afbffd3674726e5146797be21cf6bd7470a2c5f | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.comparison.dataset_version 3afbffd3674726e5146797be21cf6bd7470a2c5f Context-only references | scIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f data/metrics.csv row 243, column 2 (NMI_cluster/label) Version: 3afbffd3674726e5146797be21cf6bd7470a2c5f | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.comparison.inputs unreported Context-only references | scIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f data/metrics.csv row 243, column 2 (NMI_cluster/label) Version: 3afbffd3674726e5146797be21cf6bd7470a2c5f | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.comparison.population pancreas Context-only references | scIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f data/metrics.csv row 243, column 2 (NMI_cluster/label) Version: 3afbffd3674726e5146797be21cf6bd7470a2c5f | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.comparison.protocol_id acquired-protocol-3f6fa62242423922b5f2 Context-only references | scIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f data/metrics.csv row 243, column 2 (NMI_cluster/label) Version: 3afbffd3674726e5146797be21cf6bd7470a2c5f | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.comparison.split pancreas Context-only references | scIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f data/metrics.csv row 243, column 2 (NMI_cluster/label) Version: 3afbffd3674726e5146797be21cf6bd7470a2c5f | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.conditions.batches 9 Context-only references | scIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f data/metrics.csv row 243, column 2 (NMI_cluster/label) Version: 3afbffd3674726e5146797be21cf6bd7470a2c5f | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.conditions.cells 16382 Context-only references | scIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f data/metrics.csv row 243, column 2 (NMI_cluster/label) Version: 3afbffd3674726e5146797be21cf6bd7470a2c5f | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
| attributes.conditions.configuration scanvi_embed Context-only references | scIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f data/metrics.csv row 243, column 2 (NMI_cluster/label) Version: 3afbffd3674726e5146797be21cf6bd7470a2c5f | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact downloaded bytes, before optional gzip storage |
Sources and history
View linked audit checks and correction history
Release 2026-09-19-eb6149e5d766 · Record review: discovered
1 source records and release history
- scIB: 3afbffd3674726e5146797be21cf6bd7470a2c5f · Original source · 3afbffd3674726e5146797be21cf6bd7470a2c5f
Technical metadata and extraction receipts
Stable ID: acquired-evaluation-cb9b3b216f3e07b53077
- origin
- author_reported
- protocol
- scIB official RNA metrics export
- source locator
- data/metrics.csv row 243, column 2 (NMI_cluster/label)
- conditions
- batches: 9; cells: 16382; configuration: scanvi_embed; features: full_feature; labels: 14; notes: Published metric-score export; intended higher direction verified from pinned official consuming code. No additional min-max normalization or overall ranking. Dataset metadata reports total cells; per-result scoring coverage is unreported.; scaling: unscaled
- comparison
- protocol id: acquired-protocol-3f6fa62242423922b5f2; dataset version: 3afbffd3674726e5146797be21cf6bd7470a2c5f; split: pancreas; population: pancreas; inputs: unreported; adaptation: unreported; aggregation: metric-specific; inspect each result
- missing metadata
- checkpoint revision: unreported; scored count: unreported
Related records
- model: scanvi_embed · full_feature, unscaled
- benchmark: scIB official RNA metrics export · pancreas
- dataset: pancreas
- evaluation: scanvi_embed · isolated_label_silhouette · pancreas
- evaluation: scanvi_embed · NMI_cluster/label · pancreas
- evaluation: scanvi_embed · ASW_label · pancreas
- evaluation: scanvi_embed · graph_conn · pancreas
- evaluation: scanvi_embed · ARI_cluster/label · pancreas
- evaluation: scanvi_embed · kBET · pancreas
- evaluation: scanvi_embed · PCR_batch · pancreas
- evaluation: scanvi_embed · cLISI · pancreas
- evaluation: scanvi_embed · iLISI · pancreas
- evaluation: scanvi_embed · cell_cycle_conservation · pancreas
- evaluation: scanvi_embed · ASW_label/batch · pancreas
- evaluation: scanvi_embed · isolated_label_F1 · pancreas