Pancreas (random split with label noise) (Open Problems label projection split)
The split of Pancreas (random split with label noise) that Open Problems label projection evaluated on. The upstream dataset release is not catalogued here, so no claim is made that this matches its original splits.
Subset and evaluation context
This record describes a particular subset or cohort used in an evaluation. Its results do not describe the full dataset.
Evaluation results
Release 2026-09-17-134cd1815de8 · 48 evaluations · 48 metric rows. Different protocols are not a single leaderboard. Where several source tables report the same metric, the published comparisons above offer a pooled view that names what it does not hold constant.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| K-neighbors classifier (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy Configuration: K-neighbors classifier (log CP10k)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), AccuracyDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.9463790446841295 accuracy Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(k_neighbors_classifier), paramset(log CP10k), metric(accuracy) Source checking is not independent reproduction. |
| K-neighbors classifier (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score Configuration: K-neighbors classifier (log CP10k)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.9460810866713062 f1 Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(k_neighbors_classifier), paramset(log CP10k), metric(f1) Source checking is not independent reproduction. |
| K-neighbors classifier (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score Configuration: K-neighbors classifier (log CP10k)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.8361237623993133 f1-macro Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(k_neighbors_classifier), paramset(log CP10k), metric(f1_macro) Source checking is not independent reproduction. |
| K-neighbors classifier (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy Configuration: K-neighbors classifier (log scran)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), AccuracyDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.9411402157164869 accuracy Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(k_neighbors_classifier), paramset(log scran), metric(accuracy) Source checking is not independent reproduction. |
| K-neighbors classifier (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score Configuration: K-neighbors classifier (log scran)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.9404360005933883 f1 Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(k_neighbors_classifier), paramset(log scran), metric(f1) Source checking is not independent reproduction. |
| K-neighbors classifier (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score Configuration: K-neighbors classifier (log scran)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.7218714554626218 f1-macro Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(k_neighbors_classifier), paramset(log scran), metric(f1_macro) Source checking is not independent reproduction. |
| Logistic regression (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy Configuration: Logistic regression (log CP10k)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), AccuracyDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.9796610169491525 accuracy Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(logistic_regression), paramset(log CP10k), metric(accuracy) Source checking is not independent reproduction. |
| Logistic regression (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score Configuration: Logistic regression (log CP10k)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.9791824244686764 f1 Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(logistic_regression), paramset(log CP10k), metric(f1) Source checking is not independent reproduction. |
| Logistic regression (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score Configuration: Logistic regression (log CP10k)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.8964053737821305 f1-macro Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(logistic_regression), paramset(log CP10k), metric(f1_macro) Source checking is not independent reproduction. |
| Logistic regression (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy Configuration: Logistic regression (log scran)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), AccuracyDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.8046224961479199 accuracy Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(logistic_regression), paramset(log scran), metric(accuracy) Source checking is not independent reproduction. |
| Logistic regression (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score Configuration: Logistic regression (log scran)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.7759818120203118 f1 Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(logistic_regression), paramset(log scran), metric(f1) Source checking is not independent reproduction. |
| Logistic regression (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score Configuration: Logistic regression (log scran)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.42839154368293453 f1-macro Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(logistic_regression), paramset(log scran), metric(f1_macro) Source checking is not independent reproduction. |
| Majority Vote on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy Configuration: Majority VoteTask: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), AccuracyDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.3352850539291217 accuracy Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(majority_vote), paramset(none), metric(accuracy) Source checking is not independent reproduction. |
| Majority Vote on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score Configuration: Majority VoteTask: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.16837763151390925 f1 Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(majority_vote), paramset(none), metric(f1) Source checking is not independent reproduction. |
| Majority Vote on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score Configuration: Majority VoteTask: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.03587089116745244 f1-macro Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(majority_vote), paramset(none), metric(f1_macro) Source checking is not independent reproduction. |
| Multilayer perceptron (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy Configuration: Multilayer perceptron (log CP10k)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), AccuracyDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.8080123266563944 accuracy Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(multilayer_perceptron), paramset(log CP10k), metric(accuracy) Source checking is not independent reproduction. |
| Multilayer perceptron (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score Configuration: Multilayer perceptron (log CP10k)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.8366856872231097 f1 Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(multilayer_perceptron), paramset(log CP10k), metric(f1) Source checking is not independent reproduction. |
| Multilayer perceptron (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score Configuration: Multilayer perceptron (log CP10k)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.5463249016394928 f1-macro Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(multilayer_perceptron), paramset(log CP10k), metric(f1_macro) Source checking is not independent reproduction. |
| Multilayer perceptron (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy Configuration: Multilayer perceptron (log scran)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), AccuracyDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.9208012326656394 accuracy Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(multilayer_perceptron), paramset(log scran), metric(accuracy) Source checking is not independent reproduction. |
| Multilayer perceptron (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score Configuration: Multilayer perceptron (log scran)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.925397640256357 f1 Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(multilayer_perceptron), paramset(log scran), metric(f1) Source checking is not independent reproduction. |
| Multilayer perceptron (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score Configuration: Multilayer perceptron (log scran)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.6930725021224952 f1-macro Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(multilayer_perceptron), paramset(log scran), metric(f1_macro) Source checking is not independent reproduction. |
| Random Labels on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy Method: Random LabelsTask: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), AccuracyDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.17349768875192603 accuracy Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(random_labels), paramset(none), metric(accuracy) Source checking is not independent reproduction. |
| Random Labels on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score Method: Random LabelsTask: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.18787809947778522 f1 Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(random_labels), paramset(none), metric(f1) Source checking is not independent reproduction. |
| Random Labels on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score Method: Random LabelsTask: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 scoreDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.06262558806662334 f1-macro Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(random_labels), paramset(none), metric(f1_macro) Source checking is not independent reproduction. |
| scANVI (All genes) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy Configuration: scANVI (All genes)Task: Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), AccuracyDataset subset: Pancreas (random split with label noise) (Open Problems label projection split) Human pancreatic islet scRNA-seq data from 6 datasets across technologies (CEL-seq, CEL-seq2, Smart-seq2, inDrop, Fluidigm C1, and SMARTER-seq). Split into train/test randomly with 20% label noise. Dimensions: 16382 cells, 18771 genes. 14 cell types (avg. 1170±1703 cells per cell type). Author-reported evaluation · Evaluation metadata: source checked | ||
| 0.9704160246533128 accuracy Unit: fraction · Direction: higher | Uncertainty: Not reported Scored: Not reported · Eligible: Not reported | source checkedopenproblems-label primary benchmark evidence · results, dataset(pancreas_random_label_noise), method(scanvi), paramset(All genes), metric(accuracy) Source checking is not independent reproduction. |
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
2 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| description The split of Pancreas (random split with label noise) that Open Problems label projection evaluated on. The upstream dataset release is not catalogued here, so no claim is made that this matches its original splits. Context-only references | openproblems-label primary benchmark evidence No field-specific location recorded Version: v1.0.0 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| name Pancreas (random split with label noise) (Open Problems label projection split) Context-only references | openproblems-label primary benchmark evidence No field-specific location recorded Version: v1.0.0 | not individually reviewed No individual claim review recorded Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
Release 2026-09-17-134cd1815de8 · Record review: source checked
1 source records and release history
Download this releaseTechnical metadata and extraction receipts
Stable ID: open-problems-dataset-pancreas-random-split-with-label-noise
- areas
- cells-tissues
- missing metadata
- version: unreported; url: unextracted
Related records
- dataset: K-neighbors classifier (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: K-neighbors classifier (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: K-neighbors classifier (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: K-neighbors classifier (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: K-neighbors classifier (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: K-neighbors classifier (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: Logistic regression (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: Logistic regression (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: Logistic regression (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: Logistic regression (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: Logistic regression (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: Logistic regression (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: Majority Vote on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: Majority Vote on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: Majority Vote on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: Multilayer perceptron (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: Multilayer perceptron (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: Multilayer perceptron (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: Multilayer perceptron (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: Multilayer perceptron (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: Multilayer perceptron (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: Random Labels on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: Random Labels on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: Random Labels on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: scANVI (All genes) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: scANVI (All genes) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: scANVI (All genes) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: scANVI (Seurat v3 2000 HVG) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: scANVI (Seurat v3 2000 HVG) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: scANVI (Seurat v3 2000 HVG) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: scArches+scANVI (All genes) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: scArches+scANVI (All genes) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: scArches+scANVI (All genes) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: scArches+scANVI (Seurat v3 2000 HVG) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: scArches+scANVI (Seurat v3 2000 HVG) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: scArches+scANVI (Seurat v3 2000 HVG) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: Seurat reference mapping (SCTransform) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: Seurat reference mapping (SCTransform) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: Seurat reference mapping (SCTransform) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: True Labels on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: True Labels on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: True Labels on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: XGBoost (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: XGBoost (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: XGBoost (log CP10k) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score
- dataset: XGBoost (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-ACCURACY: Label projection on Pancreas (random split with label noise), Accuracy
- dataset: XGBoost (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1: Label projection on Pancreas (random split with label noise), F1 score
- dataset: XGBoost (log scran) on Open Problems label projection PANCREAS-RANDOM-LABEL-NOISE-F1-MACRO: Label projection on Pancreas (random split with label noise), Macro F1 score