ResNet: SugarBase immunogenicity · Immuno
Author-reported single-task models on the same held-out task; not a cross-paper ranking. Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column.
Evaluation procedure
Author-reported single-task models on the same held-out task; not a cross-paper ranking. Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column.
- Configuration
- ResNet
- Protocol
- SugarBase immunogenicity · Immuno (GlycanML immunogenicity prediction)
- Dataset
- SugarBase immunogenicity · Immuno
- origin
- Author-reported evaluation
- configuration
- ResNet architecture in Table 2; single-task supervised encoder plus MLP; interaction additionally uses ESM-1b protein embeddings
- protocol id
- paper-protocol-705c3995af4e74e425
- dataset version
- Not reported
- split
- Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column.
- subset
- Not reported
- population
- train validation test: 1026; 149; 145; note: Dataset split sizes, not per-model scored counts.
- aggregation
- Mean and standard deviation across seeds 0, 1, 2.
- inputs
- Not reported
- adaptation
- ResNet architecture in Table 2; single-task supervised encoder plus MLP; interaction additionally uses ESM-1b protein embeddings
- budget
- Not reported
- metric implementation
- Not reported
Metadata review: needs review. Unreported conditions prevent automatic comparisons.
Evaluation results
Release 2026-09-17-d277315f7d76 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| ResNet: SugarBase immunogenicity · Immuno Configuration: ResNetProtocol: SugarBase immunogenicity · Immuno (GlycanML immunogenicity prediction)Dataset: SugarBase immunogenicity · Immuno Author-reported single-task models on the same held-out task; not a cross-paper ranking. Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column. Author-reported evaluation · Evaluation metadata: needs review | ||
| 0.754(0.124) AUPRC Unit: dimensionless · Direction: higher | Uncertainty: type: standard deviation; value: 0.124; n: 3; unit: same as metric Scored: Not reported · Eligible: Not reported | source checkedGlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning · Table 3, row ResNet, column Immuno Source checking is not independent reproduction. |
Evidence table
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
20 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.comparison.adaptation ResNet architecture in Table 2; single-task supervised encoder plus MLP; interaction additionally uses ESM-1b protein embeddings Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Immuno Version: arXiv:2405.16206v1, 2024-05-25 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.aggregation Mean and standard deviation across seeds 0, 1, 2. Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Immuno Version: arXiv:2405.16206v1, 2024-05-25 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.budget No value recorded Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Immuno Version: arXiv:2405.16206v1, 2024-05-25 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.dataset_version No value recorded Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Immuno Version: arXiv:2405.16206v1, 2024-05-25 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.inputs No value recorded Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Immuno Version: arXiv:2405.16206v1, 2024-05-25 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.metric_implementation No value recorded Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Immuno Version: arXiv:2405.16206v1, 2024-05-25 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.population.note Dataset split sizes, not per-model scored counts. Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Immuno Version: arXiv:2405.16206v1, 2024-05-25 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.population.train_validation_test [1026,149,145] Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Immuno Version: arXiv:2405.16206v1, 2024-05-25 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.protocol_id paper-protocol-705c3995af4e74e425 Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Immuno Version: arXiv:2405.16206v1, 2024-05-25 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.split Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column. Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Immuno Version: arXiv:2405.16206v1, 2024-05-25 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
Release 2026-09-17-d277315f7d76 · Record review: needs review
- GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning · Original source · arXiv:2405.16206v1, 2024-05-25
Technical metadata and extraction receipts
Stable ID: paper-evaluation-f09209afcdb381c4a4
- areas
- glycomics
- origin
- author_reported
- protocol
- Author-reported single-task models on the same held-out task; not a cross-paper ranking. Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column.
- version
- ResNet architecture in Table 2; single-task supervised encoder plus MLP; interaction additionally uses ESM-1b protein embeddings
- comparison
- protocol id: paper-protocol-705c3995af4e74e425; dataset version: Not reported; split: Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column.; subset: Not reported; population: train validation test: 1026; 149; 145; note: Dataset split sizes, not per-model scored counts.; aggregation: Mean and standard deviation across seeds 0, 1, 2.; inputs: Not reported; adaptation: ResNet architecture in Table 2; single-task supervised encoder plus MLP; interaction additionally uses ESM-1b protein embeddings; budget: Not reported; metric implementation: Not reported
- source locator
- Table 3, p. 8, Immuno
- missing metadata
- checkpoint revision: unextracted; budget: unreported; split manifest: unextracted