GCN: LectinOracle interaction · Interaction
Author-reported single-task models on the same held-out task; not a cross-paper ranking. Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column.
Evaluation procedure
Author-reported single-task models on the same held-out task; not a cross-paper ranking. Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column.
- Configuration
- GCN
- Protocol
- LectinOracle interaction · Interaction (GlycanML protein-glycan interaction prediction)
- Dataset
- LectinOracle interaction · Interaction
- origin
- Author-reported evaluation
- configuration
- GCN architecture in Table 2; single-task supervised encoder plus MLP; interaction additionally uses ESM-1b protein embeddings
- protocol id
- paper-protocol-e914e4149f3b3c8185
- dataset version
- Not reported
- split
- Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column.
- subset
- Not reported
- population
- train validation test: 442396; 58887; 63364; note: Dataset split sizes, not per-model scored counts.
- aggregation
- Mean and standard deviation across seeds 0, 1, 2.
- inputs
- Not reported
- adaptation
- GCN architecture in Table 2; single-task supervised encoder plus MLP; interaction additionally uses ESM-1b protein embeddings
- budget
- Not reported
- metric implementation
- Not reported
Metadata review: needs review. Unreported conditions prevent automatic comparisons.
Evaluation results
Release 2026-09-17-d277315f7d76 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| GCN: LectinOracle interaction · Interaction Configuration: GCNProtocol: LectinOracle interaction · Interaction (GlycanML protein-glycan interaction prediction)Dataset: LectinOracle interaction · Interaction Author-reported single-task models on the same held-out task; not a cross-paper ranking. Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column. Author-reported evaluation · Evaluation metadata: needs review | ||
| 0.233(0.009) Spearman rho Unit: dimensionless · Direction: higher | Uncertainty: type: standard deviation; value: 0.009; n: 3; unit: same as metric Scored: Not reported · Eligible: Not reported | source checkedGlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning · Table 3, row GCN, column Interaction Source checking is not independent reproduction. |
Evidence table
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
20 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.comparison.adaptation GCN architecture in Table 2; single-task supervised encoder plus MLP; interaction additionally uses ESM-1b protein embeddings Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Interaction Version: arXiv:2405.16206v1, 2024-05-25 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.aggregation Mean and standard deviation across seeds 0, 1, 2. Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Interaction Version: arXiv:2405.16206v1, 2024-05-25 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.budget No value recorded Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Interaction Version: arXiv:2405.16206v1, 2024-05-25 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.dataset_version No value recorded Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Interaction Version: arXiv:2405.16206v1, 2024-05-25 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.inputs No value recorded Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Interaction Version: arXiv:2405.16206v1, 2024-05-25 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.metric_implementation No value recorded Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Interaction Version: arXiv:2405.16206v1, 2024-05-25 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.population.note Dataset split sizes, not per-model scored counts. Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Interaction Version: arXiv:2405.16206v1, 2024-05-25 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.population.train_validation_test [442396,58887,63364] Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Interaction Version: arXiv:2405.16206v1, 2024-05-25 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.protocol_id paper-protocol-e914e4149f3b3c8185 Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Interaction Version: arXiv:2405.16206v1, 2024-05-25 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.split Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column. Context-only references | GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning Table 3, p. 8, Interaction Version: arXiv:2405.16206v1, 2024-05-25 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
Release 2026-09-17-d277315f7d76 · Record review: needs review
- GlycanML: A Multi-Task and Multi-Structure Benchmark for Glycan Machine Learning · Original source · arXiv:2405.16206v1, 2024-05-25
Technical metadata and extraction receipts
Stable ID: paper-evaluation-4cf8bc2b7fc8c1732e
- areas
- glycomics
- origin
- author_reported
- protocol
- Author-reported single-task models on the same held-out task; not a cross-paper ranking. Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column.
- version
- GCN architecture in Table 2; single-task supervised encoder plus MLP; interaction additionally uses ESM-1b protein embeddings
- comparison
- protocol id: paper-protocol-e914e4149f3b3c8185; dataset version: Not reported; split: Taxonomy, immunogenicity and glycosylation: motif-frequency K-means cluster allocation 8:1:1. Interaction: MMseqs2 protein clusters at minimum identity 0.5 allocated 8:1:1. Exact counts are attached to each column.; subset: Not reported; population: train validation test: 442396; 58887; 63364; note: Dataset split sizes, not per-model scored counts.; aggregation: Mean and standard deviation across seeds 0, 1, 2.; inputs: Not reported; adaptation: GCN architecture in Table 2; single-task supervised encoder plus MLP; interaction additionally uses ESM-1b protein embeddings; budget: Not reported; metric implementation: Not reported
- source locator
- Table 3, p. 8, Interaction
- missing metadata
- checkpoint revision: unextracted; budget: unreported; split manifest: unextracted