Strengths and considerations
No source-reviewed explanatory claims are recorded here yet.
Enzyme functional-identity classification predicts whether a protein pair shares its annotated reaction function.
Explanatory profile: limited source coverage · Automated source review, 2026-09-16. Review applies to the cited claims; unresolved fields are listed below. Numerical results retain their own review status.
| Property | Description and evidence |
|---|---|
| Datasets | Swiss-Prot reaction annotations and AlphaFold Database structures; balanced same-function and different-function pairs.SourcesEnhanced prediction of protein functional identity through the integration of sequence and structural features · Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages |
| Splits | Random pair partitions provide training, validation and test subsets; model hyperparameters are tuned using cross-validation.SourcesEnhanced prediction of protein functional identity through the integration of sequence and structural features · Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages |
| Metrics | Accuracy, false-positive rate, MCC, precision, recall, F1, AUROC and AUPR.SourcesEnhanced prediction of protein functional identity through the integration of sequence and structural features · Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages |
| Baselines | LightGBM and multiple conventional classifiers.SourcesEnhanced prediction of protein functional identity through the integration of sequence and structural features · Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages |
| Leakage controls | The low-sequence-similarity evaluation excludes pairs from the original dataset; random splitting of the main pair dataset does not establish protein-identity holdout.SourcesEnhanced prediction of protein functional identity through the integration of sequence and structural features · Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages |
| Uncertainty | The paper assesses stability using repeated bootstrap iterations; its sampling unit must remain attached to the reported interval.SourcesEnhanced prediction of protein functional identity through the integration of sequence and structural features · Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages |
| Entity type | Paper-specific computational evaluation protocol.SourcesEnhanced prediction of protein functional identity through the integration of sequence and structural features · Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages |
| Organisms | Proteins were selected through Swiss-Prot release 2022_04 entries with Rhea reaction annotations and AlphaFold DB v4 structures. Dataset construction does not enumerate organism frequencies for the sampled 100,000 protein pairs, so a species-restricted population cannot be assigned. · Not reported in inspected sourcesSourcesEnhanced prediction of protein functional identity through the integration of sequence and structural features · Materials and methods: Dataset construction |
| Assays | Swiss-Prot reaction/function annotations with AlphaFold structures.SourcesEnhanced prediction of protein functional identity through the integration of sequence and structural features · Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages |
| Allowed inputs | Pairs of enzyme representations.SourcesEnhanced prediction of protein functional identity through the integration of sequence and structural features · Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages |
| Adaptation | Supervised same-function classification; hyperparameters use cross-validation, with algorithm choice additionally compared on test data.SourcesEnhanced prediction of protein functional identity through the integration of sequence and structural features · Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages |
Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol.
Swiss-Prot reaction annotations and AlphaFold Database structures; balanced same-function and different-function pairs. Random pair partitions provide training, validation and test subsets; model hyperparameters are tuned using cross-validation. Accuracy, false-positive rate, MCC, precision, recall, F1, AUROC and AUPR. LightGBM and multiple conventional classifiers. The low-sequence-similarity evaluation excludes pairs from the original dataset; random splitting of the main pair dataset does not establish protein-identity holdout.
Benchmarks bring together tasks and protocols. A task describes the biological question; a protocol defines a particular test.
These source-backed links do not make different protocols or scores interchangeable.
Explore the results reported under one evaluation protocol. Each figure keeps its source, dataset and metric together; it is not a ranking across studies.
ACC (%) (percent) · Higher values are better for this metric.
LightGBM FUJISAN and comparison methods; predictions thresholded to maximizeF 1. Protein-pair splitting is not evidence of disjoint proteins or families. 41,600 protein pairs; balanced functional-identity classes; random 56.25/18.75/25% training/validation/test split.
Source order is preserved. Plotted marks show point estimates; uncertainty, where reported, is retained in the printed values and table. Differences do not establish statistical significance.
Enhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1: ACC (%), Enzyme-pair functional identity: original held-out testSource transcription and grouping reviewed by automated source review on 2026-09-17. These experiments were not independently reproduced by rewire.
Release 2026-09-17-d277315f7d76 · 5 evaluations · 40 metric rows. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| FUJISAN: Enzyme functional identity prediction Configuration: FUJISANProtocol: Enzyme-pair functional identity: original held-out test (Enzyme functional identity prediction)Dataset: FUJISAN test sub-dataset LightGBM FUJISAN and comparison methods; predictions thresholded to maximizeF 1. Protein-pair splitting is not evidence of disjoint proteins or families. 41,600 protein pairs; balanced functional-identity classes; random 56.25/18.75/25% training/validation/test split. Author-reported evaluation · Evaluation metadata: needs review | ||
| 0.9427 AUROC Unit: unitless · Direction: higher | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features; Enhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, FUJISAN row, AUROC column Source checking is not independent reproduction. |
| 87.05% REC (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row FUJISAN, column REC (%); XML row2 column4 Source checking is not independent reproduction. |
| 0.7421 MCC Unit: dimensionless · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row FUJISAN, column MCC; XML row2 column7 Source checking is not independent reproduction. |
| 87.24% PRE (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row FUJISAN, column PRE (%); XML row2 column3 Source checking is not independent reproduction. |
| ESM2: Enzyme functional identity prediction Configuration: ESM2Protocol: Enzyme-pair functional identity: original held-out test (Enzyme functional identity prediction)Dataset: FUJISAN test sub-dataset LightGBM FUJISAN and comparison methods; predictions thresholded to maximizeF 1. Protein-pair splitting is not evidence of disjoint proteins or families. 41,600 protein pairs; balanced functional-identity classes; random 56.25/18.75/25% training/validation/test split. Independent external evaluation · Evaluation metadata: needs review | ||
| 0.7991 AUROC Unit: unitless · Direction: higher | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features; Enhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, ESM2 row, AUROC column Source checking is not independent reproduction. |
| 79.33% REC (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row ESM2, column REC (%); XML row5 column4 Source checking is not independent reproduction. |
| 0.8147 AUPR Unit: dimensionless · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row ESM2, column AUPR; XML row5 column9 Source checking is not independent reproduction. |
| 0.4321 MCC Unit: dimensionless · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row ESM2, column MCC; XML row5 column7 Source checking is not independent reproduction. |
| 68.39% PRE (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row ESM2, column PRE (%); XML row5 column3 Source checking is not independent reproduction. |
| E-value: Enzyme-pair functional identity: original held-out test Configuration: E-valueProtocol: Enzyme-pair functional identity: original held-out test (Enzyme functional identity prediction)Dataset: FUJISAN test sub-dataset LightGBM FUJISAN and comparison methods; predictions thresholded to maximizeF 1. Protein-pair splitting is not evidence of disjoint proteins or families. 41,600 protein pairs; balanced functional-identity classes; random 56.25/18.75/25% training/validation/test split. Author-reported evaluation · Evaluation metadata: needs review | ||
| 78.58% PRE (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row E-value, column PRE (%); XML row3 column3 Source checking is not independent reproduction. |
| 0.8291 F1 Unit: dimensionless · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row E-value, column F1; XML row3 column6 Source checking is not independent reproduction. |
| 0.6427 MCC Unit: dimensionless · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row E-value, column MCC; XML row3 column7 Source checking is not independent reproduction. |
| 23.92% FPR (%) Unit: percent · Direction: lower | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row E-value, column FPR (%); XML row3 column5 Source checking is not independent reproduction. |
| 87.75% REC (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row E-value, column REC (%); XML row3 column4 Source checking is not independent reproduction. |
| 81.91% ACC (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row E-value, column ACC (%); XML row3 column2 Source checking is not independent reproduction. |
| DeepFRI: Enzyme-pair functional identity: original held-out test Configuration: DeepFRIProtocol: Enzyme-pair functional identity: original held-out test (Enzyme functional identity prediction)Dataset: FUJISAN test sub-dataset LightGBM FUJISAN and comparison methods; predictions thresholded to maximizeF 1. Protein-pair splitting is not evidence of disjoint proteins or families. 41,600 protein pairs; balanced functional-identity classes; random 56.25/18.75/25% training/validation/test split. Author-reported evaluation · Evaluation metadata: needs review | ||
| 83.16% REC (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row DeepFRI, column REC (%); XML row4 column4 Source checking is not independent reproduction. |
| 80.88% ACC (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row DeepFRI, column ACC (%); XML row4 column2 Source checking is not independent reproduction. |
| 0.6790 MCC Unit: dimensionless · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row DeepFRI, column MCC; XML row4 column7 Source checking is not independent reproduction. |
| 0.8143 F1 Unit: dimensionless · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row DeepFRI, column F1; XML row4 column6 Source checking is not independent reproduction. |
| Pfam: Enzyme-pair functional identity: original held-out test Configuration: PfamProtocol: Enzyme-pair functional identity: original held-out test (Enzyme functional identity prediction)Dataset: FUJISAN test sub-dataset LightGBM FUJISAN and comparison methods; predictions thresholded to maximizeF 1. Protein-pair splitting is not evidence of disjoint proteins or families. 41,600 protein pairs; balanced functional-identity classes; random 56.25/18.75/25% training/validation/test split. Author-reported evaluation · Evaluation metadata: needs review | ||
| 61.99% ACC (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column ACC (%); XML row6 column2 Source checking is not independent reproduction. |
| 0.3520 MCC Unit: dimensionless · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column MCC; XML row6 column7 Source checking is not independent reproduction. |
| 56.92% PRE (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column PRE (%); XML row6 column3 Source checking is not independent reproduction. |
| 0.7217 F1 Unit: dimensionless · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column F1; XML row6 column6 Source checking is not independent reproduction. |
| 74.62% FPR (%) Unit: percent · Direction: lower | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column FPR (%); XML row6 column5 Source checking is not independent reproduction. |
| 98.60% REC (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column REC (%); XML row6 column4 Source checking is not independent reproduction. |
Last literature check: 2026-09-17. Primary-source discovery and table/protocol screening; source checked is not independently reproduced. Raw acquisitions not automatically numerical publication approval.
| Paper or primary resource | Version | Reference |
|---|---|---|
| Enhanced prediction of protein functional identity through the integration of sequence and structural features | PMC11609699.1 | Read source DOI: 10.1016/j.csbj.2024.11.028 |
complete comparison tables extracted pending publication review
No source-reviewed explanatory claims are recorded here yet.
Targeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change.
Stable record: reported-task-1ebf9b408517f9Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
17 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Diagram caption Conceptual summary of the cited evaluation; exact task configuration and source version remain part of the protocol. Individual claims | Enhanced prediction of protein functional identity through the integration of sequence and structural features Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages Version: PMC11609699.1 | source checked automated source review · 2026-09-16 Audit detailsTargeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Diagram steps ["Input: Pairs of enzyme representations.","Evaluation: Random pair partitions provide training, validation and test subsets; model hyperparameters are tuned using cross-validation.","Readout: Accuracy, false-positive rate, MCC, precision, recall, F1, AUROC and AUPR."] Individual claims | Enhanced prediction of protein functional identity through the integration of sequence and structural features Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages Version: PMC11609699.1 | source checked automated source review · 2026-09-16 Audit detailsTargeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Diagram title Computational evaluation flow Individual claims | Enhanced prediction of protein functional identity through the integration of sequence and structural features Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages Version: PMC11609699.1 | source checked automated source review · 2026-09-16 Audit detailsTargeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Datasets Swiss-Prot reaction annotations and AlphaFold Database structures; balanced same-function and different-function pairs. Individual claims | Enhanced prediction of protein functional identity through the integration of sequence and structural features Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages Version: PMC11609699.1 | source checked automated source review · 2026-09-16 Audit detailsTargeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Splits Random pair partitions provide training, validation and test subsets; model hyperparameters are tuned using cross-validation. Individual claims | Enhanced prediction of protein functional identity through the integration of sequence and structural features Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages Version: PMC11609699.1 | source checked automated source review · 2026-09-16 Audit detailsTargeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Adaptation Supervised same-function classification; hyperparameters use cross-validation, with algorithm choice additionally compared on test data. Individual claims | Enhanced prediction of protein functional identity through the integration of sequence and structural features Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages Version: PMC11609699.1 | source checked automated source review · 2026-09-16 Audit detailsTargeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Metrics Accuracy, false-positive rate, MCC, precision, recall, F1, AUROC and AUPR. Individual claims | Enhanced prediction of protein functional identity through the integration of sequence and structural features Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages Version: PMC11609699.1 | source checked automated source review · 2026-09-16 Audit detailsTargeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Baselines LightGBM and multiple conventional classifiers. Individual claims | Enhanced prediction of protein functional identity through the integration of sequence and structural features Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages Version: PMC11609699.1 | source checked automated source review · 2026-09-16 Audit detailsTargeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Leakage controls The low-sequence-similarity evaluation excludes pairs from the original dataset; random splitting of the main pair dataset does not establish protein-identity holdout. Individual claims | Enhanced prediction of protein functional identity through the integration of sequence and structural features Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages Version: PMC11609699.1 | source checked automated source review · 2026-09-16 Audit detailsTargeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
| Uncertainty The paper assesses stability using repeated bootstrap iterations; its sampling unit must remain attached to the reported interval. Individual claims | Enhanced prediction of protein functional identity through the integration of sequence and structural features Methods: Dataset construction; classification and metrics; Results: model comparison; cached text lines 10–11, 25, 28, 52, 55; uncertainty/repeat-run/statistical-comparison passages Version: PMC11609699.1 | source checked automated source review · 2026-09-16 Audit detailsTargeted full-paper and supplement review of the outstanding task fields, with original dataset metadata checked where accessible. Source-scoped omissions are explicit; no independent benchmark reproduction or numerical-result change. Field: Source artifact SHA-256: Hash scope: Hash scope not separately documented; inspect source record |
Release 2026-09-17-d277315f7d76 · Record review: needs review
Stable ID: reported-task-1ebf9b408517f9