Pfam: Enzyme-pair functional identity: original held-out test
LightGBM FUJISAN and comparison methods; predictions thresholded to maximizeF 1. Protein-pair splitting is not evidence of disjoint proteins or families. 41,600 protein pairs; balanced functional-identity classes; random 56.25/18.75/25% training/validation/test split.
Evaluation procedure
LightGBM FUJISAN and comparison methods; predictions thresholded to maximizeF 1. Protein-pair splitting is not evidence of disjoint proteins or families. 41,600 protein pairs; balanced functional-identity classes; random 56.25/18.75/25% training/validation/test split.
- Configuration
- Pfam
- Protocol
- Enzyme-pair functional identity: original held-out test (Enzyme functional identity prediction)
- Dataset
- FUJISAN test sub-dataset
- origin
- Author-reported evaluation
- configuration
- Paper-specific evaluated pipeline; exact checkpoint not inferred from label
- protocol id
- paper-protocol-7088bcc2f0033b8a29
- dataset version
- Not reported
- split
- 41,600 protein pairs; balanced functional-identity classes; random 56.25/18.75/25% training/validation/test split.
- subset
- Enzyme-pair functional identity: original held-out test
- population
- Not reported
- aggregation
- Not reported
- inputs
- Not reported
- adaptation
- Paper-specific evaluated pipeline; exact checkpoint not inferred from label
- budget
- Not reported
- metric implementation
- Not reported
Metadata review: needs review. Unreported conditions prevent automatic comparisons.
Evaluation results
Release 2026-09-17-d277315f7d76 · 1 evaluation · 8 metric rows. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| Pfam: Enzyme-pair functional identity: original held-out test Configuration: PfamProtocol: Enzyme-pair functional identity: original held-out test (Enzyme functional identity prediction)Dataset: FUJISAN test sub-dataset LightGBM FUJISAN and comparison methods; predictions thresholded to maximizeF 1. Protein-pair splitting is not evidence of disjoint proteins or families. 41,600 protein pairs; balanced functional-identity classes; random 56.25/18.75/25% training/validation/test split. Author-reported evaluation · Evaluation metadata: needs review | ||
| 61.99% ACC (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column ACC (%); XML row6 column2 Source checking is not independent reproduction. |
| 0.3520 MCC Unit: dimensionless · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column MCC; XML row6 column7 Source checking is not independent reproduction. |
| 56.92% PRE (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column PRE (%); XML row6 column3 Source checking is not independent reproduction. |
| 0.7217 F1 Unit: dimensionless · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column F1; XML row6 column6 Source checking is not independent reproduction. |
| 74.62% FPR (%) Unit: percent · Direction: lower | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column FPR (%); XML row6 column5 Source checking is not independent reproduction. |
| 98.60% REC (%) Unit: percent · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column REC (%); XML row6 column4 Source checking is not independent reproduction. |
| – AUROC Unit: unitless · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column AUROC; XML row6 column8 Source checking is not independent reproduction. |
| – AUPR Unit: dimensionless · Direction: higher | Uncertainty: unreported Scored: Not reported · Eligible: Not reported | source checkedEnhanced prediction of protein functional identity through the integration of sequence and structural features · Table 1, row Pfam, column AUPR; XML row6 column9 Source checking is not independent reproduction. |
Evidence table
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
19 evidence rows matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| attributes.comparison.adaptation Paper-specific evaluated pipeline; exact checkpoint not inferred from label Context-only references | Enhanced prediction of protein functional identity through the integration of sequence and structural features Table 1: ACC (%), Enzyme-pair functional identity: original held-out test Version: PMC11609699.1 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.aggregation No value recorded Context-only references | Enhanced prediction of protein functional identity through the integration of sequence and structural features Table 1: ACC (%), Enzyme-pair functional identity: original held-out test Version: PMC11609699.1 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.budget No value recorded Context-only references | Enhanced prediction of protein functional identity through the integration of sequence and structural features Table 1: ACC (%), Enzyme-pair functional identity: original held-out test Version: PMC11609699.1 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.dataset_version No value recorded Context-only references | Enhanced prediction of protein functional identity through the integration of sequence and structural features Table 1: ACC (%), Enzyme-pair functional identity: original held-out test Version: PMC11609699.1 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.inputs No value recorded Context-only references | Enhanced prediction of protein functional identity through the integration of sequence and structural features Table 1: ACC (%), Enzyme-pair functional identity: original held-out test Version: PMC11609699.1 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.metric_implementation No value recorded Context-only references | Enhanced prediction of protein functional identity through the integration of sequence and structural features Table 1: ACC (%), Enzyme-pair functional identity: original held-out test Version: PMC11609699.1 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.population No value recorded Context-only references | Enhanced prediction of protein functional identity through the integration of sequence and structural features Table 1: ACC (%), Enzyme-pair functional identity: original held-out test Version: PMC11609699.1 | missing or unspecified No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.protocol_id paper-protocol-7088bcc2f0033b8a29 Context-only references | Enhanced prediction of protein functional identity through the integration of sequence and structural features Table 1: ACC (%), Enzyme-pair functional identity: original held-out test Version: PMC11609699.1 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.split 41,600 protein pairs; balanced functional-identity classes; random 56.25/18.75/25% training/validation/test split. Context-only references | Enhanced prediction of protein functional identity through the integration of sequence and structural features Table 1: ACC (%), Enzyme-pair functional identity: original held-out test Version: PMC11609699.1 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
| attributes.comparison.subset Enzyme-pair functional identity: original held-out test Context-only references | Enhanced prediction of protein functional identity through the integration of sequence and structural features Table 1: ACC (%), Enzyme-pair functional identity: original held-out test Version: PMC11609699.1 | not individually reviewed No individual claim review recorded author reported Audit detailsField: Source artifact SHA-256: Hash scope: Exact retrieved primary paper artifact bytes. |
Sources and history
Release 2026-09-17-d277315f7d76 · Record review: needs review
- Enhanced prediction of protein functional identity through the integration of sequence and structural features · Original source · PMC11609699.1
Technical metadata and extraction receipts
Stable ID: paper-evaluation-ab92fd5261f0d65a63
- areas
- proteins-complexes
- tasks
- Enzyme functional identity prediction
- origin
- author_reported
- protocol
- LightGBM FUJISAN and comparison methods; predictions thresholded to maximizeF 1. Protein-pair splitting is not evidence of disjoint proteins or families. 41,600 protein pairs; balanced functional-identity classes; random 56.25/18.75/25% training/validation/test split.
- version
- Paper-specific evaluated pipeline; exact checkpoint not inferred from label
- comparison
- protocol id: paper-protocol-7088bcc2f0033b8a29; dataset version: Not reported; split: 41,600 protein pairs; balanced functional-identity classes; random 56.25/18.75/25% training/validation/test split.; subset: Enzyme-pair functional identity: original held-out test; population: Not reported; aggregation: Not reported; inputs: Not reported; adaptation: Paper-specific evaluated pipeline; exact checkpoint not inferred from label; budget: Not reported; metric implementation: Not reported
- source locator
- Table 1: ACC (%), Enzyme-pair functional identity: original held-out test
- missing metadata
- checkpoint revision: unextracted; budget: unreported; split manifest: unextracted
Related records
- model: Pfam
- benchmark: Enzyme-pair functional identity: original held-out test (Enzyme functional identity prediction)
- dataset: FUJISAN test sub-dataset
- evaluation: Pfam: ACC (%) on Enzyme-pair functional identity: original held-out test
- evaluation: Pfam: MCC on Enzyme-pair functional identity: original held-out test
- evaluation: Pfam: PRE (%) on Enzyme-pair functional identity: original held-out test
- evaluation: Pfam: F1 on Enzyme-pair functional identity: original held-out test
- evaluation: Pfam: FPR (%) on Enzyme-pair functional identity: original held-out test
- evaluation: Pfam: REC (%) on Enzyme-pair functional identity: original held-out test
- evaluation: Pfam: AUROC on Enzyme-pair functional identity: original held-out test
- evaluation: Pfam: AUPR on Enzyme-pair functional identity: original held-out test