result · source checked
0.796 F1 macro-weighted
SPIN + ESM2-35M · F1 macro-weighted · TRX
- Tested model
- SPIN + ESM2-35M
- Task or benchmark
- protein function annotation
- Dataset
- TRX
- Procedure
- frozen ESM2-35M backbone in SPIN
- Evaluation
- SPIN + ESM2-35M: protein function annotation
- Evidence
- Author-reported evaluation · source checkedScaling the profile of life by function with SPIN · Table 1, ESM2-35M Test row, F1_m-w column
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.
Evaluation results
Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| SPIN + ESM2-35M: protein function annotation frozen ESM2-35M backbone in SPIN Author-reported evaluation · Evaluation metadata: needs review | ||
| 0.796 F1 macro-weighted Unit: fraction · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedScaling the profile of life by function with SPIN · Table 1, ESM2-35M Test row, F1_m-w column Source checking is not independent reproduction. |
Sources and history
Release 2026-09-16-d74d282221a9 · Record review: source checked
- Scaling the profile of life by function with SPIN · Original source · journal full text in PMC
Technical metadata and extraction receipts
Stable ID: b2-spin-protein-function-2026
- areas
- proteins-complexes
- tasks
- protein function annotation
- printed value
- 0.796
- numeric value
- 0.796
- metric
- F1 macro-weighted
- metric direction
- unknown
- unit
- fraction
- uncertainty
- Not reported
- source locator
- Table 1, ESM2-35M Test row, F1_m-w column
- review
- method: independent_ai_table_review; reviewer: Codex secondary table review; reviewed at: 2026-09-16T10:38:57.558225+00:00; notes: Resolved Test group and macro-weighted F1 subcolumn (0.796) for frozen ESM2-35M in SPIN. Test weighted accuracy is 0.798. Methods define inverse-frequency class weighting for macro-weighted F1.; evidence: Original PMC XML table headers, row groups and caption inspected; printed value 0.796.; artifact sha256: 9701843e93bf7fa3ead71e19693fb07d483f1022379871adfb04486783722a9d; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC12970593/fullTextXML
- legacy id
- b2-spin-protein-function-2026
- legacy row
- id: b2-spin-protein-function-2026; paper id: spin-protein-function-2026; domain id: proteins-complexes; task: protein function annotation; model: SPIN + ESM2-35M; model version: ESM2-35M frozen; dataset: TRX; dataset version: Not reported; split: test set; metric: F1 macro-weighted; value: 0.796; unit: fraction; uncertainty: Not reported; protocol: frozen ESM2-35M backbone in SPIN; source locator: Table 1, ESM2-35M Test row, F1_m-w column; source url: https://pmc.ncbi.nlm.nih.gov/articles/PMC12970593/; evaluation origin: author_reported; reviewed utc: 2026-09-15T23:33:26Z
- missing metadata
- dataset version: not_reported_in_legacy_extract; uncertainty: not_reported_in_legacy_extract