benchmark · task

protein function annotation

This paper-specific evaluation tests protein function annotation using TRX.

At a glance

Explanatory profile: limited source coverage · Automated source review, 2026-09-16. This does not change the review status of its results.

Data, procedure and scoring
Property	Description and evidence
Record type	Paper-specific task; protocol incompletely extractedScaling the profile of life by function with SPIN · Table 1, ESM2-35M Test row, F1_m-w column
Inputs	TRXScaling the profile of life by function with SPIN · Table 1, ESM2-35M Test row, F1_m-w column
Assessment	F1 macro-weightedScaling the profile of life by function with SPIN · Table 1, ESM2-35M Test row, F1_m-w column
Recorded split or evaluation setting	test setScaling the profile of life by function with SPIN · Table 1, ESM2-35M Test row, F1_m-w column
Datasets	Not extracted or verified for this record.
Organisms	Not extracted or verified for this record.
Assays	Not extracted or verified for this record.
Adaptation	Not extracted or verified for this record.
Baselines	Not extracted or verified for this record.

How it works

Reported evaluation outline

Outline of the existing paper extraction. Split membership, fitting details and scorer implementation remain incompletely reviewed.

Read the diagram as text

TRX
Recorded fitting or scoring procedure
Assess F1 macro-weighted

Scaling the profile of life by function with SPIN · Table 1, ESM2-35M Test row, F1_m-w column

Evaluation context

The existing paper extraction describes: frozen ESM2-35M backbone in SPIN. This description is retained with the exact evaluation records; it is not a new protocol reconstruction.

Scaling the profile of life by function with SPIN · Table 1, ESM2-35M Test row, F1_m-w column

Tested models and results

Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.

Evaluated configurationMetricEvidence origin

Results grouped by the exact reported evaluation
Metric and finding	Coverage and uncertainty	Evidence
SPIN + ESM2-35M: protein function annotation Model: SPIN + ESM2-35M · Benchmark: protein function annotation · Dataset: TRX frozen ESM2-35M backbone in SPIN Author-reported evaluation · Evaluation metadata: needs review
0.796 F1 macro-weighted Unit: fraction · Direction: unknown	Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported	source checkedScaling the profile of life by function with SPIN · Table 1, ESM2-35M Test row, F1_m-w column Source checking is not independent reproduction.

Strengths and limitations

Strengths and considerations

The linked evaluation identifies the paper-specific dataset and assessment rather than treating the task name as a universal benchmark.Scaling the profile of life by function with SPIN · Table 1, ESM2-35M Test row, F1_m-w column

Limitations and conditions

The numerical table check does not establish the full data-processing, fitting or leakage-control protocol.Scaling the profile of life by function with SPIN · Table 1, ESM2-35M Test row, F1_m-w column

Profile review details

Catalogue extraction inspected; protocol claims remain limited to the cited evidence. Missing details are not presumed absent from the original paper.

Stable record: reported-task-c4a578065f44b2

Sources and history

Release 2026-09-16-d74d282221a9 · Record review: needs review

Scaling the profile of life by function with SPIN · Original source · journal full text in PMC

Download this release

Technical metadata and extraction receipts

Stable ID: reported-task-c4a578065f44b2

areas: proteins-complexes
tasks: protein function annotation
entity level: task
version: Not reported
task: protein function annotation
scope note: Paper-specific evaluation task; protocol completeness requires further extraction.
missing metadata: protocol version: not_reported_in_legacy_extract

Related records

dataset: TRX
benchmark: SPIN + ESM2-35M: protein function annotation

Suggest a correction