rewire.it
Configuration

ESM3

Protein model evaluated by the ProteinBench authors under their harness.

26 evaluations · 26 metric rows

Overview

Protein model evaluated by the ProteinBench authors under their harness.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

Release 2026-09-17-134cd1815de8 · 26 evaluations · 26 metric rows. Different protocols are not a single leaderboard. Where several source tables report the same metric, the published comparisons above offer a pooled view that names what it does not hold constant.

Results grouped by the exact reported evaluation
Metric and findingCoverage and uncertaintyEvidence
ESM3 on ProteinBench CO-LENGTH-100-DIVERSITY-MAX-CLUST: length 100, Diversity Max Clust.

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.64 max-clust

Unit: score · Direction: higher

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 100, Diversity Max Clust. ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-100-NOVELTY-MAX-TM: length 100, Novelty Max TM

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.41 max-tm

Unit: score · Direction: lower

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 100, Novelty Max TM ↓)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-100-QUALITY-SCRMSD: length 100, Quality scRMSD

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

13.80 ± 10.51 scrmsd

Unit: score · Direction: lower

Uncertainty: type: standard deviation; value: 10.51

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 100, Quality scRMSD ↓)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-100-QUALITY-SCTM: length 100, Quality scTM

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.72 ± 0.19 sctm

Unit: score · Direction: higher

Uncertainty: type: standard deviation; value: 0.19

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 100, Quality scTM ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-200-DIVERSITY-MAX-CLUST: length 200, Diversity Max Clust.

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.63 max-clust

Unit: score · Direction: higher

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 200, Diversity Max Clust. ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-200-NOVELTY-MAX-TM: length 200, Novelty Max TM

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.61 max-tm

Unit: score · Direction: lower

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 200, Novelty Max TM ↓)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-200-QUALITY-SCRMSD: length 200, Quality scRMSD

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

21.18 ± 16.19 scrmsd

Unit: score · Direction: lower

Uncertainty: type: standard deviation; value: 16.19

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 200, Quality scRMSD ↓)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-200-QUALITY-SCTM: length 200, Quality scTM

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.63 ± 0.20 sctm

Unit: score · Direction: higher

Uncertainty: type: standard deviation; value: 0.20

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 200, Quality scTM ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-300-DIVERSITY-MAX-CLUST: length 300, Diversity Max Clust.

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.52 max-clust

Unit: score · Direction: higher

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 300, Diversity Max Clust. ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-300-NOVELTY-MAX-TM: length 300, Novelty Max TM

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.73 max-tm

Unit: score · Direction: lower

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 300, Novelty Max TM ↓)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-300-QUALITY-SCRMSD: length 300, Quality scRMSD

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

25.5 ± 20.68 scrmsd

Unit: score · Direction: lower

Uncertainty: type: standard deviation; value: 20.68

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 300, Quality scRMSD ↓)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-300-QUALITY-SCTM: length 300, Quality scTM

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.59 ± 0.21 sctm

Unit: score · Direction: higher

Uncertainty: type: standard deviation; value: 0.21

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 300, Quality scTM ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-500-DIVERSITY-MAX-CLUST: length 500, Diversity Max Clust.

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.46 max-clust

Unit: score · Direction: higher

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 500, Diversity Max Clust. ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-500-NOVELTY-MAX-TM: length 500, Novelty Max TM

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.78 max-tm

Unit: score · Direction: lower

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 500, Novelty Max TM ↓)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-500-QUALITY-SCRMSD: length 500, Quality scRMSD

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

26.72 ± 21.08 scrmsd

Unit: score · Direction: lower

Uncertainty: type: standard deviation; value: 21.08

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 500, Quality scRMSD ↓)

Source checking is not independent reproduction.

ESM3 on ProteinBench CO-LENGTH-500-QUALITY-SCTM: length 500, Quality scTM

Joint structure and sequence generation at a fixed length. Values are the mean and standard deviation over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.64 ± 0.20 sctm

Unit: score · Direction: higher

Uncertainty: type: standard deviation; value: 0.20

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 5, row(ESM3*), column(length 500, Quality scTM ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench IF-DE-NOVO-BACKBONES-BASED-SEQUENCE-DESIGN-LENGTH-100-PLDDT: De novo backbones based sequence design, length 100 pLDDT

Inverse folding: recover a sequence for a given backbone. Values are the median over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

86.60 plddt

Unit: score · Direction: higher

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 2, row(ESM3), column(De novo backbones based sequence design, length 100 pLDDT ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench IF-DE-NOVO-BACKBONES-BASED-SEQUENCE-DESIGN-LENGTH-100-SCTM: De novo backbones based sequence design, length 100 scTM

Inverse folding: recover a sequence for a given backbone. Values are the median over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.942 sctm

Unit: score · Direction: higher

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 2, row(ESM3), column(De novo backbones based sequence design, length 100 scTM ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench IF-DE-NOVO-BACKBONES-BASED-SEQUENCE-DESIGN-LENGTH-200-PLDDT: De novo backbones based sequence design, length 200 pLDDT

Inverse folding: recover a sequence for a given backbone. Values are the median over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

60.69 plddt

Unit: score · Direction: higher

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 2, row(ESM3), column(De novo backbones based sequence design, length 200 pLDDT ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench IF-DE-NOVO-BACKBONES-BASED-SEQUENCE-DESIGN-LENGTH-200-SCTM: De novo backbones based sequence design, length 200 scTM

Inverse folding: recover a sequence for a given backbone. Values are the median over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.486 sctm

Unit: score · Direction: higher

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 2, row(ESM3), column(De novo backbones based sequence design, length 200 scTM ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench IF-DE-NOVO-BACKBONES-BASED-SEQUENCE-DESIGN-LENGTH-300-PLDDT: De novo backbones based sequence design, length 300 pLDDT

Inverse folding: recover a sequence for a given backbone. Values are the median over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

70.78 plddt

Unit: score · Direction: higher

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 2, row(ESM3), column(De novo backbones based sequence design, length 300 pLDDT ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench IF-DE-NOVO-BACKBONES-BASED-SEQUENCE-DESIGN-LENGTH-300-SCTM: De novo backbones based sequence design, length 300 scTM

Inverse folding: recover a sequence for a given backbone. Values are the median over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.632 sctm

Unit: score · Direction: higher

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 2, row(ESM3), column(De novo backbones based sequence design, length 300 scTM ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench IF-DE-NOVO-BACKBONES-BASED-SEQUENCE-DESIGN-LENGTH-400-PLDDT: De novo backbones based sequence design, length 400 pLDDT

Inverse folding: recover a sequence for a given backbone. Values are the median over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

62.63 plddt

Unit: score · Direction: higher

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 2, row(ESM3), column(De novo backbones based sequence design, length 400 pLDDT ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench IF-DE-NOVO-BACKBONES-BASED-SEQUENCE-DESIGN-LENGTH-400-SCTM: De novo backbones based sequence design, length 400 scTM

Inverse folding: recover a sequence for a given backbone. Values are the median over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

0.564 sctm

Unit: score · Direction: higher

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 2, row(ESM3), column(De novo backbones based sequence design, length 400 scTM ↑)

Source checking is not independent reproduction.

ESM3 on ProteinBench IF-DE-NOVO-BACKBONES-BASED-SEQUENCE-DESIGN-LENGTH-500-PLDDT: De novo backbones based sequence design, length 500 pLDDT

Inverse folding: recover a sequence for a given backbone. Values are the median over repeated runs.

Author-reported evaluation · Evaluation metadata: source checked

59.37 plddt

Unit: score · Direction: higher

Uncertainty: Not reported

Scored: Not reported · Eligible: Not reported

source checkedproteinbench primary benchmark evidence · Table 2, row(ESM3), column(De novo backbones based sequence design, length 500 pLDDT ↑)

Source checking is not independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters

Claims, original sources and review scope · Release 2026-09-17-134cd1815de8
Property and statementOriginal source and locationReview and provenance

No evidence rows match these filters. Choose another scope or clear the search.

Sources and history

Release 2026-09-17-134cd1815de8 · Record review: source checked

1 source records and release historyDownload this release
Technical metadata and extraction receipts

Stable ID: proteinbench-method-esm3

areas
proteins-complexes
source locator
Table 2, row(ESM3)
missing metadata
checkpoint revision: unreported; parameters: unextracted
Related records

Suggest a correction