Configuration

Embed. MSAT

Supervised fitness predictor evaluated by the ProteinGym authors. The leading term is the input representation the paper's model type column gives.

8 evaluations · 8 metric rows

Overview

Supervised fitness predictor evaluated by the ProteinGym authors. The leading term is the input representation the paper's model type column gives.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

Release 2026-09-17-134cd1815de8 · 8 evaluations · 8 metric rows. Different protocols are not a single leaderboard. Where several source tables report the same metric, the published comparisons above offer a pooled view that names what it does not hold constant.

Evaluation setupMetricEvidence origin

Results grouped by the exact reported evaluation
Metric and finding	Coverage and uncertainty	Evidence
Embed. MSAT on ProteinGym SUP-SUB-MSE-AVG: Supervised substitutions, average over splits, MSE Configuration: Embed. MSATTask: ProteinGym SUP-SUB-MSE-AVG: Supervised substitutions, average over splits, MSEDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Supervised fitness prediction under three cross-validation schemes: contiguous, modulo and random splits. Author-reported evaluation · Evaluation metadata: source checked
0.735 mse Unit: error · Direction: lower	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 3, row(MSAT), column(Supervised substitutions, average over splits, MSE) Source checking is not independent reproduction.
Embed. MSAT on ProteinGym SUP-SUB-MSE-CONTIG: Supervised substitutions, contiguous split, MSE Configuration: Embed. MSATTask: ProteinGym SUP-SUB-MSE-CONTIG: Supervised substitutions, contiguous split, MSEDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Supervised fitness prediction under three cross-validation schemes: contiguous, modulo and random splits. Author-reported evaluation · Evaluation metadata: source checked
0.836 mse Unit: error · Direction: lower	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 3, row(MSAT), column(Supervised substitutions, contiguous split, MSE) Source checking is not independent reproduction.
Embed. MSAT on ProteinGym SUP-SUB-MSE-MOD: Supervised substitutions, modulo split, MSE Configuration: Embed. MSATTask: ProteinGym SUP-SUB-MSE-MOD: Supervised substitutions, modulo split, MSEDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Supervised fitness prediction under three cross-validation schemes: contiguous, modulo and random splits. Author-reported evaluation · Evaluation metadata: source checked
0.795 mse Unit: error · Direction: lower	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 3, row(MSAT), column(Supervised substitutions, modulo split, MSE) Source checking is not independent reproduction.
Embed. MSAT on ProteinGym SUP-SUB-MSE-RAND: Supervised substitutions, random split, MSE Configuration: Embed. MSATTask: ProteinGym SUP-SUB-MSE-RAND: Supervised substitutions, random split, MSEDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Supervised fitness prediction under three cross-validation schemes: contiguous, modulo and random splits. Author-reported evaluation · Evaluation metadata: source checked
0.573 mse Unit: error · Direction: lower	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 3, row(MSAT), column(Supervised substitutions, random split, MSE) Source checking is not independent reproduction.
Embed. MSAT on ProteinGym SUP-SUB-SPEARMAN-AVG: Supervised substitutions, average over splits, Spearman Configuration: Embed. MSATTask: ProteinGym SUP-SUB-SPEARMAN-AVG: Supervised substitutions, average over splits, SpearmanDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Supervised fitness prediction under three cross-validation schemes: contiguous, modulo and random splits. Author-reported evaluation · Evaluation metadata: source checked
0.568 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 3, row(MSAT), column(Supervised substitutions, average over splits, Spearman) Source checking is not independent reproduction.
Embed. MSAT on ProteinGym SUP-SUB-SPEARMAN-CONTIG: Supervised substitutions, contiguous split, Spearman Configuration: Embed. MSATTask: ProteinGym SUP-SUB-SPEARMAN-CONTIG: Supervised substitutions, contiguous split, SpearmanDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Supervised fitness prediction under three cross-validation schemes: contiguous, modulo and random splits. Author-reported evaluation · Evaluation metadata: source checked
0.525 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 3, row(MSAT), column(Supervised substitutions, contiguous split, Spearman) Source checking is not independent reproduction.
Embed. MSAT on ProteinGym SUP-SUB-SPEARMAN-MOD: Supervised substitutions, modulo split, Spearman Configuration: Embed. MSATTask: ProteinGym SUP-SUB-SPEARMAN-MOD: Supervised substitutions, modulo split, SpearmanDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Supervised fitness prediction under three cross-validation schemes: contiguous, modulo and random splits. Author-reported evaluation · Evaluation metadata: source checked
0.538 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 3, row(MSAT), column(Supervised substitutions, modulo split, Spearman) Source checking is not independent reproduction.
Embed. MSAT on ProteinGym SUP-SUB-SPEARMAN-RAND: Supervised substitutions, random split, Spearman Configuration: Embed. MSATTask: ProteinGym SUP-SUB-SPEARMAN-RAND: Supervised substitutions, random split, SpearmanDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Supervised fitness prediction under three cross-validation schemes: contiguous, modulo and random splits. Author-reported evaluation · Evaluation metadata: source checked
0.642 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 3, row(MSAT), column(Supervised substitutions, random split, Spearman) Source checking is not independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters