Configuration

EVmutation

Fitness prediction model evaluated by the ProteinGym authors under their harness.

Overview

Fitness prediction model evaluated by the ProteinGym authors under their harness.

Consult the linked sources for architecture or protocol details. Missing evidence is not evidence of a missing capability.

Evaluations and results

Release 2026-09-17-134cd1815de8 · 5 evaluations · 5 metric rows. Different protocols are not a single leaderboard. Where several source tables report the same metric, the published comparisons above offer a pooled view that names what it does not hold constant.

Evaluation setupMetricEvidence origin

Results grouped by the exact reported evaluation
Metric and finding	Coverage and uncertainty	Evidence
EVmutation on ProteinGym ZS-SUB-AUC: Zero-shot substitutions, AUC Configuration: EVmutationTask: ProteinGym ZS-SUB-AUC: Zero-shot substitutions, AUCDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Author-reported evaluation · Evaluation metadata: source checked
0.716 auc Unit: fraction · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(EVmutation), column(Zero-shot substitutions, AUC) Source checking is not independent reproduction.
EVmutation on ProteinGym ZS-SUB-MCC: Zero-shot substitutions, MCC Configuration: EVmutationTask: ProteinGym ZS-SUB-MCC: Zero-shot substitutions, MCCDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Author-reported evaluation · Evaluation metadata: source checked
0.305 mcc Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(EVmutation), column(Zero-shot substitutions, MCC) Source checking is not independent reproduction.
EVmutation on ProteinGym ZS-SUB-NDCG: Zero-shot substitutions, NDCG@10% Configuration: EVmutationTask: ProteinGym ZS-SUB-NDCG: Zero-shot substitutions, NDCG@10%Dataset subset: ProteinGym substitution DMS assays (ProteinGym split) Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Author-reported evaluation · Evaluation metadata: source checked
0.777 ndcg Unit: fraction · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(EVmutation), column(Zero-shot substitutions, NDCG@10%) Source checking is not independent reproduction.
EVmutation on ProteinGym ZS-SUB-RECALL: Zero-shot substitutions, top 10% recall Configuration: EVmutationTask: ProteinGym ZS-SUB-RECALL: Zero-shot substitutions, top 10% recallDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Author-reported evaluation · Evaluation metadata: source checked
0.222 recall Unit: fraction · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(EVmutation), column(Zero-shot substitutions, top 10% recall) Source checking is not independent reproduction.
EVmutation on ProteinGym ZS-SUB-SPEARMAN: Zero-shot substitutions, Spearman Configuration: EVmutationTask: ProteinGym ZS-SUB-SPEARMAN: Zero-shot substitutions, SpearmanDataset subset: ProteinGym substitution DMS assays (ProteinGym split) Zero-shot scoring of substitution assays, averaged over assays with the correction the paper describes. Author-reported evaluation · Evaluation metadata: source checked
0.395 spearman Unit: correlation · Direction: higher	Uncertainty: Not reported Scored: Not reported · Eligible: Not reported	source checkedProteinGym: Large-Scale Benchmarks for Protein Fitness Prediction and Design · Table 2, row(EVmutation), column(Zero-shot substitutions, Spearman) Source checking is not independent reproduction.

Evidence table

Inspect claims, sources and review details

Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.

One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.

0 evidence rows matching the loaded filters