Strengths supported by sources
- Assay-level analysis distinguishes effects measured under different biological conditions.OATML-Markslab/ProteinGym official source · ProteinGym README: Overview; Results; Resources
benchmark · task
ProteinGym mutation effects
Protein mutation-effect evaluation asks whether scores order variants consistently with measured assay effects.
At a glance
Explanatory profile: source reviewed · Automated source review, 2026-09-16. This does not change the review status of its results.
| Property | Description and evidence |
|---|---|
| Record type | Generic task linked to a suiteOATML-Markslab/ProteinGym official source · ProteinGym README: Overview; Results; Resources |
| Inputs | Protein variants and experimental assay measurementsOATML-Markslab/ProteinGym official source · ProteinGym README: Overview; Results; Resources |
| Assessment | Within-assay ranking and protocol-specific aggregationOATML-Markslab/ProteinGym official source · ProteinGym README: Overview; Results; Resources |
| Datasets | Not extracted or verified for this record. |
| Organisms | Not extracted or verified for this record. |
| Assays | Not extracted or verified for this record. |
| Splits | Not extracted or verified for this record. |
| Adaptation | Not extracted or verified for this record. |
| Baselines | Not extracted or verified for this record. |
How it works
Conceptual design only. This generic task has no fixed executable protocol and does not imply a completed run.
Read the diagram as text
- Choose matched biological data
- Define held-out evaluation
- Apply candidate methods
- Assess the specified endpoint
Procedure
ProteinGym provides concrete assay releases and evaluation tracks. Select the assay, permitted model inputs and supervision regime before using its scoring and aggregation procedure.
OATML-Markslab/ProteinGym official source · ProteinGym README: Overview; Results; ResourcesConnected tasks and protocols
- ProteinGym · suite · evaluates task
These associations do not imply identical protocols or interchangeable scores.
Tested models and results
Release 2026-09-16-d74d282221a9 · 0 evaluations · 0 metric rows. Different protocols are not a single leaderboard.
No evaluations linked in this release.
Strengths and limitations
Limitations and conditions
- This generic task does not fix one ProteinGym release or train/test split.OATML-Markslab/ProteinGym official source · ProteinGym README: Overview; Results; Resources
Profile review details
Primary-source description checked by an automated research assistant. This is profile review, not independent execution or numerical reproduction.
Stable record: catalog-task-proteingym-effectsSources and history
Release 2026-09-16-d74d282221a9 · Record review: discovered
- MIMIC official resource · Original source · Not reported
- ESM-2 official resource · Original source · Not reported
- ProteinMPNN official resource · Original source · Not reported
- OATML-Markslab/ProteinGym official source · Original source · 144fe22b07dfaeec2b366f2346203a9838a55b4c
Technical metadata and extraction receipts
Stable ID: catalog-task-proteingym-effects
- areas
- proteins-complexes
- entity level
- task
- version
- Not reported
- task
- ProteinGym mutation effects
- scope note
- Rank substitution effects within held-out deep-mutational-scanning assays.
- missing metadata
- protocol version: not_yet_extracted
Related records
- evaluates task: ProteinGym