.803 AUROC
structure-informed pLM · AUROC · variant-effects benchmark
- Tested model
- structure-informed pLM
- Task or benchmark
- protein variant-effect classification
- Dataset
- variant-effects benchmark
- Procedure
- combined amino-acid, secondary structure, solvent accessibility and contact-map scoring
- Evaluation
- structure-informed pLM: protein variant-effect classification
- Evidence
- Author-reported evaluation · source checkedStructure-Informed Protein Language Models are Robust Predictors for Variant Effects · PMC12068927 HTML, Table4, AA+SS+RSA+CM row, AUROC column
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: needs review. Source checked does not mean independently reproduced.
Evaluation results
Release 2026-09-16-d74d282221a9 · 1 evaluation · 1 metric row. Different protocols are not a single leaderboard.
| Metric and finding | Coverage and uncertainty | Evidence |
|---|---|---|
| structure-informed pLM: protein variant-effect classification Model: structure-informed pLM · Benchmark: protein variant-effect classification · Dataset: variant-effects benchmark combined amino-acid, secondary structure, solvent accessibility and contact-map scoring Author-reported evaluation · Evaluation metadata: needs review | ||
| .803 AUROC Unit: fraction · Direction: unknown | Uncertainty: not reported in legacy extract Scored: Not reported · Eligible: Not reported | source checkedStructure-Informed Protein Language Models are Robust Predictors for Variant Effects · PMC12068927 HTML, Table4, AA+SS+RSA+CM row, AUROC column Source checking is not independent reproduction. |
Sources and history
Release 2026-09-16-d74d282221a9 · Record review: source checked
- Structure-Informed Protein Language Models are Robust Predictors for Variant Effects · Original source · Human Genetics 2025 journal article (online 2024)
Technical metadata and extraction receipts
Stable ID: b2-structure-informed-plm-2025
- areas
- proteins-complexes
- tasks
- protein variant-effect classification
- printed value
- .803
- numeric value
- 0.803
- metric
- AUROC
- metric direction
- unknown
- unit
- fraction
- uncertainty
- Not reported
- source locator
- PMC12068927 HTML, Table4, AA+SS+RSA+CM row, AUROC column
- review
- method: independent_ai_table_review; reviewer: Codex omics research agent; independent source review, not human review; reviewed at: 2026-09-16T10:45:41.099916+00:00; notes: Full-text HTML succeeds although EuropePMC XMLreturned404. Row is mutation-site variables AA+SS+RSA+CM, not neighbouring environment variant. AUROC .803 is numerically equivalent to preserved legacy0.803. Source check, not experimental reproduction; do not claim original source printed leading zero.; evidence: Table4 headers: Type, Variable(s), Spearman rho, AUROC, AUPRC. Parsed HTML row: AA+SS+RSA+CM | .552 | .803 | .792. Primary web rendering independently confirms columns.; artifact sha256: 76082e1cd992d2c09c38f86d05aba575cc76c5022b53a297123b713bb1ce9267; retrieval url: https://pmc.ncbi.nlm.nih.gov/articles/PMC12068927/
- legacy id
- b2-structure-informed-plm-2025
- legacy row
- id: b2-structure-informed-plm-2025; paper id: structure-informed-plm-2025; domain id: proteins-complexes; task: protein variant-effect classification; model: structure-informed pLM; model version: not stated in table; dataset: variant-effects benchmark; dataset version: Not reported; split: paper evaluation; metric: AUROC; value: 0.803; unit: fraction; uncertainty: Not reported; protocol: combined amino-acid, secondary structure, solvent accessibility and contact-map scoring; source locator: Table 4, AA+SS+RSA+CM row, AUROC column; source url: https://pmc.ncbi.nlm.nih.gov/articles/PMC12068927/; evaluation origin: author_reported; reviewed utc: 2026-09-15T23:33:26Z
- missing metadata
- dataset version: not_reported_in_legacy_extract; uncertainty: not_reported_in_legacy_extract