rewire.itbenchmarks

← Back to use cases

Metabolomics · Use case

Shortlist molecular identities from tandem mass spectra

Which retrieval configurations merit validation when molecular formula is unknown and a researcher can examine only a short list of candidate structures?

Your decision and inputs

Compare formula-free retrieval configurations within a named split and shortlist size, then validate the intended instrument, chemistry and candidate database before selecting a workflow.

Who this is for
Metabolomics researchers shortlisting candidate molecular identities for experimental confirmation; Computational researchers choosing retrieval inputs, candidate pools and validation splits
Context
Research
Inputs
  • MS/MS spectra with metadata sufficient to derive neutral molecular mass
  • A frozen set of candidate molecular structures; the true identity must be present for the measured retrieval endpoint
Expected output
Split-specific Recall@1 and Recall@20 evidence for six exact configurations, plus candidate-pool and domain-shift limits.
Biological setting
MSAlign paper Table 3, MassSpecGym formula and MCES splits, formula-free inputs. Each source candidate pool contains 256 mass-matched PubChem structures. Formula and MCES splits remain distinct.

Outside this use case

  • De novo molecular generation or cases where the true structure is absent from the candidate set
  • Formula-conditioned retrieval, including MIST, FLARE and MSAlign+Filter
  • Pooling split-specific results or transferring scores to different candidate database sizes
  • Authenticated molecular identification and clinical diagnosis

What this establishes for clinical research

Research only. Candidate retrieval is not a confirmed molecular identification or evidence of clinical diagnostic performance.

Which evaluations inform this question?

Evidence is grouped by its protocol. Relevance refers to the stated endpoint and context; it is separate from clinical validation and from the review method.

MSAlign molecular retrieval MassSpecGym formula split: no formula, R@1: MassSpecGym formula split retrieval with no formula

Current source-reviewed mapping

Proxy evidence: transfer to this question is limited

These source-checked retrieval evaluations inform method selection under explicit candidate and split assumptions; they do not establish accuracy in a new assay or unrestricted chemical search.

Assessed endpoint
Recall@1 of the true molecular structure among 256 mass-matched candidate structures on the MassSpecGym formula split, with no molecular formula supplied.
Evaluation protocol
MSAlign molecular retrieval MassSpecGym formula split: no formula, R@1: MassSpecGym formula split retrieval with no formula
Computational task
A reviewed task relationship is not recorded for this protocol.
Input and population constraints
  • Table 3, MassSpecGym formula split only; Recall@1. Retain all six formula-free configurations from that panel.
  • Candidate sets contain 256 PubChem structures selected with a 10 ppm neutral-mass tolerance. The true molecular identity is assumed to be in the set.
  • The formula data split groups by chemical formula; it does not supply formula to the evaluated models. Formula-conditioned methods and filtering are outside this mapping.
  • These are the source paper implementations and training settings. Exact original-paper or current-release equivalence is not established.
  • Metric groups at different shortlist sizes share an evaluation setting and must not count as independent replications.

Limits on interpretation

  • The correct structure must be in a 256-candidate mass-filtered pool. Scores do not transfer automatically to a larger database, a different pool-construction procedure or a missing true structure.
  • MCES and formula splits impose different distribution shifts. The source authors favour formula splits for their deployment interpretation; that choice does not prove that formula-split performance represents every intended application.
  • Reported methods are the paper implementations: DeepSets training was extended to 50 epochs. These are not interchangeable with original model-paper scores or current checkpoints.
  • Exact test denominators, split-manifest hashes, checkpoint hashes and evaluator revisions remain unextracted or unreported in the catalogue. No uncertainty values or new independent reproduction are established.
  • Candidate recall is not an authenticated metabolite identification, a clinical diagnosis or a calibrated probability. Human domain review remains outstanding.

Automated source review · 2026-09-28 · Codex research curation

Primary-source curation and separate automated cross-review checked exact evidence identities, comparator coverage, endpoint relevance and transfer limits. No new execution, human scientific review, independent replication or clinical validation.

Evaluated configurations

Each configuration below belongs to this protocol. Inspect its inputs, population and scoring conditions before comparing it with another evaluation.

DeepSets

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of DeepSets on MassSpecGym formula split retrieval with no formula, scored with Recall@1.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_122.2%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

Emb-Cos

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of Emb-Cos on MassSpecGym formula split retrieval with no formula, scored with Recall@1.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_141.2%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

FFN

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of FFN on MassSpecGym formula split retrieval with no formula, scored with Recall@1.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_116.9%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

JESTR

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of JESTR on MassSpecGym formula split retrieval with no formula, scored with Recall@1.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_120%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

MSAlign

Author-reported evaluation · Source checked

MSAlign molecular retrieval evaluation of MSAlign on MassSpecGym formula split retrieval with no formula, scored with Recall@1.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_153.8%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

SAIL

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of SAIL on MassSpecGym formula split retrieval with no formula, scored with Recall@1.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_129.5%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

Open the protocol's results and comparison checks →

Mapping sources and review metadata

Mapping use-case-mapping-msms-formula-no-formula-r1 · revision 1

Initial applicability review: primary sources and separate automated cross-review support this exact protocol, its complete selected comparator group and the stated limits.

Reviewed evidence fingerprint 264c270dc14e4c28740837553d6fcbf899529f22d829f825f065a798a4dfe76a

MSAlign molecular retrieval MassSpecGym formula split: no formula, R@20: MassSpecGym formula split retrieval with no formula

Current source-reviewed mapping

Proxy evidence: transfer to this question is limited

These source-checked retrieval evaluations inform method selection under explicit candidate and split assumptions; they do not establish accuracy in a new assay or unrestricted chemical search.

Assessed endpoint
Recall@20 of the true molecular structure among 256 mass-matched candidate structures on the MassSpecGym formula split, with no molecular formula supplied.
Evaluation protocol
MSAlign molecular retrieval MassSpecGym formula split: no formula, R@20: MassSpecGym formula split retrieval with no formula
Computational task
A reviewed task relationship is not recorded for this protocol.
Input and population constraints
  • Table 3, MassSpecGym formula split only; Recall@20. Retain all six formula-free configurations from that panel.
  • Candidate sets contain 256 PubChem structures selected with a 10 ppm neutral-mass tolerance. The true molecular identity is assumed to be in the set.
  • The formula data split groups by chemical formula; it does not supply formula to the evaluated models. Formula-conditioned methods and filtering are outside this mapping.
  • These are the source paper implementations and training settings. Exact original-paper or current-release equivalence is not established.
  • Metric groups at different shortlist sizes share an evaluation setting and must not count as independent replications.

Limits on interpretation

  • The correct structure must be in a 256-candidate mass-filtered pool. Scores do not transfer automatically to a larger database, a different pool-construction procedure or a missing true structure.
  • MCES and formula splits impose different distribution shifts. The source authors favour formula splits for their deployment interpretation; that choice does not prove that formula-split performance represents every intended application.
  • Reported methods are the paper implementations: DeepSets training was extended to 50 epochs. These are not interchangeable with original model-paper scores or current checkpoints.
  • Exact test denominators, split-manifest hashes, checkpoint hashes and evaluator revisions remain unextracted or unreported in the catalogue. No uncertainty values or new independent reproduction are established.
  • Candidate recall is not an authenticated metabolite identification, a clinical diagnosis or a calibrated probability. Human domain review remains outstanding.

Automated source review · 2026-09-28 · Codex research curation

Primary-source curation and separate automated cross-review checked exact evidence identities, comparator coverage, endpoint relevance and transfer limits. No new execution, human scientific review, independent replication or clinical validation.

Evaluated configurations

Each configuration below belongs to this protocol. Inspect its inputs, population and scoring conditions before comparing it with another evaluation.

DeepSets

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of DeepSets on MassSpecGym formula split retrieval with no formula, scored with Recall@20.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_2050.9%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

Emb-Cos

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of Emb-Cos on MassSpecGym formula split retrieval with no formula, scored with Recall@20.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_2079.6%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

FFN

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of FFN on MassSpecGym formula split retrieval with no formula, scored with Recall@20.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_2040.4%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

JESTR

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of JESTR on MassSpecGym formula split retrieval with no formula, scored with Recall@20.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_2060.9%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

MSAlign

Author-reported evaluation · Source checked

MSAlign molecular retrieval evaluation of MSAlign on MassSpecGym formula split retrieval with no formula, scored with Recall@20.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_2087.1%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

SAIL

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of SAIL on MassSpecGym formula split retrieval with no formula, scored with Recall@20.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_2073%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

Open the protocol's results and comparison checks →

Mapping sources and review metadata

Mapping use-case-mapping-msms-formula-no-formula-r20 · revision 1

Initial applicability review: primary sources and separate automated cross-review support this exact protocol, its complete selected comparator group and the stated limits.

Reviewed evidence fingerprint 7b93e2000caca7115c4b176f38059899025b4efeb98f22a3e469bdc0c9521e1d

MSAlign molecular retrieval MassSpecGym MCES split: no formula, R@1: MassSpecGym MCES split retrieval with no formula

Current source-reviewed mapping

Proxy evidence: transfer to this question is limited

These source-checked retrieval evaluations inform method selection under explicit candidate and split assumptions; they do not establish accuracy in a new assay or unrestricted chemical search.

Assessed endpoint
Recall@1 of the true molecular structure among 256 mass-matched candidate structures on the MassSpecGym MCES split, with no molecular formula supplied.
Evaluation protocol
MSAlign molecular retrieval MassSpecGym MCES split: no formula, R@1: MassSpecGym MCES split retrieval with no formula
Computational task
A reviewed task relationship is not recorded for this protocol.
Input and population constraints
  • Table 3, MassSpecGym MCES split only; Recall@1. Retain all six formula-free configurations from that panel.
  • Candidate sets contain 256 PubChem structures selected with a 10 ppm neutral-mass tolerance. The true molecular identity is assumed to be in the set.
  • The MCES split separates structure clusters with a minimum MCES distance greater than 10. Molecular formula is not supplied to these models; formula-conditioned methods and filtering are outside this mapping.
  • These are the source paper implementations and training settings. Exact original-paper or current-release equivalence is not established.
  • Metric groups at different shortlist sizes share an evaluation setting and must not count as independent replications.

Limits on interpretation

  • The correct structure must be in a 256-candidate mass-filtered pool. Scores do not transfer automatically to a larger database, a different pool-construction procedure or a missing true structure.
  • MCES and formula splits impose different distribution shifts. The source authors favour formula splits for their deployment interpretation; that choice does not prove that formula-split performance represents every intended application.
  • Reported methods are the paper implementations: DeepSets training was extended to 50 epochs. These are not interchangeable with original model-paper scores or current checkpoints.
  • Exact test denominators, split-manifest hashes, checkpoint hashes and evaluator revisions remain unextracted or unreported in the catalogue. No uncertainty values or new independent reproduction are established.
  • Candidate recall is not an authenticated metabolite identification, a clinical diagnosis or a calibrated probability. Human domain review remains outstanding.

Automated source review · 2026-09-28 · Codex research curation

Primary-source curation and separate automated cross-review checked exact evidence identities, comparator coverage, endpoint relevance and transfer limits. No new execution, human scientific review, independent replication or clinical validation.

Evaluated configurations

Each configuration below belongs to this protocol. Inspect its inputs, population and scoring conditions before comparing it with another evaluation.

DeepSets

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of DeepSets on MassSpecGym MCES split retrieval with no formula, scored with Recall@1.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_15.24%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

Emb-Cos

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of Emb-Cos on MassSpecGym MCES split retrieval with no formula, scored with Recall@1.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_112.3%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

FFN

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of FFN on MassSpecGym MCES split retrieval with no formula, scored with Recall@1.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_12.54%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

JESTR

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of JESTR on MassSpecGym MCES split retrieval with no formula, scored with Recall@1.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_111.8%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

MSAlign

Author-reported evaluation · Source checked

MSAlign molecular retrieval evaluation of MSAlign on MassSpecGym MCES split retrieval with no formula, scored with Recall@1.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_116.2%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

SAIL

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of SAIL on MassSpecGym MCES split retrieval with no formula, scored with Recall@1.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_19.5%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

Open the protocol's results and comparison checks →

Mapping sources and review metadata

Mapping use-case-mapping-msms-mces-no-formula-r1 · revision 1

Initial applicability review: primary sources and separate automated cross-review support this exact protocol, its complete selected comparator group and the stated limits.

Reviewed evidence fingerprint 1556c455cef29ff84665800c8a0bfd3eacef978dcfb6f0048ed261d55e4bd55c

MSAlign molecular retrieval MassSpecGym MCES split: no formula, R@20: MassSpecGym MCES split retrieval with no formula

Current source-reviewed mapping

Proxy evidence: transfer to this question is limited

These source-checked retrieval evaluations inform method selection under explicit candidate and split assumptions; they do not establish accuracy in a new assay or unrestricted chemical search.

Assessed endpoint
Recall@20 of the true molecular structure among 256 mass-matched candidate structures on the MassSpecGym MCES split, with no molecular formula supplied.
Evaluation protocol
MSAlign molecular retrieval MassSpecGym MCES split: no formula, R@20: MassSpecGym MCES split retrieval with no formula
Computational task
A reviewed task relationship is not recorded for this protocol.
Input and population constraints
  • Table 3, MassSpecGym MCES split only; Recall@20. Retain all six formula-free configurations from that panel.
  • Candidate sets contain 256 PubChem structures selected with a 10 ppm neutral-mass tolerance. The true molecular identity is assumed to be in the set.
  • The MCES split separates structure clusters with a minimum MCES distance greater than 10. Molecular formula is not supplied to these models; formula-conditioned methods and filtering are outside this mapping.
  • These are the source paper implementations and training settings. Exact original-paper or current-release equivalence is not established.
  • Metric groups at different shortlist sizes share an evaluation setting and must not count as independent replications.

Limits on interpretation

  • The correct structure must be in a 256-candidate mass-filtered pool. Scores do not transfer automatically to a larger database, a different pool-construction procedure or a missing true structure.
  • MCES and formula splits impose different distribution shifts. The source authors favour formula splits for their deployment interpretation; that choice does not prove that formula-split performance represents every intended application.
  • Reported methods are the paper implementations: DeepSets training was extended to 50 epochs. These are not interchangeable with original model-paper scores or current checkpoints.
  • Exact test denominators, split-manifest hashes, checkpoint hashes and evaluator revisions remain unextracted or unreported in the catalogue. No uncertainty values or new independent reproduction are established.
  • Candidate recall is not an authenticated metabolite identification, a clinical diagnosis or a calibrated probability. Human domain review remains outstanding.

Automated source review · 2026-09-28 · Codex research curation

Primary-source curation and separate automated cross-review checked exact evidence identities, comparator coverage, endpoint relevance and transfer limits. No new execution, human scientific review, independent replication or clinical validation.

Evaluated configurations

Each configuration below belongs to this protocol. Inspect its inputs, population and scoring conditions before comparing it with another evaluation.

DeepSets

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of DeepSets on MassSpecGym MCES split retrieval with no formula, scored with Recall@20.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_2028.2%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

Emb-Cos

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of Emb-Cos on MassSpecGym MCES split retrieval with no formula, scored with Recall@20.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_2046.4%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

FFN

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of FFN on MassSpecGym MCES split retrieval with no formula, scored with Recall@20.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_2020%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

JESTR

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of JESTR on MassSpecGym MCES split retrieval with no formula, scored with Recall@20.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_2049.7%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

MSAlign

Author-reported evaluation · Source checked

MSAlign molecular retrieval evaluation of MSAlign on MassSpecGym MCES split retrieval with no formula, scored with Recall@20.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_2059.9%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

SAIL

Independent external evaluation · Source checked

MSAlign molecular retrieval evaluation of SAIL on MassSpecGym MCES split retrieval with no formula, scored with Recall@20.

Population and split
Not reported · Not reported
Inputs and adaptation
Not reported · Not reported
Evaluation budget
Not reported
Runtime and memory

Runtime and memory measurements are not reported in this evaluation. A study budget is not a runtime or memory measurement.

Recorded results for this configuration
MetricValueCoverageUncertainty and source
recall_at_2045.2%

percent · higher

Not reported scored / Not reported eligible

Not reported

Result provenance

Evaluation methods, evidence and reproduction

No execution recipe has been verified for this exact configuration and evaluation. Inspect its methods and original run documentation before attempting reproduction.

Open the protocol's results and comparison checks →

Mapping sources and review metadata

Mapping use-case-mapping-msms-mces-no-formula-r20 · revision 1

Initial applicability review: primary sources and separate automated cross-review support this exact protocol, its complete selected comparator group and the stated limits.

Reviewed evidence fingerprint 20b4477c9d7da7d6213c216c7729530cbc41539830e44375d8be88fd41a66c32

What evidence is still missing?

  • The correct structure must be in a 256-candidate mass-filtered pool. Scores do not transfer automatically to a larger database, a different pool-construction procedure or a missing true structure.
  • MCES and formula splits impose different distribution shifts. The source authors favour formula splits for their deployment interpretation; that choice does not prove that formula-split performance represents every intended application.
  • Reported methods are the paper implementations: DeepSets training was extended to 50 epochs. These are not interchangeable with original model-paper scores or current checkpoints.
  • Exact test denominators, split-manifest hashes, checkpoint hashes and evaluator revisions remain unextracted or unreported in the catalogue. No uncertainty values or new independent reproduction are established.
  • Candidate recall is not an authenticated metabolite identification, a clinical diagnosis or a calibrated probability. Human domain review remains outstanding.
  • The four metric and split groups come from one paper and do not constitute independent replications.

Contribute evidence or propose a correction

Sources and review

Automated source review · 2026-09-28 · Codex research curation

Primary-source curation and separate automated cross-review checked exact evidence identities, comparator coverage, endpoint relevance and transfer limits. No new execution, human scientific review, independent replication or clinical validation.

Release provenance and downloads

Release 2026-09-28-c7b5ac6d34f2

Use-case input digest a0dd27a5f430ec387d309fd6e8615083250873ce4cff5e882c6fb8458ef80e95

Download questions, collection plans and review metadata (JSON) · Verify release checksums

Question use-case-mass-spectrum-molecule-shortlisting. Any numerical results on this page come from this release's existing evaluation records.