45.611% accuracy_at_10
FFN fingerprint · MIST CANOPUS retrieval Top 10 · Retrieval accuracy@10
- Tested configuration
- FFN fingerprint
- Protocol
- MIST CANOPUS retrieval Top 10: MIST CANOPUS fingerprint retrieval: Top 10
- Dataset subset
- MIST CANOPUS benchmark test set used in DreaMS Extended Data Table 1 (MIST CANOPUS retrieval split)
- Procedure
- MIST CANOPUS PubChem candidate retrieval; candidate positives share true molecule InChIKey first14 characters, negatives share molecular formula; rank cosine similarity of predicted and candidate fingerprints; accuracy@k is fraction of spectra with positive candidate in top k, printed as percent. Full test set named in Extended Data Table 1; exact split version/hash unextracted; 8000 spectra/7000 molecules describes total benchmark, not confirmed test denominator.
- Evaluation
- FFN fingerprint on MIST CANOPUS retrieval Top 10: MIST CANOPUS fingerprint retrieval: Top 10
- Coverage
- scored: unreported; eligible: unreported
- Uncertainty
- Not reported
- Evidence
- Evaluation origin not reported · source checkeddreams: Journal full-text XML · Extended Data Table 1 (XML Tab1), row FFN fingerprint, column Top 10
A source-checked result verifies the numerical transcription, not every model or protocol detail. Evaluation metadata: source checked. Source checked does not mean independently reproduced.
Reproduction
- Split
- Not reported
- Adaptation
- Not reported
- Scoring implementation
- Retrieval accuracy@10
No execution recipe has been verified for this exact configuration and evaluation. A benchmark's general instructions may use different inputs, splits or model settings.
Reproducing this published result requires matching its model configuration, data, split and scorer. Source checking or a successful smoke test does not establish score reproduction.
Evidence
Source checking verifies the cited claim or transcription. It does not establish independent reproduction.
Evidence table
Inspect claims, sources and review details
Trace each statement to its source and review. A context-only reference supports the record generally; it does not verify an individual field. Source checking does not reproduce an experiment.
One row per statement and cited source. Multiple citations are not independent evaluations. Shared locators are labelled explicitly.
1 evidence row matching the loaded filters
| Property and statement | Original source and location | Review and provenance |
|---|---|---|
| Reported result 45.611 Individual claims | dreams: Journal full-text XML Extended Data Table 1 (XML Tab1), row FFN fingerprint, column Top 10 Version: Retrieved page snapshot; no immutable publisher revision supplied | source checked XML table parsing plus independent row/column count and exact-string verification against the pinned primary article; not model execution. · 2026-09-23 unreported Audit detailsSource checked, not reproduced. Metrics differ by task, so no composite score across tasks is computed or implied. Field: Source artifact SHA-256: Hash scope: SHA-256 of retrieved original artifact bytes Format: original_artifact Extraction artifact SHA-256: |
Sources and history
View linked audit checks and correction history
Release 2026-09-23-2b89723c6dd9 · Record review: source checked
1 source records and release history
- dreams: Journal full-text XML · Original source · Retrieved page snapshot; no immutable publisher revision supplied
Technical metadata and extraction receipts
Stable ID: dreams-mist-retrieval-result-ffn-fingerprint-top-10-accuracy-at-10
- areas
- metabolomics
- tasks
- MIST CANOPUS fingerprint retrieval: Top 10
- metric
- accuracy_at_10
- metric direction
- higher
- unit
- percent
- printed value
- 45.611
- numeric value
- 45.611
- uncertainty
- Not reported
- source locator
- Extended Data Table 1 (XML Tab1), row FFN fingerprint, column Top 10
- missing metadata
- denominator: unextracted; seeds: unreported
- review
- method: XML table parsing plus independent row/column count and exact-string verification against the pinned primary article; not model execution.; reviewer: automated-source-review; date: 2026-09-23; artifact sha256: 4bbe2ecff0ad75944b3aec5131369c1b2f75ff6f4b5dc257487a274fdd7b0fef; retrieval url: https://www.ebi.ac.uk/europepmc/webservices/rest/PMC13090125/fullTextXML; notes: Source checked, not reproduced. Metrics differ by task, so no composite score across tasks is computed or implied.
- evidence overlap
- Complete Extended Data Table 1 from one paper. Comparator execution provenance is unresolved; do not treat quoted comparisons as additional independent experiments.