COMO: Closed-Loop Optical Molecule Recognition with Minimum Risk Training
Zhuoqi Lyu, Qing Ke
原文摘要
Optical chemical structure recognition (OCSR) translates molecular images into machine-readable representations such as SMILES strings or molecular graphs, but remains challenging in real-world documents due to wide variations in chemical structures, shorthand conventions, and scanning artifacts. Most existing deep learning approaches rely on teacher forcing with token-level Maximum Likelihood Estimation (MLE). This training paradigm suffers from exposure bias, as models are trained under ground-truth prefixes but must condition on their own previous predictions during inference. Moreover, token-level MLE objectives hinder the optimization towards molecular-level evaluation criteria such as chemical validity and structural similarity. Here we introduce Minimum Risk Training (MRT) to OCSR and propose COMO (Closed-loop Optical Molecule recOgnition), a framework that mitigates exposure bias by directly optimizing over molecule-level, non-differentiable objectives. Experiments on ten benchmarks, including synthetic and real-world chemical diagrams from patent and scientific literature, demonstrate that COMO substantially outperforms existing rule-based and learning-based methods with less training data, consistently achieving superior performance across both reproduced baselines and previously reported results. Ablation studies further show that MRT is architecture-agnostic, demonstrating its potential for broad application to end-to-end OCSR systems.
cs.CV · cs.AI · cs.LG