Molecule graph reconstruction from atomic force microscope images with machine learning
Loading...
Access rights
openAccess
publishedVersion
URL
Journal Title
Journal ISSN
Volume Title
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)
Date
Major/Subject
Mcode
Degree programme
Language
en
Pages
11
Series
MRS Bulletin, Volume 47, issue 9, pp. 895-905
Abstract
Abstract: Despite the success of noncontact atomic force microscopy (AFM) in providing atomic-scale insight into the structure and properties of matter on surfaces, the wider applicability of the technique faces challenges in the difficulty of interpreting the measurement data. We tackle this problem by proposing a machine learning model for extracting molecule graphs of samples from AFM images. The predicted graphs contain not only atoms and their bond connections but also their coordinates within the image and elemental identification. The model is shown to be effective on simulated AFM images, but we also highlight some issues with robustness that need to be addressed before generalization to real AFM images. Impact statement: Developing better techniques for imaging matter at the atomic scale is important for advancing our fundamental understanding of physics and chemistry as well as providing better tools for materials R&D of nanotechnologies. State-of-the-art high-resolution atomic force microscopy experiments are providing such atomic-resolution imaging for many systems of interest. However, greater automation of processing the measurement data is required in order to eliminate the need for subjective evaluation by human operators, which is unreliable and requires specialized expertise. The ability to convert microscope images into graphs would provide an easily understandable and precise view into the structure of the system under study. Furthermore, a graph consisting of a discrete set of objects, rather than an image that describes a continuous domain, is much more amenable to further processing and analysis using symbolic reasoning based on physically motivated rules. This type of image-to-graph conversion is also relevant to other machine learning tasks such as scene understanding.Description
Funding Information: Open Access funding provided by Aalto University. This research was supported by the Academy of Finland (Project No. 314877), Ministry of Education, Culture, Sports, Science and Technology and was a part of the Flagship Programmes under Projects Nos. 318890 and 318891 (Competence Center for Materials Bioeconomy, FinnCERES) and the Finnish Center for Artificial Intelligence FCAI. A.S.F. has been supported by the World Premier International Research Center Initiative (WPI), MEXT, Japan. Publisher Copyright: © 2022, The Author(s).
Other note
Citation
Oinonen, N, Kurki, L, Ilin, A & Foster, A S 2022, 'Molecule graph reconstruction from atomic force microscope images with machine learning', MRS Bulletin, vol. 47, no. 9, pp. 895-905. https://doi.org/10.1557/s43577-022-00324-3