TY - JOUR
T1 - Zero-Shot Autonomous Microscopy for Scalable and Intelligent Characterization of 2D Materials
AU - Yang, Jingyun
AU - Yin, Ruoyan Avery
AU - Jiang, Chi
AU - Hu, Yuepeng
AU - Zhu, Xiaokai
AU - Hu, Xingjian
AU - Kumar, Sutharsika
AU - Holmes, Samantha K.
AU - Wang, Xiao
AU - Zhai, Xiaohua
AU - Rong, Keran
AU - Zhu, Yunyue
AU - Zhang, Tianyi
AU - Yin, Zongyou
AU - Cao, Yuan
AU - Tang, Haoning
AU - Franklin, Aaron D.
AU - Kong, Jing
AU - Gong, Neil Zhenqiang
AU - Ren, Zhichu
AU - Wang, Haozhe
N1 - ©2025 The authors
PY - 2025/10/14
Y1 - 2025/10/14
N2 - Characterization of atomic-scale materials traditionally requires human experts with months to years of specialized training. Even for trained human operators, accurate and reliable characterization remains challenging when examining newly discovered materials such as two-dimensional (2D) structures. This bottleneck drives demand for fully autonomous experimentation systems capable of comprehending research objectives without requiring large training data sets. In this work, we present ATOMIC (Autonomous Technology for Optical Microscopy & Intelligent Characterization), an end-to-end framework that integrates foundation models to enable fully autonomous, zero-shot characterization of 2D materials. Our system integrates the vision foundation model (i.e., Segment Anything Model), large language models (i.e., ChatGPT), unsupervised clustering, and topological analysis to automate microscope control, sample scanning, image segmentation, and intelligent analysis through prompt engineering, eliminating the need for additional training. When analyzing typical MoS2samples, our approach achieves 99.7% segmentation accuracy for single layer identification, which is equivalent to that of human experts. In addition, the integrated model is able to detect grain boundary slits that are challenging to identify with human eyes. Furthermore, the system retains robust accuracy despite variable conditions, including defocus, color-temperature fluctuations, and exposure variations. It is applicable to a broad spectrum of common 2D materials─including graphene, MoS2, WSe2, SnSe─regardless of whether they were fabricated via top-down or bottom-up methods. This work represents the implementation of foundation models to achieve autonomous analysis, providing a scalable and data-efficient characterization paradigm that transforms the approach to nanoscale materials research.
AB - Characterization of atomic-scale materials traditionally requires human experts with months to years of specialized training. Even for trained human operators, accurate and reliable characterization remains challenging when examining newly discovered materials such as two-dimensional (2D) structures. This bottleneck drives demand for fully autonomous experimentation systems capable of comprehending research objectives without requiring large training data sets. In this work, we present ATOMIC (Autonomous Technology for Optical Microscopy & Intelligent Characterization), an end-to-end framework that integrates foundation models to enable fully autonomous, zero-shot characterization of 2D materials. Our system integrates the vision foundation model (i.e., Segment Anything Model), large language models (i.e., ChatGPT), unsupervised clustering, and topological analysis to automate microscope control, sample scanning, image segmentation, and intelligent analysis through prompt engineering, eliminating the need for additional training. When analyzing typical MoS2samples, our approach achieves 99.7% segmentation accuracy for single layer identification, which is equivalent to that of human experts. In addition, the integrated model is able to detect grain boundary slits that are challenging to identify with human eyes. Furthermore, the system retains robust accuracy despite variable conditions, including defocus, color-temperature fluctuations, and exposure variations. It is applicable to a broad spectrum of common 2D materials─including graphene, MoS2, WSe2, SnSe─regardless of whether they were fabricated via top-down or bottom-up methods. This work represents the implementation of foundation models to achieve autonomous analysis, providing a scalable and data-efficient characterization paradigm that transforms the approach to nanoscale materials research.
KW - 2D materials
KW - autonomous microscopy
KW - foundation models
KW - large language models
KW - materials characterization
UR - https://www.scopus.com/pages/publications/105018670925
U2 - 10.1021/acsnano.5c09057
DO - 10.1021/acsnano.5c09057
M3 - Article
C2 - 41037740
AN - SCOPUS:105018670925
SN - 1936-0851
VL - 19
SP - 35493
EP - 35502
JO - ACS Nano
JF - ACS Nano
IS - 40
ER -