Automated Pixel-Scale Classification of Scanning Electron Microscopy Images via Vision Transformers
Year: 2025
Type: conference-paper
Abstract: Large-scale analysis of Scanning Electron Microscopy (SEM) images is often limited by unreliable scale information due to proprietary formats and error-prone Optical Character Recognition (OCR). We address this by fine-tuning a Vision Transformer (ViT) to classify the image pixel size - pico, nano, or micro - directly from the pixel data. Fine-tuning on a dataset of 17,700 SEM images, the model achieves 90.6% precision on a held-out test set. Notably, most misclassifications occur at the transitional nano-micro boundary, indicating that the model learns physically meaningful feature representations. Our method provides a robust, automated tool for stratifying SEM archives, enabling new large-scale studies in materials science and nanotechnology.This work was developed as part of the NFFA-DI project and has received funding from the European Union’s NextGenerationEU program.
Authors: Khalil, Ahmed, Rodani, Tommaso, Bazzocchi, Federica, Biagetti, Matteo, Cazzaniga, Alberto, Cozzini, Stefano
Institution: AREA Science Park
Language: English
Subfield: Computer Vision and Pattern Recognition
Field: Computer Science
Domain: Physical Sciences
Open Access status: green
OpenAlex ID: W7085658016
FWCI:
Cites:
Cited by:
Related to: