Work

Predicting Many Crystal Properties via an Adaptive Transformer-Based Framework

Year: 2025
Type: article
Abstract: Machine learning has revolutionized many fields, including materials science. However, predicting the properties of crystalline materials using machine learning faces challenges in input encoding, output versatility, and interpretability. We introduce CrystalBERT, an adaptable transformer-based framework integrating space group, elemental, and unit cell information. This novel structure can seamlessly combine diverse features and accurately predict various physical properties, including topological properties, superconducting transition temperatures, dielectric constants, and more. CrystalBERT provides insightful interpretations of features influencing target properties. Our results indicate that space group and elemental information are crucial for predicting topological and superconducting properties, underscoring their intricate nature. By incorporating these features, we achieve 91% accuracy in topological classification, surpassing prior studies and identifying previously misclassified materials. This research demonstrates that integrating diverse material information enhances the prediction of complex material properties, paving the way for more accurate and interpretable machine learning models in materials science.
Language: English
Open Access status: green
OpenAlex ID: W4410528556
FWCI: 0.208
Cites: 65
Cited by: 1
Related to: 10