Enhanced Binding Affinity Prediction via Transformer‑Based Protein Embeddings and Ensemble Learning
Year: 2025
Type: preprint
Abstract: Binding Affinity Prediction is pivotal in determining the efficacy of interactions between proteins and ligands. It plays a critical role in drug discovery and therapeutic agent development. This study proposes a new hybrid ensemble learning model for protein-ligand affinity prediction that utilizes ProtT5 protein embeddings and Morgan molecular fingerprints for ligand representation. We used ProtT5 for protein sequence embedding and 2,048-bit Morgan Fingerprints to capture ligand structures. The ensemble approach performed best when a Random Forest regressor was paired with data encoded by the T5 Transformer model, achieving MSE = 0.5678, R 2 = 0.6062, MAE = 0.3246, and Pearson correlation = 0.7787 on the benchmark Devis Dataset. Our approach is distinctive in that it combines protein sequence embeddings with offline frozen Random Forest regression, enhancing accuracy due to the data’s intricate interdependence and highly multivariate nature. Hyperparameter tuning was conducted with Random Search, and ProtT5 embeddings coupled with Morgan Fingerprints served to depict ligands and proteins respectively. Compared with earlier models that utilized basic Random Forest and SVR, this approach demonstrates improved accuracy, interpretive capability, and less complexity in required inputs—merely protein sequences and SMILES strings. Here, the interplay between advanced embeddings and classical machine learning methods are harnessed to improve the accuracy and interpretability of the model.
Authors: Muhammad Ismail, Abdul Majid, M. Usman Hashmi, Munir Ahmad
Language: English
Subfield: Computational Theory and Mathematics
Field: Computer Science
Domain: Physical Sciences
Open Access status: gold
OpenAlex ID: W4413278677