EXPLAINABLE MACHINE LEARNING FOR PREDICTING MOLECULAR TOXICITY FROM PHYSICOCHEMICAL AND STRUCTURAL PROPERTIES
Main Article Content
Abstract
The prediction of molecular toxicity is becoming more and more critical for effective chemical safety assessment, drug development and environmental risk assessment. In this study, an explainable machine learning model for predicting molecular toxicity was developed using physicochemical descriptors and structural properties of Tox21 dataset. There were 7,831 molecules and 12 binary toxicity endpoints in the dataset, with 7,823 molecules remaining after structure validation for the molecules. Morgan molecular fingerprints were created along with physicochemical descriptors such as molecular weight, LogP, topological polar surface area, hydrogen-bond properties, rotatable bonds, heavy-atom count, ring properties, and Fraction Csp3. The accuracy, precision, recall, specificity, F1 score, balanced accuracy, ROC-AUC and PR-AUC were used to evaluate the following logistic regression, random forest, XGBoost and Support Vector Machine models. Random Forest had the best mean ROC-AUC (0.839) and PR-AUC (0.480) values while XGBoost had the best balanced accuracy (0.738) and F1 score (0.402). Generally, active molecules were larger, more lipophilic and more aromatic than inactive compounds for the representative SR-ARE endpoint. The molecular weight, LogP, Fraction Csp3, TPSA, number of heavy atoms and aromatic properties were found to be influential predictors using SHAP analysis. In general, this work shows that explainable machine learning offers accurate and interpretable molecular toxicity predictions to enable compound prioritization and computational chemical-safety assessment.
Downloads
Article Details

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Author(s) and co-author(s) jointly and severally represent and warrant that the Article is original with the author(s) and does not infringe any copyright or violate any other right of any third parties, and that the Article has not been published elsewhere. Author(s) agree to the terms that the IJRDO Journal will have the full right to remove the published article on any misconduct found in the published article.
References
2.Arrieta, Alejandro Barredo, Natalia Díaz-Rodríguez, Javier Del Ser, Adrien Bennetot, Siham Tabik, Alberto Barbado, Salvador García, Sergio Gil-López, Daniel Molina, and Richard Benjamins. 2020. “Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI.” Information Fusion 58:82–115.
3.Chakraborty, Soumyadeep. 2024. “Tox21 Dataset.” https://www.kaggle.com/datasets/epicskills/tox21-dataset.
4.Chen, Jiarui, Yain-Whar Si, Chon-Wai Un, and Shirley W. I. Siu. 2021. “Chemical Toxicity Prediction Based on Semi-Supervised Learning and Graph Convolutional Neural Network.” Journal of Cheminformatics 13(1):93. doi:10.1186/s13321-021-00570-8.
5.Cronin, Mark TD, Andrea-Nicole Richarz, and Terry W. Schultz. 2019. “Identification and Description of the Uncertainty, Variability, Bias and Influence in Quantitative Structure-Activity Relationships (QSARs) for Toxicity Prediction.” Regulatory Toxicology and Pharmacology 106:90–104.
6.Gao, Feng, Wei Zhang, Andrea A. Baccarelli, and Yike Shen. 2022. “Predicting Chemical Ecotoxicity by Learning Latent Space Chemical Representations.” Environment International 163:107224.
7.Heid, Esther, Kevin P. Greenman, Yunsie Chung, Shih-Cheng Li, David E. Graff, Florence H. Vermeire, Haoyang Wu, William H. Green, and Charles J. McGill. 2024. “Chemprop: A Machine Learning Package for Chemical Property Prediction.” Journal of Chemical Information and Modeling 64(1):9–17.
8.Hwang, Doyeong, Soojung Yang, Yongchan Kwon, Kyung Hoon Lee, Grace Lee, Hanseok Jo, Seyeol Yoon, and Seongok Ryu. 2020. “Comprehensive Study on Molecular Supervised Learning with Graph Neural Networks.” Journal of Chemical Information and Modeling 60(12):5936–45.
9.Jiang, Dejun, Zhenxing Wu, Chang-Yu Hsieh, Guangyong Chen, Ben Liao, Zhe Wang, Chao Shen, Dongsheng Cao, Jian Wu, and Tingjun Hou. 2021. “Could Graph Neural Networks Learn Better Molecular Representation for Drug Discovery? A Comparison Study of Descriptor-Based and Graph-Based Models.” Journal of Cheminformatics 13(1):12. doi:10.1186/s13321-020-00479-8.
10.Jiang, Jian, Rui Wang, and Guo-Wei Wei. 2021. “GGL-Tox: Geometric Graph Learning for Toxicity Prediction.” Journal of Chemical Information and Modeling 61(4):1691–1700.
11.Jiao, Zeren, Pingfan Hu, Hongfei Xu, and Qingsheng Wang. 2020. “Machine Learning and Deep Learning in Chemical Healthand Safety: A Systematic Review of Techniques and Applications.” ACS Chemical Health & Safety 27(6):316–34. doi:10.1021/acs.chas.0c00075.
12.Jiménez-Luna, José, Francesca Grisoni, and Gisbert Schneider. 2020. “Drug Discovery with Explainable Artificial Intelligence.” Nature Machine Intelligence 2(10):573–84.
13.Johnson, Justin M., and Taghi M. Khoshgoftaar. 2019. “Survey on Deep Learning with Class Imbalance.” Journal of Big Data 6(1):27. doi:10.1186/s40537-019-0192-5.
14.Kong, Yue, Xiaoman Zhao, Ruizi Liu, Zhenwu Yang, Hongyan Yin, Bowen Zhao, Jinling Wang, Bingjie Qin, and Aixia Yan. 2022. “Integrating Concept of Pharmacophore with Graph Neural Networks for Chemical Property Prediction and Interpretation.” Journal of Cheminformatics 14(1):52. doi:10.1186/s13321-022-00634-3.
15.Li, Ting, Weida Tong, Ruth Roberts, Zhichao Liu, and Shraddha Thakkar. 2021. “DeepDILI: Deep Learning-Powered Drug-Induced Liver Injury Prediction Using Model-Level Representation.” Chemical Research in Toxicology 34(2):550–65.
16.Lou, Shang, Zhuohang Yu, Zejun Huang, Haoqiang Wang, Fei Pan, Weihua Li, Guixia Liu, and Yun Tang. 2024. “In Silico Prediction of Chemical Acute Dermal Toxicity Using Explainable Machine Learning Methods.” Chemical Research in Toxicology 37(3):513–24. doi:10.1021/acs.chemrestox.4c00012.
17.Lundberg, Scott M., Gabriel Erion, Hugh Chen, Alex DeGrave, Jordan M. Prutkin, Bala Nair, Ronit Katz, Jonathan Himmelfarb, Nisha Bansal, and Su-In Lee. 2020. “From Local Explanations to Global Understanding with Explainable AI for Trees.” Nature Machine Intelligence 2(1):56–67.
18.Moriwaki, Hirotomo, Yu-Shi Tian, Norihito Kawashita, and Tatsuya Takagi. 2018. “Mordred: A Molecular Descriptor Calculator.” Journal of Cheminformatics 10(1):4. doi:10.1186/s13321-018-0258-y.
19.Muratov, Eugene N., Jürgen Bajorath, Robert P. Sheridan, Igor V. Tetko, Dmitry Filimonov, Vladimir Poroikov, Tudor I. Oprea, Igor I. Baskin, Alexandre Varnek, and Adrian Roitberg. 2020. “QSAR without Borders.” Chemical Society Reviews 49(11):3525–64.
20.Peng, Yuzhong, Ziqiao Zhang, Qizhi Jiang, Jihong Guan, and Shuigeng Zhou. 2020. “TOP: A Deep Mixture Representation Learning Method for Boosting Molecular Toxicity Prediction.” Methods 179:55–64.
21.Rudin, Cynthia. 2019. “Stop Explaining Black Box Machine Learning Models for High Stakes Decisions and Use Interpretable Models Instead.” Nature Machine Intelligence 1(5):206–15.
22.Tang, Weihao, Jingwen Chen, Zhongyu Wang, Hongbin Xie, and Huixiao Hong. 2018. “Deep Learning for Predicting Toxicity of Chemicals: A Mini Review.” Journal of Environmental Science and Health, Part C 36(4):252–71. doi:10.1080/10590501.2018.1537563.
23.Wang, Yuyang, Jianren Wang, Zhonglin Cao, and Amir Barati Farimani. 2022. “Molecular Contrastive Learning of Representations via Graph Neural Networks.” Nature Machine Intelligence 4(3):279–87.
24.Wu, Zhenqin, Bharath Ramsundar, Evan N. Feinberg, Joseph Gomes, Caleb Geniesse, Aneesh S. Pappu, Karl Leswing, and Vijay Pande. 2018. “MoleculeNet: A Benchmark for Molecular Machine Learning.” Chemical Science 9(2):513–30.
25.Xiong, Zhaoping, Dingyan Wang, Xiaohong Liu, Feisheng Zhong, Xiaozhe Wan, Xutong Li, Zhaojun Li, Xiaomin Luo, Kaixian Chen, and Hualiang Jiang. 2020. “Pushing the Boundaries of Molecular Representation for Drug Discovery with the Graph Attention Mechanism.” Journal of Medicinal Chemistry 63(16):8749–60.
26.Yang, Kevin, Kyle Swanson, Wengong Jin, Connor Coley, Philipp Eiden, Hua Gao, Angel Guzman-Perez, Timothy Hopper, Brian Kelley, and Miriam Mathea. 2019. “Analyzing Learned Molecular Representations for Property Prediction.” Journal of Chemical Information and Modeling 59(8):3370.
27.Ye, Lin, Deborah K. Ngan, Tuan Xu, Zhichao Liu, Jinghua Zhao, Srilatha Sakamuru, Li Zhang, Tongan Zhao, Menghang Xia, and Anton Simeonov. 2022. “Prediction of Drug-Induced Liver Injury and Cardiotoxicity Using Chemical Structure and in Vitro Assay Data.” Toxicology and Applied Pharmacology 454:116250.
28.Yuan Li, Yuan, Lingfeng Chen, Chengtao Pu, Chengdong Zang, YingChao Yan, Yadong Chen, Yanmin Zhang, and Haichun Liu. 2023. “Co‐model for Chemical Toxicity Prediction Based on Multi‐task Deep Learning.” Molecular Informatics 42(5):2200257. doi:10.1002/minf.202200257.
29.Zhang, Li, Hui Zhang, Haixin Ai, Huan Hu, Shimeng Li, Jian Zhao, and Hongsheng Liu. 2018. “Applications of Machine Learning Methods in Drug Toxicity Prediction.” Current Topics in Medicinal Chemistry 18(12):987–97.