Hamdia, K.M.; Zhuang, X.; Rabczuk, T.: An efficient optimization approach for designing machine learning models based on genetic algorithm. In: Neural computing & applications 33 (2021), Nr. 6, S. 1923-1933. DOI: https://doi.org/10.1007/s00521-020-05035-x
Abstract: | |
Machine learning (ML) methods have shown powerful performance in different application. Nonetheless, designing ML models remains a challenge and requires further research as most procedures adopt a trial and error strategy. In this study, we present a methodology to optimize the architecture and the feature configurations of ML models considering a supervised learning process. The proposed approach employs genetic algorithm (GA)-based integer-valued optimization for two ML models, namely deep neural networks (DNN) and adaptive neuro-fuzzy inference system (ANFIS). The selected variables in the DNN optimization problems are the number of hidden layers, their number of neurons and their activation function, while the type and the number of membership functions are the design variables in the ANFIS optimization problem. The mean squared error (MSE) between the predictions and the target outputs is minimized as the optimization fitness function. The proposed scheme is validated through a case study of computational material design. We apply the method to predict the fracture energy of polymer/nanoparticles composites (PNCs) with a database gathered from the literature. The optimized DNN model shows superior prediction accuracy compared to the classical one-hidden layer network. Also, it outperforms ANFIS with significantly lower number of generations in GA. The proposed method can be easily extended to optimize similar architecture properties of ML models in various complex systems. | |
License of this version: | CC BY 4.0 Unported |
Document Type: | Article |
Publishing status: | publishedVersion |
Issue Date: | 2021 |
Appears in Collections: | Fakultät für Mathematik und Physik |
pos. | country | downloads | ||
---|---|---|---|---|
total | perc. | |||
1 | Germany | 19 | 40.43% | |
2 | United States | 9 | 19.15% | |
3 | Russian Federation | 4 | 8.51% | |
4 | China | 3 | 6.38% | |
5 | Israel | 2 | 4.26% | |
6 | No geo information available | 1 | 2.13% | |
7 | Pakistan | 1 | 2.13% | |
8 | Netherlands | 1 | 2.13% | |
9 | Latvia | 1 | 2.13% | |
10 | Iran, Islamic Republic of | 1 | 2.13% | |
other countries | 5 | 10.64% |
Hinweis
Zur Erhebung der Downloadstatistiken kommen entsprechend dem „COUNTER Code of Practice for e-Resources“ international anerkannte Regeln und Normen zur Anwendung. COUNTER ist eine internationale Non-Profit-Organisation, in der Bibliotheksverbände, Datenbankanbieter und Verlage gemeinsam an Standards zur Erhebung, Speicherung und Verarbeitung von Nutzungsdaten elektronischer Ressourcen arbeiten, welche so Objektivität und Vergleichbarkeit gewährleisten sollen. Es werden hierbei ausschließlich Zugriffe auf die entsprechenden Volltexte ausgewertet, keine Aufrufe der Website an sich.