M. Sc. Lukas Rauch

AI for Computationally Intelligent Systems (AI4CIS)

Fax: +49 561 804-6022
E-Mail: lukas.rauch[at]uni-kassel[dot]de

Publikationen

[ 2023 ]
[ 2022 ]

2023[ to top ]

DADO – Low-Cost Query Strategies for Deep Active Design Optimization. Decke, Jens; Gruhl, Christian; Rauch, Lukas; Sick, Bernhard. In International Conference on Machine Learning and Applications (ICMLA). 2023.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
In this work, we apply deep active learning to the field of design optimization to reduce the number of computationally expensive numerical simulations widely used in industry and engineering. We are interested in optimizing the design of structural components, where a set of parameters describes the shape. If we can predict the performance based on these parameters and consider only the promising candidates for simulation, there is an enormous potential for saving computing power. We present two query strategies for self-optimization to reduce the computational cost in multi-objective design optimization problems. Our proposed methodology provides an intuitive approach that is easy to apply, offers significant improvements over random sampling, and circumvents the need for uncertainty estimation. We evaluate our strategies on a large dataset from the domain of fluid dynamics and introduce two new evaluation metrics to determine the model's performance. Findings from our evaluation highlights the effectiveness of our query strategies in accelerating design optimization. Furthermore, the introduced method is easily transferable to other self-optimization problems in industry and engineering.
@inproceedings{decke2023dado, abstract = {In this work, we apply deep active learning to the field of design optimization to reduce the number of computationally expensive numerical simulations widely used in industry and engineering. We are interested in optimizing the design of structural components, where a set of parameters describes the shape. If we can predict the performance based on these parameters and consider only the promising candidates for simulation, there is an enormous potential for saving computing power. We present two query strategies for self-optimization to reduce the computational cost in multi-objective design optimization problems. Our proposed methodology provides an intuitive approach that is easy to apply, offers significant improvements over random sampling, and circumvents the need for uncertainty estimation. We evaluate our strategies on a large dataset from the domain of fluid dynamics and introduce two new evaluation metrics to determine the model's performance. Findings from our evaluation highlights the effectiveness of our query strategies in accelerating design optimization. Furthermore, the introduced method is easily transferable to other self-optimization problems in industry and engineering.}, author = {Decke, Jens and Gruhl, Christian and Rauch, Lukas and Sick, Bernhard}, booktitle = {International Conference on Machine Learning and Applications (ICMLA)}, keywords = {itegpub}, note = {(accepted)}, title = {DADO – Low-Cost Query Strategies for Deep Active Design Optimization}, year = 2023 }
%0 Conference Paper %1 decke2023dado %A Decke, Jens %A Gruhl, Christian %A Rauch, Lukas %A Sick, Bernhard %B International Conference on Machine Learning and Applications (ICMLA) %D 2023 %T DADO – Low-Cost Query Strategies for Deep Active Design Optimization %X In this work, we apply deep active learning to the field of design optimization to reduce the number of computationally expensive numerical simulations widely used in industry and engineering. We are interested in optimizing the design of structural components, where a set of parameters describes the shape. If we can predict the performance based on these parameters and consider only the promising candidates for simulation, there is an enormous potential for saving computing power. We present two query strategies for self-optimization to reduce the computational cost in multi-objective design optimization problems. Our proposed methodology provides an intuitive approach that is easy to apply, offers significant improvements over random sampling, and circumvents the need for uncertainty estimation. We evaluate our strategies on a large dataset from the domain of fluid dynamics and introduce two new evaluation metrics to determine the model's performance. Findings from our evaluation highlights the effectiveness of our query strategies in accelerating design optimization. Furthermore, the introduced method is easily transferable to other self-optimization problems in industry and engineering.

2022[ to top ]

Predicting flow stress behavior of an AA7075 alloy using machine learning methods. Decke, Jens; Engelhardt, Anna; Rauch, Lukas; Degener, Sebastian; Sajjadifar, Seyedvahid; Scharifi, Emad; Steinhoff, Kurt; Niendorf, Thomas; Sick, Bernhard. In Crystals, 9(12), bll 1–19. MDPI, 2022.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
- [ URL ]
This work focuses on the prediction of hot deformation behavior of thermo-mechanically processed precipitation hardenable aluminum alloy AA7075. Data available are focusing on a novel hot forming process at different tool temperatures ranging from 24°C to 350°C to set different cooling rates after solution-heat-treatment. Isothermal uniaxial tensile tests in the temperature range from 200°C to 400°C and at strain rates ranging from 0.001 s^-1 to 0.1 s^-1 were carried out on four different material conditions. The present paper mainly focuses on a comparative study of modeling techniques based on Machine Learning (ML) and the well-known Zerilli-Armstrong model (Z-A) as an empirically based reference. Work focused on predicting single data points of curves that the model was trained on. Due to the novel way data were split with respect to training and testing data, it becomes possible to predict entire stress-strain curves which leads to a reduction in the number of required laboratory experiments, finally saving costs and time in future experiments. While all investigated ML methods showed a higher performance than the Z-A model, the extreme Gradient Boosting model (XGB) showed the superior results, i.e., highest error reduction of 91% with respect to the Mean Squared Error.
@article{decke2022predicting, abstract = {This work focuses on the prediction of hot deformation behavior of thermo-mechanically processed precipitation hardenable aluminum alloy AA7075. Data available are focusing on a novel hot forming process at different tool temperatures ranging from 24°C to 350°C to set different cooling rates after solution-heat-treatment. Isothermal uniaxial tensile tests in the temperature range from 200°C to 400°C and at strain rates ranging from 0.001 s^{-1} to 0.1 s^{-1} were carried out on four different material conditions. The present paper mainly focuses on a comparative study of modeling techniques based on Machine Learning (ML) and the well-known Zerilli-Armstrong model (Z-A) as an empirically based reference. Work focused on predicting single data points of curves that the model was trained on. Due to the novel way data were split with respect to training and testing data, it becomes possible to predict entire stress-strain curves which leads to a reduction in the number of required laboratory experiments, finally saving costs and time in future experiments. While all investigated ML methods showed a higher performance than the Z-A model, the extreme Gradient Boosting model (XGB) showed the superior results, i.e., highest error reduction of 91% with respect to the Mean Squared Error.}, author = {Decke, Jens and Engelhardt, Anna and Rauch, Lukas and Degener, Sebastian and Sajjadifar, Seyedvahid and Scharifi, Emad and Steinhoff, Kurt and Niendorf, Thomas and Sick, Bernhard}, journal = {Crystals}, keywords = {itegpub}, number = 12, pages = {1–19}, publisher = {MDPI}, title = {Predicting flow stress behavior of an AA7075 alloy using machine learning methods}, volume = 9, year = 2022 }
%0 Journal Article %1 decke2022predicting %A Decke, Jens %A Engelhardt, Anna %A Rauch, Lukas %A Degener, Sebastian %A Sajjadifar, Seyedvahid %A Scharifi, Emad %A Steinhoff, Kurt %A Niendorf, Thomas %A Sick, Bernhard %D 2022 %I MDPI %J Crystals %N 12 %P 1--19 %R 10.3390/cryst12091281 %T Predicting flow stress behavior of an AA7075 alloy using machine learning methods %U https://www.mdpi.com/2073-4352/12/9/1281 %V 9 %X This work focuses on the prediction of hot deformation behavior of thermo-mechanically processed precipitation hardenable aluminum alloy AA7075. Data available are focusing on a novel hot forming process at different tool temperatures ranging from 24°C to 350°C to set different cooling rates after solution-heat-treatment. Isothermal uniaxial tensile tests in the temperature range from 200°C to 400°C and at strain rates ranging from 0.001 s^-1 to 0.1 s^-1 were carried out on four different material conditions. The present paper mainly focuses on a comparative study of modeling techniques based on Machine Learning (ML) and the well-known Zerilli-Armstrong model (Z-A) as an empirically based reference. Work focused on predicting single data points of curves that the model was trained on. Due to the novel way data were split with respect to training and testing data, it becomes possible to predict entire stress-strain curves which leads to a reduction in the number of required laboratory experiments, finally saving costs and time in future experiments. While all investigated ML methods showed a higher performance than the Z-A model, the extreme Gradient Boosting model (XGB) showed the superior results, i.e., highest error reduction of 91% with respect to the Mean Squared Error.
Enhancing Active Learning with Weak Supervision and Transfer Learning by Leveraging Information and Knowledge Sources. Rauch, Lukas; Huseljic, Denis; Sick, Bernhard. In Workshop on Interactive Adaptive Learning (IAL), ECML PKDD, bll 27–42. 2022.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
- [ URL ]
One of the major limitations of deploying a machine learning model is the availability of labeled training data and the resulting expensive annotation process. Although active learning (AL) methods may reduce the annotation cost by actively selecting the most-useful instances, a costly human annotator usually provides the labels. Therefore, even with AL, we still consider the annotation process to be time-consuming and expensive. Besides human annotators, though, companies often have a vast amount of information and knowledge sources available that can generate low-cost labels (e.g., a black-box model) or improve the learning process (e.g., a pre-trained model). We present a novel approach that enhances AL with weak supervision (WS) and transfer learning (TL) to reduce the annotation cost by leveraging these sources. Specifically, we consider a black-box model like a rule-based system as an error-prone and weakly-supervised annotator that inexpensively provides labels. We estimate its performance with an annotator model to decide whether a human annotation is required. Additionally, we utilize unlabeled internal and external data by transferring knowledge from a pre-trained model to the AL cycle. We sequentially investigate the impact of WS and TL on annotation cost and model performance in an AL cycle through a use case. Our evaluation shows that our approach can reduce annotation cost by 51% while achieving nearly identical model performance compared to a traditional AL approach.
@inproceedings{rauch2022enhancing, abstract = {One of the major limitations of deploying a machine learning model is the availability of labeled training data and the resulting expensive annotation process. Although active learning (AL) methods may reduce the annotation cost by actively selecting the most-useful instances, a costly human annotator usually provides the labels. Therefore, even with AL, we still consider the annotation process to be time-consuming and expensive. Besides human annotators, though, companies often have a vast amount of information and knowledge sources available that can generate low-cost labels (e.g., a black-box model) or improve the learning process (e.g., a pre-trained model). We present a novel approach that enhances AL with weak supervision (WS) and transfer learning (TL) to reduce the annotation cost by leveraging these sources. Specifically, we consider a black-box model like a rule-based system as an error-prone and weakly-supervised annotator that inexpensively provides labels. We estimate its performance with an annotator model to decide whether a human annotation is required. Additionally, we utilize unlabeled internal and external data by transferring knowledge from a pre-trained model to the AL cycle. We sequentially investigate the impact of WS and TL on annotation cost and model performance in an AL cycle through a use case. Our evaluation shows that our approach can reduce annotation cost by 51% while achieving nearly identical model performance compared to a traditional AL approach.}, author = {Rauch, Lukas and Huseljic, Denis and Sick, Bernhard}, booktitle = {Workshop on Interactive Adaptive Learning (IAL), ECML PKDD}, keywords = {itegpub}, pages = {27–42}, title = {Enhancing Active Learning with Weak Supervision and Transfer Learning by Leveraging Information and Knowledge Sources}, year = 2022 }
%0 Conference Paper %1 rauch2022enhancing %A Rauch, Lukas %A Huseljic, Denis %A Sick, Bernhard %B Workshop on Interactive Adaptive Learning (IAL), ECML PKDD %D 2022 %P 27--42 %T Enhancing Active Learning with Weak Supervision and Transfer Learning by Leveraging Information and Knowledge Sources %U http://ceur-ws.org/Vol-3259/ialatecml_paper3.pdf %X One of the major limitations of deploying a machine learning model is the availability of labeled training data and the resulting expensive annotation process. Although active learning (AL) methods may reduce the annotation cost by actively selecting the most-useful instances, a costly human annotator usually provides the labels. Therefore, even with AL, we still consider the annotation process to be time-consuming and expensive. Besides human annotators, though, companies often have a vast amount of information and knowledge sources available that can generate low-cost labels (e.g., a black-box model) or improve the learning process (e.g., a pre-trained model). We present a novel approach that enhances AL with weak supervision (WS) and transfer learning (TL) to reduce the annotation cost by leveraging these sources. Specifically, we consider a black-box model like a rule-based system as an error-prone and weakly-supervised annotator that inexpensively provides labels. We estimate its performance with an annotator model to decide whether a human annotation is required. Additionally, we utilize unlabeled internal and external data by transferring knowledge from a pre-trained model to the AL cycle. We sequentially investigate the impact of WS and TL on annotation cost and model performance in an AL cycle through a use case. Our evaluation shows that our approach can reduce annotation cost by 51% while achieving nearly identical model performance compared to a traditional AL approach.