Publications

The content on this page was translated automatically.

2024[ to top ]

1.
Botache, D., Decke, J., Ripken, W., Dornipati, A., Götz-Hahn, F., Ayeb, M., Sick, B.: Enhancing Multi-Objective Optimization through Machine Learning-Supported Multiphysics Simulation. arXiv e-prints. arXiv:2309.13179v2 (2024).
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
- [ URL ]
This paper presents a methodological framework for training, self-optimising, and self-organising surrogate models to approximate and speed up multiobjective optimisation of technical systems based on multiphysics simulations. At the hand of two real-world datasets, we illustrate that surrogate models can be trained on relatively small amounts of data to approximate the underlying simulations accurately. Including explainable AI techniques allow for highlighting feature relevancy or dependencies and supporting the possible extension of the used datasets. One of the datasets was created for this paper and is made publicly available for the broader scientific community. Extensive experiments combine four machine learning and deep learning algorithms with an evolutionary optimisation algorithm. The performance of the combined training and optimisation pipeline is evaluated by verifying the generated Pareto-optimal results using the ground truth simulations. The results from our pipeline and a comprehensive evaluation strategy show the potential for efficiently acquiring solution candidates in multiobjective optimisation tasks by reducing the number of simulations and conserving a higher prediction accuracy, i.e., with a MAPE score under 5% for one of the presented use cases.
@article{botache2024enhancing, abstract = {This paper presents a methodological framework for training, self-optimising, and self-organising surrogate models to approximate and speed up multiobjective optimisation of technical systems based on multiphysics simulations. At the hand of two real-world datasets, we illustrate that surrogate models can be trained on relatively small amounts of data to approximate the underlying simulations accurately. Including explainable AI techniques allow for highlighting feature relevancy or dependencies and supporting the possible extension of the used datasets. One of the datasets was created for this paper and is made publicly available for the broader scientific community. Extensive experiments combine four machine learning and deep learning algorithms with an evolutionary optimisation algorithm. The performance of the combined training and optimisation pipeline is evaluated by verifying the generated Pareto-optimal results using the ground truth simulations. The results from our pipeline and a comprehensive evaluation strategy show the potential for efficiently acquiring solution candidates in multiobjective optimisation tasks by reducing the number of simulations and conserving a higher prediction accuracy, i.e., with a MAPE score under 5% for one of the presented use cases.}, author = {Botache, Diego and Decke, Jens and Ripken, Winfried and Dornipati, Abhinay and Götz-Hahn, Franz and Ayeb, Mohamed and Sick, Bernhard}, journal = {arXiv e-prints}, keywords = {itegpub}, pages = {arXiv:2309.13179v2}, title = {Enhancing Multi-Objective Optimization through Machine Learning-Supported Multiphysics Simulation}, year = 2024 }
%0 Journal Article %1 botache2024enhancing %A Botache, Diego %A Decke, Jens %A Ripken, Winfried %A Dornipati, Abhinay %A Götz-Hahn, Franz %A Ayeb, Mohamed %A Sick, Bernhard %D 2024 %J arXiv e-prints %P arXiv:2309.13179v2 %T Enhancing Multi-Objective Optimization through Machine Learning-Supported Multiphysics Simulation %U https://arxiv.org/abs/2309.13179 %X This paper presents a methodological framework for training, self-optimising, and self-organising surrogate models to approximate and speed up multiobjective optimisation of technical systems based on multiphysics simulations. At the hand of two real-world datasets, we illustrate that surrogate models can be trained on relatively small amounts of data to approximate the underlying simulations accurately. Including explainable AI techniques allow for highlighting feature relevancy or dependencies and supporting the possible extension of the used datasets. One of the datasets was created for this paper and is made publicly available for the broader scientific community. Extensive experiments combine four machine learning and deep learning algorithms with an evolutionary optimisation algorithm. The performance of the combined training and optimisation pipeline is evaluated by verifying the generated Pareto-optimal results using the ground truth simulations. The results from our pipeline and a comprehensive evaluation strategy show the potential for efficiently acquiring solution candidates in multiobjective optimisation tasks by reducing the number of simulations and conserving a higher prediction accuracy, i.e., with a MAPE score under 5% for one of the presented use cases.

2023[ to top ]

1.
Botache, D.: Machine Learning Supported Optimisation and Experimental Evaluation of Electrical Motors for Small Urban Passenger Vehicles. In: Tomforde, S. en Krupitzer, C. (reds) Organic Computing -- Doctoral Dissertation Colloquium 2023. bll 14–26. kassel university press (2023).
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
The increasing environmental pollution and rising global energy demands require the rapid development of novel and sustainable traction machines from urban transport up to large-scale transport vehicles. The optimisation of the development cycle of electrical traction machines plays a vital role in sustainable mobility. Still, developers have to face the difficulty of analysing time-consuming multiphysics simulations to assess the performance of many prototype variants. Accelerating this process involves implementing machine learning-supported strategies that can effectively acquire results and predictions about the performance and efficiency of prototypes in an iterative optimisation process and detect possible issues during the experimental procedure. The following research project streamlines the development cycle by identifying and presenting multiple strategies for applying and evaluating machine learning and deep learning techniques in different stages and areas in the development cycle including self-optimisation and self-adaptation capabilities. By implementing these strategies, the optimisation process can be further improved and become more efficient and robust, reducing the time and cost required for testing and validation. Therefore, this proposal addresses two application areas. The first area consists of the supported machine learning motor performance prediction at the topology design and optimisation stage of structural components. The second area corresponds to the machine learning-supported experimental evaluation process of prototypes at desired test benches.
@incollection{botache2023machine, abstract = {The increasing environmental pollution and rising global energy demands require the rapid development of novel and sustainable traction machines from urban transport up to large-scale transport vehicles. The optimisation of the development cycle of electrical traction machines plays a vital role in sustainable mobility. Still, developers have to face the difficulty of analysing time-consuming multiphysics simulations to assess the performance of many prototype variants. Accelerating this process involves implementing machine learning-supported strategies that can effectively acquire results and predictions about the performance and efficiency of prototypes in an iterative optimisation process and detect possible issues during the experimental procedure. The following research project streamlines the development cycle by identifying and presenting multiple strategies for applying and evaluating machine learning and deep learning techniques in different stages and areas in the development cycle including self-optimisation and self-adaptation capabilities. By implementing these strategies, the optimisation process can be further improved and become more efficient and robust, reducing the time and cost required for testing and validation. Therefore, this proposal addresses two application areas. The first area consists of the supported machine learning motor performance prediction at the topology design and optimisation stage of structural components. The second area corresponds to the machine learning-supported experimental evaluation process of prototypes at desired test benches.}, author = {Botache, Diego}, booktitle = {Organic Computing – Doctoral Dissertation Colloquium 2023}, editor = {Tomforde, Sven and Krupitzer, Christian}, keywords = {itegpub}, pages = {14–26}, publisher = {kassel university press}, title = {Machine Learning Supported Optimisation and Experimental Evaluation of Electrical Motors for Small Urban Passenger Vehicles}, year = 2023 }
%0 Book Section %1 botache2023machine %A Botache, Diego %B Organic Computing -- Doctoral Dissertation Colloquium 2023 %D 2023 %E Tomforde, Sven %E Krupitzer, Christian %I kassel university press %P 14--26 %T Machine Learning Supported Optimisation and Experimental Evaluation of Electrical Motors for Small Urban Passenger Vehicles %X The increasing environmental pollution and rising global energy demands require the rapid development of novel and sustainable traction machines from urban transport up to large-scale transport vehicles. The optimisation of the development cycle of electrical traction machines plays a vital role in sustainable mobility. Still, developers have to face the difficulty of analysing time-consuming multiphysics simulations to assess the performance of many prototype variants. Accelerating this process involves implementing machine learning-supported strategies that can effectively acquire results and predictions about the performance and efficiency of prototypes in an iterative optimisation process and detect possible issues during the experimental procedure. The following research project streamlines the development cycle by identifying and presenting multiple strategies for applying and evaluating machine learning and deep learning techniques in different stages and areas in the development cycle including self-optimisation and self-adaptation capabilities. By implementing these strategies, the optimisation process can be further improved and become more efficient and robust, reducing the time and cost required for testing and validation. Therefore, this proposal addresses two application areas. The first area consists of the supported machine learning motor performance prediction at the topology design and optimisation stage of structural components. The second area corresponds to the machine learning-supported experimental evaluation process of prototypes at desired test benches.
1.
Botache, D., Dingel, K., Huhnstock, R., Ehresmann, A., Sick, B.: Unraveling the Complexity of Splitting Sequential Data: Tackling Challenges in Video and Time Series Analysis. arXiv e-prints. arXiv:2307.14294 (2023).
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
- [ URL ]
Splitting of sequential data, such as videos and time series, is an essential step in various data analysis tasks, including object tracking and anomaly detection. However, splitting sequential data presents a variety of challenges that can impact the accuracy and reliability of subsequent analyses. This concept article examines the challenges associated with splitting sequential data, including data acquisition, data representation, split ratio selection, setting up quality criteria, and choosing suitable selection strategies. We explore these challenges through two real-world examples: motor test benches and particle tracking in liquids.
@article{botache2023unraveling, abstract = {Splitting of sequential data, such as videos and time series, is an essential step in various data analysis tasks, including object tracking and anomaly detection. However, splitting sequential data presents a variety of challenges that can impact the accuracy and reliability of subsequent analyses. This concept article examines the challenges associated with splitting sequential data, including data acquisition, data representation, split ratio selection, setting up quality criteria, and choosing suitable selection strategies. We explore these challenges through two real-world examples: motor test benches and particle tracking in liquids.}, author = {Botache, Diego and Dingel, Kristina and Huhnstock, Rico and Ehresmann, Arno and Sick, Bernhard}, journal = {arXiv e-prints}, keywords = {itegpub}, pages = {arXiv:2307.14294}, title = {Unraveling the Complexity of Splitting Sequential Data: Tackling Challenges in Video and Time Series Analysis}, year = 2023 }
%0 Journal Article %1 botache2023unraveling %A Botache, Diego %A Dingel, Kristina %A Huhnstock, Rico %A Ehresmann, Arno %A Sick, Bernhard %D 2023 %J arXiv e-prints %P arXiv:2307.14294 %T Unraveling the Complexity of Splitting Sequential Data: Tackling Challenges in Video and Time Series Analysis %U https://arxiv.org/abs/2307.14294 %X Splitting of sequential data, such as videos and time series, is an essential step in various data analysis tasks, including object tracking and anomaly detection. However, splitting sequential data presents a variety of challenges that can impact the accuracy and reliability of subsequent analyses. This concept article examines the challenges associated with splitting sequential data, including data acquisition, data representation, split ratio selection, setting up quality criteria, and choosing suitable selection strategies. We explore these challenges through two real-world examples: motor test benches and particle tracking in liquids.

2022[ to top ]

1.
Westmeier, T., Botache, D., Bieshaar, M., Sick, B.: Generating Synthetic Time Series for Machine-Learning-Empowered Monitoring of Electric Motor Test Benches. In: IEEE International Conference on Data Science and Advanced Analytics (DSAA). bll 513–522. IEEE (2022). https://doi.org/10.1109/DSAA54385.2022.10032385.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
- [ URL ]
The development of new electric traction machines is a time-consuming process as it involves intensive testing on motor test benches. Machine-Learning-empowered monitoring offers the opportunity to anticipate costly failures early and hence reducing development time. However, machine learning (ML) for process monitoring requires large amounts of training data, especially as the targeted fault states are scarce and yet diverse in their appearances. Therefore, we propose to use synthetic time series data to leverage the high cost of acquiring training data from experiments in real test benches. In this article, we present a novel scheme to generate synthetic data based on a sub-dimensional time series representation. We introduce a highly flexible model by mapping the data to a latent representation and approximating the latent data distribution by a Gaussian Mixture Model. In addition, we propose the Frechet InceptionTime Distance (FITD) as a new distance measure to evaluate the generated data. It allows extracting characteristics at different scales by using multiple kernel sizes. In this way, we ensure that the synthesized data contains characteristics similar to those present in the real data. In our experiment, we train two types of fault detectors, one based on real data of a motor test bench and the other based on synthetic data. We also consider employing fault-aware conditional architectures to generate training data for different fault types explicitly. Our final results show that using synthesized data in the training process increases the performance in terms of classification accuracy score (CAS) up to 29%.
@inproceedings{westmeier2022generating, abstract = {The development of new electric traction machines is a time-consuming process as it involves intensive testing on motor test benches. Machine-Learning-empowered monitoring offers the opportunity to anticipate costly failures early and hence reducing development time. However, machine learning (ML) for process monitoring requires large amounts of training data, especially as the targeted fault states are scarce and yet diverse in their appearances. Therefore, we propose to use synthetic time series data to leverage the high cost of acquiring training data from experiments in real test benches. In this article, we present a novel scheme to generate synthetic data based on a sub-dimensional time series representation. We introduce a highly flexible model by mapping the data to a latent representation and approximating the latent data distribution by a Gaussian Mixture Model. In addition, we propose the Frechet InceptionTime Distance (FITD) as a new distance measure to evaluate the generated data. It allows extracting characteristics at different scales by using multiple kernel sizes. In this way, we ensure that the synthesized data contains characteristics similar to those present in the real data. In our experiment, we train two types of fault detectors, one based on real data of a motor test bench and the other based on synthetic data. We also consider employing fault-aware conditional architectures to generate training data for different fault types explicitly. Our final results show that using synthesized data in the training process increases the performance in terms of classification accuracy score (CAS) up to 29%.}, author = {Westmeier, Tobias and Botache, Diego and Bieshaar, Maarten and Sick, Bernhard}, booktitle = {IEEE International Conference on Data Science and Advanced Analytics (DSAA)}, keywords = {Variational-Autoencoder}, pages = {513–522}, publisher = {IEEE}, title = {Generating Synthetic Time Series for Machine-Learning-Empowered Monitoring of Electric Motor Test Benches}, year = 2022 }
%0 Conference Paper %1 westmeier2022generating %A Westmeier, Tobias %A Botache, Diego %A Bieshaar, Maarten %A Sick, Bernhard %B IEEE International Conference on Data Science and Advanced Analytics (DSAA) %D 2022 %I IEEE %P 513--522 %R 10.1109/DSAA54385.2022.10032385 %T Generating Synthetic Time Series for Machine-Learning-Empowered Monitoring of Electric Motor Test Benches %U https://ieeexplore.ieee.org/document/10032385 %X The development of new electric traction machines is a time-consuming process as it involves intensive testing on motor test benches. Machine-Learning-empowered monitoring offers the opportunity to anticipate costly failures early and hence reducing development time. However, machine learning (ML) for process monitoring requires large amounts of training data, especially as the targeted fault states are scarce and yet diverse in their appearances. Therefore, we propose to use synthetic time series data to leverage the high cost of acquiring training data from experiments in real test benches. In this article, we present a novel scheme to generate synthetic data based on a sub-dimensional time series representation. We introduce a highly flexible model by mapping the data to a latent representation and approximating the latent data distribution by a Gaussian Mixture Model. In addition, we propose the Frechet InceptionTime Distance (FITD) as a new distance measure to evaluate the generated data. It allows extracting characteristics at different scales by using multiple kernel sizes. In this way, we ensure that the synthesized data contains characteristics similar to those present in the real data. In our experiment, we train two types of fault detectors, one based on real data of a motor test bench and the other based on synthetic data. We also consider employing fault-aware conditional architectures to generate training data for different fault types explicitly. Our final results show that using synthesized data in the training process increases the performance in terms of classification accuracy score (CAS) up to 29%.
1.
Decke, J., Schmeißing, J., Botache, D., Bieshaar, M., Sick, B., Gruhl, C.: NDNET: A Unified Framework for Anomaly and Novelty Detection. In: International Conference on Architecture of Computing Systems (ARCS). bll 197–210. Springer (2022). https://doi.org/10.1007/978-3-031-21867-5_13.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
We introduce NDNET (https://novelty-detection.net/p/ndnet), an anomaly and novelty detection library that implements various detection algorithms adjusted for online processing of data streams. The intention of this library is threefold: 1) Make experimentation with different anomaly and novelty detection algorithms simple. 2) Support the development of new novelty detection approaches by providing the mCANDIES framework. 3) Provide fundamentals to analyze and evaluate novelty detection algorithms on data streams. The library is freely available and developed as open-source software.
@inproceedings{decke2022ndnet, abstract = {We introduce NDNET (https://novelty-detection.net/p/ndnet), an anomaly and novelty detection library that implements various detection algorithms adjusted for online processing of data streams. The intention of this library is threefold: 1) Make experimentation with different anomaly and novelty detection algorithms simple. 2) Support the development of new novelty detection approaches by providing the mCANDIES framework. 3) Provide fundamentals to analyze and evaluate novelty detection algorithms on data streams. The library is freely available and developed as open-source software.}, author = {Decke, Jens and Schmeißing, Jörn and Botache, Diego and Bieshaar, Maarten and Sick, Bernhard and Gruhl, Christian}, booktitle = {International Conference on Architecture of Computing Systems (ARCS)}, keywords = {itegpub}, pages = {197–210}, publisher = {Springer}, title = {{NDNET}: {A} Unified Framework for Anomaly and Novelty Detection}, year = 2022 }
%0 Conference Paper %1 decke2022ndnet %A Decke, Jens %A Schmeißing, Jörn %A Botache, Diego %A Bieshaar, Maarten %A Sick, Bernhard %A Gruhl, Christian %B International Conference on Architecture of Computing Systems (ARCS) %D 2022 %I Springer %P 197--210 %R 10.1007/978-3-031-21867-5_13 %T NDNET: A Unified Framework for Anomaly and Novelty Detection %X We introduce NDNET (https://novelty-detection.net/p/ndnet), an anomaly and novelty detection library that implements various detection algorithms adjusted for online processing of data streams. The intention of this library is threefold: 1) Make experimentation with different anomaly and novelty detection algorithms simple. 2) Support the development of new novelty detection approaches by providing the mCANDIES framework. 3) Provide fundamentals to analyze and evaluate novelty detection algorithms on data streams. The library is freely available and developed as open-source software.

2021[ to top ]

1.
Möller, F., Botache, D., Huseljic, D., Heidecker, F., Bieshaar, M., Sick, B.: Out-of-distribution Detection and Generation using Soft Brownian Offset Sampling and Autoencoders. In: Workshop on Safe Artificial Intelligence for Automated Driving (SAIAD), CVPR. bll 1–10 (2021).
- [ BibTeX ]
- [ EndNote ]
- [ URL ]
@inproceedings{moeller2021out, author = {Möller, Felix and Botache, Diego and Huseljic, Denis and Heidecker, Florian and Bieshaar, Maarten and Sick, Bernhard}, booktitle = {Workshop on Safe Artificial Intelligence for Automated Driving (SAIAD), CVPR}, keywords = {itegpub}, pages = {1–10}, title = {{Out-of-distribution Detection and Generation using Soft Brownian Offset Sampling and Autoencoders}}, year = 2021 }
%0 Conference Paper %1 moeller2021out %A Möller, Felix %A Botache, Diego %A Huseljic, Denis %A Heidecker, Florian %A Bieshaar, Maarten %A Sick, Bernhard %B Workshop on Safe Artificial Intelligence for Automated Driving (SAIAD), CVPR %D 2021 %P 1--10 %T Out-of-distribution Detection and Generation using Soft Brownian Offset Sampling and Autoencoders %U https://openaccess.thecvf.com/content/CVPR2021W/SAIAD/papers/Moller_Out-of-Distribution_Detection_and_Generation_Using_Soft_Brownian_Offset_Sampling_and_CVPRW_2021_paper.pdf
1.
Botache, D., Bethke, F., Hardieck, M., Bieshaar, M., Brabetz, L., Ayeb, M., Zipf, P., Sick, B.: Towards Highly Automated Machine-Learning-Empowered Monitoring of Motor Test Stands. In: IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS). bll 120–130. IEEE, Washington, DC, USA (2021). https://doi.org/10.1109/acsos52086.2021.00031.
- [ BibTeX ]
- [ EndNote ]
@inproceedings{botache2021towards, address = {Washington, DC, USA}, author = {Botache, Diego and Bethke, Florian and Hardieck, Martin and Bieshaar, Maarten and Brabetz, Ludwig and Ayeb, Mohamed and Zipf, Peter and Sick, Bernhard}, booktitle = {IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS)}, keywords = {itegpub}, pages = {120–130}, publisher = {IEEE}, title = {Towards Highly Automated Machine-Learning-Empowered Monitoring of Motor Test Stands}, year = 2021 }
%0 Conference Paper %1 botache2021towards %A Botache, Diego %A Bethke, Florian %A Hardieck, Martin %A Bieshaar, Maarten %A Brabetz, Ludwig %A Ayeb, Mohamed %A Zipf, Peter %A Sick, Bernhard %B IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS) %C Washington, DC, USA %D 2021 %I IEEE %P 120--130 %R 10.1109/acsos52086.2021.00031 %T Towards Highly Automated Machine-Learning-Empowered Monitoring of Motor Test Stands

2019[ to top ]

1.
Botache, D., Dandan, L., Bieshaar, M., Sick, B.: Early Pedestrian Movement Detection Using Smart Devices Based on Human Activity Recognition. In: INFORMATIK 2019: 50 Jahre Gesellschaft für Informatik -- Informatik für Gesellschaft (Workshop-Beiträge). bll 229–238. Gesellschaft für Informatik e.V., Bonn (2019). https://doi.org/10.18420/inf2019_ws26.
- [ BibTeX ]
- [ EndNote ]
@inproceedings{botache2019early, address = {Bonn}, author = {Botache, Diego and Dandan, Liu and Bieshaar, Maarten and Sick, Bernhard}, booktitle = {INFORMATIK 2019: 50 Jahre Gesellschaft für Informatik – Informatik für Gesellschaft (Workshop-Beiträge)}, keywords = {imported}, pages = {229–238}, publisher = {Gesellschaft für Informatik e.V.}, title = {Early Pedestrian Movement Detection Using Smart Devices Based on Human Activity Recognition}, year = 2019 }
%0 Conference Paper %1 botache2019early %A Botache, Diego %A Dandan, Liu %A Bieshaar, Maarten %A Sick, Bernhard %B INFORMATIK 2019: 50 Jahre Gesellschaft für Informatik -- Informatik für Gesellschaft (Workshop-Beiträge) %C Bonn %D 2019 %I Gesellschaft für Informatik e.V. %P 229--238 %R 10.18420/inf2019_ws26 %T Early Pedestrian Movement Detection Using Smart Devices Based on Human Activity Recognition