M. Sc. Yujiang He

AI for Computationally Intelligent Systems (AI4CIS)

Telephone: +49 561 804-6184
Fax: +49 561 804-6022
Email: Yujiang.he[at]uni-kassel[dot]de

Publications

[ 2022 ]
[ 2021 ]
[ 2020 ]
[ 2017 ]

2022[ to top ]

He, Y., Huang, Z., Sick, B.: Design of Explainability Module with Experts in the Loop for Visualization and Dynamic Adjustment of Continual Learning In: Workshop on Interactive Machine Learning Workshop (IMLW), AAAI. bll 1–6 (2022).
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
- [ URL ]
Continual learning can enable neural networks to evolve by learning new tasks sequentially in task-changing scenarios. However, two general challenges should be overcome in further research before we apply this technique to real-world applications. Firstly, newly collected novelties from the data stream in applications could contain anomalies that are meaningless for continual learning. Instead of viewing them as a new task for updating, we have to filter out such anomalies to reduce the disturbance of extremely high-entropy data for the progression of convergence. Secondly, fewer efforts have been put into research regarding the explainability of continual learning, which leads to a lack of transparency and credibility of the updated neural networks. Elaborated explanations about the process and result of continual learning can help experts in judgment and making decisions. Therefore, we propose the conceptual design of an explainability module with experts in the loop based on techniques, such as dimension reduction, visualization, and evaluation strategies. This work aims to overcome the mentioned challenges by sufficiently explaining and visualizing the identified anomalies and the updated neural network. With the help of this module, experts can be more confident in decision-making regarding anomaly filtering, dynamic adjustment of hyperparameters, data backup, etc.
@inproceedings{he2022design, abstract = {Continual learning can enable neural networks to evolve by learning new tasks sequentially in task-changing scenarios. However, two general challenges should be overcome in further research before we apply this technique to real-world applications. Firstly, newly collected novelties from the data stream in applications could contain anomalies that are meaningless for continual learning. Instead of viewing them as a new task for updating, we have to filter out such anomalies to reduce the disturbance of extremely high-entropy data for the progression of convergence. Secondly, fewer efforts have been put into research regarding the explainability of continual learning, which leads to a lack of transparency and credibility of the updated neural networks. Elaborated explanations about the process and result of continual learning can help experts in judgment and making decisions. Therefore, we propose the conceptual design of an explainability module with experts in the loop based on techniques, such as dimension reduction, visualization, and evaluation strategies. This work aims to overcome the mentioned challenges by sufficiently explaining and visualizing the identified anomalies and the updated neural network. With the help of this module, experts can be more confident in decision-making regarding anomaly filtering, dynamic adjustment of hyperparameters, data backup, etc.}, author = {He, Yujiang and Huang, Zhixin and Sick, Bernhard}, booktitle = {Workshop on Interactive Machine Learning Workshop (IMLW), AAAI}, keywords = {itegpub}, pages = {1–6}, title = {Design of Explainability Module with Experts in the Loop for Visualization and Dynamic Adjustment of Continual Learning}, year = 2022 }
%0 Conference Paper %1 he2022design %A He, Yujiang %A Huang, Zhixin %A Sick, Bernhard %B Workshop on Interactive Machine Learning Workshop (IMLW), AAAI %D 2022 %P 1--6 %T Design of Explainability Module with Experts in the Loop for Visualization and Dynamic Adjustment of Continual Learning %U https://arxiv.org/abs/2202.06781 %X Continual learning can enable neural networks to evolve by learning new tasks sequentially in task-changing scenarios. However, two general challenges should be overcome in further research before we apply this technique to real-world applications. Firstly, newly collected novelties from the data stream in applications could contain anomalies that are meaningless for continual learning. Instead of viewing them as a new task for updating, we have to filter out such anomalies to reduce the disturbance of extremely high-entropy data for the progression of convergence. Secondly, fewer efforts have been put into research regarding the explainability of continual learning, which leads to a lack of transparency and credibility of the updated neural networks. Elaborated explanations about the process and result of continual learning can help experts in judgment and making decisions. Therefore, we propose the conceptual design of an explainability module with experts in the loop based on techniques, such as dimension reduction, visualization, and evaluation strategies. This work aims to overcome the mentioned challenges by sufficiently explaining and visualizing the identified anomalies and the updated neural network. With the help of this module, experts can be more confident in decision-making regarding anomaly filtering, dynamic adjustment of hyperparameters, data backup, etc.
He, Y.: Adaptive Explainable Continual Learning Framework for Regression Problems with Focus on Power Forecasts In: Tomforde, S. en Krupitzer, C. (reds) Organic Computing -- Doctoral Dissertation Colloquium 2021. bll 125–140. kassel university press (2022).
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
Compared with traditional deep learning techniques, continual learning enables deep neural networks to learn continually and adaptively. Deep neural networks have to learn unseen tasks and overcome forgetting the knowledge obtained from previously learned tasks as the amount of data keeps increasing in applications. This article proposes two continual learning application scenarios, i.e., the target-domain incremental scenario and the data-domain incremental scenario, to describe the potential challenges in this context. Based on our previous work regarding the CLeaR framework, which is short for continual learning for regression tasks, models will be enabled to extend themselves and to learn data successively. Research topics are related, but not limited, to developing continual deep learning algorithms, strategies for non-stationarity detection in data streams, explainable and visualizable artificial intelligence, etc. Moreover, the framework- and algorithm-related hyperparameters should be dynamically updated in applications. Forecasting experiments will be conducted based on power generation and consumption data collected from real-world applications. A series of comprehensive evaluation metrics and visualization tools are applied to access the experimental results. The proposed framework is expected to be generally applied to other constantly changing scenarios.
@incollection{he2022adaptive, abstract = {Compared with traditional deep learning techniques, continual learning enables deep neural networks to learn continually and adaptively. Deep neural networks have to learn unseen tasks and overcome forgetting the knowledge obtained from previously learned tasks as the amount of data keeps increasing in applications. This article proposes two continual learning application scenarios, i.e., the target-domain incremental scenario and the data-domain incremental scenario, to describe the potential challenges in this context. Based on our previous work regarding the CLeaR framework, which is short for continual learning for regression tasks, models will be enabled to extend themselves and to learn data successively. Research topics are related, but not limited, to developing continual deep learning algorithms, strategies for non-stationarity detection in data streams, explainable and visualizable artificial intelligence, etc. Moreover, the framework- and algorithm-related hyperparameters should be dynamically updated in applications. Forecasting experiments will be conducted based on power generation and consumption data collected from real-world applications. A series of comprehensive evaluation metrics and visualization tools are applied to access the experimental results. The proposed framework is expected to be generally applied to other constantly changing scenarios.}, author = {He, Yujiang}, booktitle = {Organic Computing – Doctoral Dissertation Colloquium 2021}, editor = {Tomforde, Sven and Krupitzer, Christian}, keywords = {itegpub}, pages = {125–140}, publisher = {kassel university press}, title = {Adaptive Explainable Continual Learning Framework for Regression Problems with Focus on Power Forecasts}, year = 2022 }
%0 Book Section %1 he2022adaptive %A He, Yujiang %B Organic Computing -- Doctoral Dissertation Colloquium 2021 %D 2022 %E Tomforde, Sven %E Krupitzer, Christian %I kassel university press %P 125--140 %T Adaptive Explainable Continual Learning Framework for Regression Problems with Focus on Power Forecasts %X Compared with traditional deep learning techniques, continual learning enables deep neural networks to learn continually and adaptively. Deep neural networks have to learn unseen tasks and overcome forgetting the knowledge obtained from previously learned tasks as the amount of data keeps increasing in applications. This article proposes two continual learning application scenarios, i.e., the target-domain incremental scenario and the data-domain incremental scenario, to describe the potential challenges in this context. Based on our previous work regarding the CLeaR framework, which is short for continual learning for regression tasks, models will be enabled to extend themselves and to learn data successively. Research topics are related, but not limited, to developing continual deep learning algorithms, strategies for non-stationarity detection in data streams, explainable and visualizable artificial intelligence, etc. Moreover, the framework- and algorithm-related hyperparameters should be dynamically updated in applications. Forecasting experiments will be conducted based on power generation and consumption data collected from real-world applications. A series of comprehensive evaluation metrics and visualization tools are applied to access the experimental results. The proposed framework is expected to be generally applied to other constantly changing scenarios.

2021[ to top ]

Huang, Z., He, Y., Vogt, S., Sick, B.: Uncertainty and Utility Sampling with Pre-Clustering In: Workshop on Interactive Adaptive Learning (IAL), ECML PKDD (2021).
- [ BibTeX ]
- [ EndNote ]
@inproceedings{huang2021uncertainty, author = {Huang, Zhixin and He, Yujiang and Vogt, Stephan and Sick, Bernhard}, booktitle = {Workshop on Interactive Adaptive Learning (IAL), ECML PKDD}, keywords = {itegpub}, note = {(accepted)}, title = {Uncertainty and Utility Sampling with Pre-Clustering}, year = 2021 }
%0 Conference Paper %1 huang2021uncertainty %A Huang, Zhixin %A He, Yujiang %A Vogt, Stephan %A Sick, Bernhard %B Workshop on Interactive Adaptive Learning (IAL), ECML PKDD %D 2021 %T Uncertainty and Utility Sampling with Pre-Clustering
He, Y., Huang, Z., Sick, B.: Toward Application of Continuous Power Forecasts in a Regional Flexibility Market In: International Joint Conference on Neural Networks (IJCNN). bll 1–8. IEEE (2021). https://doi.org/10.1109/ijcnn52387.2021.9533626.
- [ BibTeX ]
- [ EndNote ]
@inproceedings{he2021application, author = {He, Yujiang and Huang, Zhixin and Sick, Bernhard}, booktitle = {International Joint Conference on Neural Networks (IJCNN)}, keywords = {itegpub}, pages = {1–8}, publisher = {IEEE}, title = {Toward Application of Continuous Power Forecasts in a Regional Flexibility Market}, year = 2021 }
%0 Conference Paper %1 he2021application %A He, Yujiang %A Huang, Zhixin %A Sick, Bernhard %B International Joint Conference on Neural Networks (IJCNN) %D 2021 %I IEEE %P 1--8 %R 10.1109/ijcnn52387.2021.9533626 %T Toward Application of Continuous Power Forecasts in a Regional Flexibility Market
He, Y., Sick, B.: CLeaR: An adaptive continual learning framework for regression tasks AI Perspectives. 3, 2 (2020). https://doi.org/10.1186/s42467-021-00009-8.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
- [ URL ]
Catastrophic forgetting means that a trained neural network model gradually forgets the previously learned tasks when being retrained on new tasks. Overcoming the forgetting problem is a major problem in machine learning. Numerous continual learning algorithms are very successful in incremental learning of classification tasks, where new samples with their labels appear frequently. However, there is currently no research that addresses the catastrophic forgetting problem in regression tasks as far as we know. This problem has emerged as one of the primary constraints in some applications, such as renewable energy forecasts. This article clarifies problem-related definitions and proposes a new methodological framework that can forecast targets and update itself by means of continual learning. The framework consists of forecasting neural networks and buffers, which store newly collected data from a non-stationary data stream in an application. The changed probability distribution of the data stream, which the framework has identified, will be learned sequentially. The framework is called CLeaR (Continual Learning for Regression Tasks), where components can be flexibly customized for a specific application scenario. We design two sets of experiments to evaluate the CLeaR framework concerning fitting error (training), prediction error (test), and forgetting ratio. The first one is based on an artificial time series to explore how hyperparameters affect the CLeaR framework. The second one is designed with data collected from European wind farms to evaluate the CLeaR framework's performance in a real-world application. The experimental results demonstrate that the CLeaR framework can continually acquire knowledge in the data stream and improve the prediction accuracy. The article concludes with further research issues arising from requirements to extend the framework.
@article{he2021clear, abstract = {Catastrophic forgetting means that a trained neural network model gradually forgets the previously learned tasks when being retrained on new tasks. Overcoming the forgetting problem is a major problem in machine learning. Numerous continual learning algorithms are very successful in incremental learning of classification tasks, where new samples with their labels appear frequently. However, there is currently no research that addresses the catastrophic forgetting problem in regression tasks as far as we know. This problem has emerged as one of the primary constraints in some applications, such as renewable energy forecasts. This article clarifies problem-related definitions and proposes a new methodological framework that can forecast targets and update itself by means of continual learning. The framework consists of forecasting neural networks and buffers, which store newly collected data from a non-stationary data stream in an application. The changed probability distribution of the data stream, which the framework has identified, will be learned sequentially. The framework is called CLeaR (Continual Learning for Regression Tasks), where components can be flexibly customized for a specific application scenario. We design two sets of experiments to evaluate the CLeaR framework concerning fitting error (training), prediction error (test), and forgetting ratio. The first one is based on an artificial time series to explore how hyperparameters affect the CLeaR framework. The second one is designed with data collected from European wind farms to evaluate the CLeaR framework's performance in a real-world application. The experimental results demonstrate that the CLeaR framework can continually acquire knowledge in the data stream and improve the prediction accuracy. The article concludes with further research issues arising from requirements to extend the framework.}, author = {He, Yujiang and Sick, Bernhard}, journal = {AI Perspectives}, keywords = {itegpub}, number = 1, pages = 2, publisher = {Springer}, title = {CLeaR: An adaptive continual learning framework for regression tasks}, volume = 3, year = 2021 }
%0 Journal Article %1 he2021clear %A He, Yujiang %A Sick, Bernhard %D 2021 %I Springer %J AI Perspectives %N 1 %P 2 %R 10.1186/s42467-021-00009-8 %T CLeaR: An adaptive continual learning framework for regression tasks %U https://doi.org/10.1186/s42467-021-00009-8 %V 3 %X Catastrophic forgetting means that a trained neural network model gradually forgets the previously learned tasks when being retrained on new tasks. Overcoming the forgetting problem is a major problem in machine learning. Numerous continual learning algorithms are very successful in incremental learning of classification tasks, where new samples with their labels appear frequently. However, there is currently no research that addresses the catastrophic forgetting problem in regression tasks as far as we know. This problem has emerged as one of the primary constraints in some applications, such as renewable energy forecasts. This article clarifies problem-related definitions and proposes a new methodological framework that can forecast targets and update itself by means of continual learning. The framework consists of forecasting neural networks and buffers, which store newly collected data from a non-stationary data stream in an application. The changed probability distribution of the data stream, which the framework has identified, will be learned sequentially. The framework is called CLeaR (Continual Learning for Regression Tasks), where components can be flexibly customized for a specific application scenario. We design two sets of experiments to evaluate the CLeaR framework concerning fitting error (training), prediction error (test), and forgetting ratio. The first one is based on an artificial time series to explore how hyperparameters affect the CLeaR framework. The second one is designed with data collected from European wind farms to evaluate the CLeaR framework's performance in a real-world application. The experimental results demonstrate that the CLeaR framework can continually acquire knowledge in the data stream and improve the prediction accuracy. The article concludes with further research issues arising from requirements to extend the framework.

2020[ to top ]

He, Y., Henze, J., Sick, B.: Forecasting Power Grid States for Regional Energy Markets with Deep Neural Networks In: International Joint Conference on Neural Networks (IJCNN). IEEE (2020). https://doi.org/10.1109/ijcnn48605.2020.9207536.
- [ BibTeX ]
- [ EndNote ]
@inproceedings{he2020forecasting, author = {{He}, Y. and {Henze}, J. and {Sick}, B.}, booktitle = {International Joint Conference on Neural Networks (IJCNN)}, keywords = {itegpub}, publisher = {IEEE}, title = {Forecasting Power Grid States for Regional Energy Markets with Deep Neural Networks}, year = 2020 }
%0 Conference Paper %1 he2020forecasting %A He, Y. %A Henze, J. %A Sick, B. %B International Joint Conference on Neural Networks (IJCNN) %D 2020 %I IEEE %R 10.1109/ijcnn48605.2020.9207536 %T Forecasting Power Grid States for Regional Energy Markets with Deep Neural Networks
He, Y., Henze, J., Sick, B.: Continuous Learning of Deep Neural Networks to Improve Forecasts for Regional Energy Markets In: International Federation of Automatic Control (IFAC) World Congress. bll 12175–12182. Elsevier (2020). https://doi.org/10.1016/j.ifacol.2020.12.1017.
- [ BibTeX ]
- [ EndNote ]
@inproceedings{he2020continuous, author = {He, Yujiang and Henze, Janosch and Sick, Bernhard}, booktitle = {{International Federation of Automatic Control (IFAC) World Congress}}, keywords = {itegpub}, pages = {12175–12182}, publisher = {Elsevier}, title = {Continuous Learning of Deep Neural Networks to Improve Forecasts for Regional Energy Markets}, year = 2020 }
%0 Conference Paper %1 he2020continuous %A He, Yujiang %A Henze, Janosch %A Sick, Bernhard %B International Federation of Automatic Control (IFAC) World Congress %D 2020 %I Elsevier %P 12175--12182 %R 10.1016/j.ifacol.2020.12.1017 %T Continuous Learning of Deep Neural Networks to Improve Forecasts for Regional Energy Markets

2017[ to top ]

Zhou, B., Cheng, J., Mawandia, A., He, Y., Huang, Z., Sundholm, M., Yildrim, M., Cruz, H., Lukowicz, P.: TPM Framework: a Comprehensive Kit for Exploring Applications with Textile Pressure Mapping Matrix In: International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies (UBICOMM). IARIA (2017).
- [ BibTeX ]
- [ EndNote ]
@inproceedings{zhou2017tpm, author = {Zhou, Bo and Cheng, Jingyuan and Mawandia, Ankur and He, Yujiang and Huang, Zhixin and Sundholm, Mathias and Yildrim, Muhammet and Cruz, Heber and Lukowicz, Paul}, booktitle = {International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies (UBICOMM)}, keywords = {not_ies}, publisher = {IARIA}, title = {TPM Framework: a Comprehensive Kit for Exploring Applications with Textile Pressure Mapping Matrix}, year = 2017 }
%0 Conference Paper %1 zhou2017tpm %A Zhou, Bo %A Cheng, Jingyuan %A Mawandia, Ankur %A He, Yujiang %A Huang, Zhixin %A Sundholm, Mathias %A Yildrim, Muhammet %A Cruz, Heber %A Lukowicz, Paul %B International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies (UBICOMM) %D 2017 %I IARIA %T TPM Framework: a Comprehensive Kit for Exploring Applications with Textile Pressure Mapping Matrix