M. Mgt. Chandana Priya Nivarthi

Autonomous Energy Systems (AESy)

E-Mail: chandana.nivarthi[at]uni-kassel[dot]de

Publikationen

[ 2024 ]
[ 2023 ]
[ 2022 ]
[ 2021 ]
[ 2020 ]

2024[ to top ]

Time-Series Representation Learning via Heterogeneous Spatial-Temporal Contrasting for Remaining Useful Life Prediction. Huang, Zhixin; He, Yujiang; Nivarthi, Chandana Priya; Gruhl, Christian; Sick, Bernhard. In International Conference on Pattern Recognition (ICPR), bll 1–21. Springer, 2024.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
Classical contrastive learning paradigms rely on manual augmentations like cropping, masking, dropping, or adding noise randomly to create divergent sample views from original data. However, the choice of which method to manipulate samples is often subjective and may destroy the latent pattern of the sample. In response, this paper introduces a novel contrastive learning paradigm without choosing sample view augmentation methods, termed Heterogeneous Spatial-Temporal Representation Contrasting (HSTRC). Instead of sample view augmentation, we employ dual branches with a heterogeneous spatial-temporal flipped structure to extract two distinct hidden feature views from the same source data, which avoids disturbing the original time series. Leveraging a combination of cross-branch spatial-temporal contrastive and projected feature contrastive loss functions, HSTRC can effectively extract robust representations from unlabeled time series data. Remarkably, by only fine-tuning the fully connected layers on top of extracted representations by HSTRC, we achieve the best performance across several Remaining Useful Life prediction datasets, showing up to 19.2% improvements over the state-of-the-art supervised learning methods and classical contrastive learning paradigms. Besides, further intensive experiments demonstrate HSTRC's effectiveness in active learning, out-of-distribution testing, and transfer learning scenarios.
@inproceedings{huang2024time, abstract = {Classical contrastive learning paradigms rely on manual augmentations like cropping, masking, dropping, or adding noise randomly to create divergent sample views from original data. However, the choice of which method to manipulate samples is often subjective and may destroy the latent pattern of the sample. In response, this paper introduces a novel contrastive learning paradigm without choosing sample view augmentation methods, termed Heterogeneous Spatial-Temporal Representation Contrasting (HSTRC). Instead of sample view augmentation, we employ dual branches with a heterogeneous spatial-temporal flipped structure to extract two distinct hidden feature views from the same source data, which avoids disturbing the original time series. Leveraging a combination of cross-branch spatial-temporal contrastive and projected feature contrastive loss functions, HSTRC can effectively extract robust representations from unlabeled time series data. Remarkably, by only fine-tuning the fully connected layers on top of extracted representations by HSTRC, we achieve the best performance across several Remaining Useful Life prediction datasets, showing up to 19.2% improvements over the state-of-the-art supervised learning methods and classical contrastive learning paradigms. Besides, further intensive experiments demonstrate HSTRC's effectiveness in active learning, out-of-distribution testing, and transfer learning scenarios.}, author = {Huang, Zhixin and He, Yujiang and Nivarthi, Chandana Priya and Gruhl, Christian and Sick, Bernhard}, booktitle = {International Conference on Pattern Recognition (ICPR)}, keywords = {itegpub}, pages = {1–21}, publisher = {Springer}, title = {Time-Series Representation Learning via Heterogeneous Spatial-Temporal Contrasting for Remaining Useful Life Prediction}, year = 2024 }
%0 Conference Paper %1 huang2024time %A Huang, Zhixin %A He, Yujiang %A Nivarthi, Chandana Priya %A Gruhl, Christian %A Sick, Bernhard %B International Conference on Pattern Recognition (ICPR) %D 2024 %I Springer %P 1--21 %R 10.1007/978-3-031-78398-2_1 %T Time-Series Representation Learning via Heterogeneous Spatial-Temporal Contrasting for Remaining Useful Life Prediction %X Classical contrastive learning paradigms rely on manual augmentations like cropping, masking, dropping, or adding noise randomly to create divergent sample views from original data. However, the choice of which method to manipulate samples is often subjective and may destroy the latent pattern of the sample. In response, this paper introduces a novel contrastive learning paradigm without choosing sample view augmentation methods, termed Heterogeneous Spatial-Temporal Representation Contrasting (HSTRC). Instead of sample view augmentation, we employ dual branches with a heterogeneous spatial-temporal flipped structure to extract two distinct hidden feature views from the same source data, which avoids disturbing the original time series. Leveraging a combination of cross-branch spatial-temporal contrastive and projected feature contrastive loss functions, HSTRC can effectively extract robust representations from unlabeled time series data. Remarkably, by only fine-tuning the fully connected layers on top of extracted representations by HSTRC, we achieve the best performance across several Remaining Useful Life prediction datasets, showing up to 19.2% improvements over the state-of-the-art supervised learning methods and classical contrastive learning paradigms. Besides, further intensive experiments demonstrate HSTRC's effectiveness in active learning, out-of-distribution testing, and transfer learning scenarios.
Spatial-Temporal Attention Graph Neural Network with Uncertainty Estimation for Remaining Useful Life Prediction. Huang, Zhixin; Nivarthi, Chandana Priya; Gruhl, Christian; Sick, Bernhard. In International Joint Conference on Neural Networks (IJCNN), bll 1–9. IEEE, 2024.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
In the increasingly complex industrial system health management domain, accurate prediction of remaining useful life plays an essential role. This paper analyzes the methods to improve the predictive performance of remaining useful life from three aspects: optimizing model structures, augmenting uncertainty estimation in predictions, and transitioning normalization methods. Based on our analysis, we propose a novel model, the Uncertainty Spatial-Temporal Attention Graph Neural Network (USTAGNN), which consists of three primary components: sensor graph construction, a spatio-temporal feature extractor, and a probabilistic prediction module. The feature extractor leverages graph neural networks and temporal convolutional networks as a foundation to extract spatial and temporal features, further enhanced by attention mechanisms, spectral normalization, and residual connections to bolster its distance awareness. Following extensive experimental comparisons, we utilized the parameter-driven dynamic adjacency matrix for sensor graph construction and the deep kernel Gaussian process for precise uncertainty estimation. USTAGNN tries to resolve issues not thoroughly addressed in existing research, such as comparative analyses of sensor graph construction methods, accurate uncertainty estimation, and the model’s generalization under different preprocessing conditions. The proposed model demonstrated state-of-the-art performance on various subsets of the C-MAPSS dataset, achieving up to a 35.9% improvement in prediction score.
@inproceedings{huang2024spatial, abstract = {In the increasingly complex industrial system health management domain, accurate prediction of remaining useful life plays an essential role. This paper analyzes the methods to improve the predictive performance of remaining useful life from three aspects: optimizing model structures, augmenting uncertainty estimation in predictions, and transitioning normalization methods. Based on our analysis, we propose a novel model, the Uncertainty Spatial-Temporal Attention Graph Neural Network (USTAGNN), which consists of three primary components: sensor graph construction, a spatio-temporal feature extractor, and a probabilistic prediction module. The feature extractor leverages graph neural networks and temporal convolutional networks as a foundation to extract spatial and temporal features, further enhanced by attention mechanisms, spectral normalization, and residual connections to bolster its distance awareness. Following extensive experimental comparisons, we utilized the parameter-driven dynamic adjacency matrix for sensor graph construction and the deep kernel Gaussian process for precise uncertainty estimation. USTAGNN tries to resolve issues not thoroughly addressed in existing research, such as comparative analyses of sensor graph construction methods, accurate uncertainty estimation, and the model’s generalization under different preprocessing conditions. The proposed model demonstrated state-of-the-art performance on various subsets of the C-MAPSS dataset, achieving up to a 35.9% improvement in prediction score.}, author = {Huang, Zhixin and Nivarthi, Chandana Priya and Gruhl, Christian and Sick, Bernhard}, booktitle = {International Joint Conference on Neural Networks (IJCNN)}, keywords = {itegpub}, pages = {1–9}, publisher = {IEEE}, title = {Spatial-Temporal Attention Graph Neural Network with Uncertainty Estimation for Remaining Useful Life Prediction}, year = 2024 }
%0 Conference Paper %1 huang2024spatial %A Huang, Zhixin %A Nivarthi, Chandana Priya %A Gruhl, Christian %A Sick, Bernhard %B International Joint Conference on Neural Networks (IJCNN) %D 2024 %I IEEE %P 1--9 %R 10.1109/IJCNN60899.2024.10650622 %T Spatial-Temporal Attention Graph Neural Network with Uncertainty Estimation for Remaining Useful Life Prediction %X In the increasingly complex industrial system health management domain, accurate prediction of remaining useful life plays an essential role. This paper analyzes the methods to improve the predictive performance of remaining useful life from three aspects: optimizing model structures, augmenting uncertainty estimation in predictions, and transitioning normalization methods. Based on our analysis, we propose a novel model, the Uncertainty Spatial-Temporal Attention Graph Neural Network (USTAGNN), which consists of three primary components: sensor graph construction, a spatio-temporal feature extractor, and a probabilistic prediction module. The feature extractor leverages graph neural networks and temporal convolutional networks as a foundation to extract spatial and temporal features, further enhanced by attention mechanisms, spectral normalization, and residual connections to bolster its distance awareness. Following extensive experimental comparisons, we utilized the parameter-driven dynamic adjacency matrix for sensor graph construction and the deep kernel Gaussian process for precise uncertainty estimation. USTAGNN tries to resolve issues not thoroughly addressed in existing research, such as comparative analyses of sensor graph construction methods, accurate uncertainty estimation, and the model’s generalization under different preprocessing conditions. The proposed model demonstrated state-of-the-art performance on various subsets of the C-MAPSS dataset, achieving up to a 35.9% improvement in prediction score.
Multi-Task Representation Learning with Temporal Attention for Zero-Shot Time Series Anomaly Detection. Nivarthi, Chandana Priya; Huang, Zhixin; Gruhl, Christian; Sick, Bernhard. In International Joint Conference on Neural Networks (IJCNN), bll 1–10. IEEE, 2024.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
Ensuring the reliability of critical industrial systems across various sectors is crucial. It is essential to detect deviations from regular behaviour to mitigate disruptions and preserve infrastructure integrity. However, accurately labelling anomaly datasets is challenging due to their rarity and manual annotation subjectivity. The conventional approach of training separate models for each dataset entity further complicates model development. This paper presents a novel Multi-task Learning framework combining LSTM Autoencoder with temporal attention mechanism (MTL-LATAM) for effective time series anomaly detection. Multitask learning models improve adaptability and generalizability, leading to reduced runtime and compute power while supporting zero-shot evaluation. These models offer flexibility in detecting emerging anomalies. Additionally, we introduce a dynamic thresholding mechanism to incorporate temporal context for anomaly detection and provide visualizations of attention weights to enhance interpretability. The study compares MTL- LATAM, with other multi-task models, evaluates multi-task versus single-task models and assesses the performance of the proposed frame- work in zero-shot learning scenarios. The findings indicate MTL- LATAM’s effectiveness across real-world and open-source datasets, achieving 95% and 97% task synergy. The results underscore the superior performance of multi-task models in zero-shot tasks compared to individual models trained exclusively on their respective datasets.
@inproceedings{nivarthi2024multi, abstract = {Ensuring the reliability of critical industrial systems across various sectors is crucial. It is essential to detect deviations from regular behaviour to mitigate disruptions and preserve infrastructure integrity. However, accurately labelling anomaly datasets is challenging due to their rarity and manual annotation subjectivity. The conventional approach of training separate models for each dataset entity further complicates model development. This paper presents a novel Multi-task Learning framework combining LSTM Autoencoder with temporal attention mechanism (MTL-LATAM) for effective time series anomaly detection. Multitask learning models improve adaptability and generalizability, leading to reduced runtime and compute power while supporting zero-shot evaluation. These models offer flexibility in detecting emerging anomalies. Additionally, we introduce a dynamic thresholding mechanism to incorporate temporal context for anomaly detection and provide visualizations of attention weights to enhance interpretability. The study compares MTL- LATAM, with other multi-task models, evaluates multi-task versus single-task models and assesses the performance of the proposed frame- work in zero-shot learning scenarios. The findings indicate MTL- LATAM’s effectiveness across real-world and open-source datasets, achieving 95% and 97% task synergy. The results underscore the superior performance of multi-task models in zero-shot tasks compared to individual models trained exclusively on their respective datasets.}, author = {Nivarthi, Chandana Priya and Huang, Zhixin and Gruhl, Christian and Sick, Bernhard}, booktitle = {International Joint Conference on Neural Networks (IJCNN)}, keywords = {itegpub}, pages = {1–10}, publisher = {IEEE}, title = {Multi-Task Representation Learning with Temporal Attention for Zero-Shot Time Series Anomaly Detection}, year = 2024 }
%0 Conference Paper %1 nivarthi2024multi %A Nivarthi, Chandana Priya %A Huang, Zhixin %A Gruhl, Christian %A Sick, Bernhard %B International Joint Conference on Neural Networks (IJCNN) %D 2024 %I IEEE %P 1--10 %R 10.1109/IJCNN60899.2024.10651344 %T Multi-Task Representation Learning with Temporal Attention for Zero-Shot Time Series Anomaly Detection %X Ensuring the reliability of critical industrial systems across various sectors is crucial. It is essential to detect deviations from regular behaviour to mitigate disruptions and preserve infrastructure integrity. However, accurately labelling anomaly datasets is challenging due to their rarity and manual annotation subjectivity. The conventional approach of training separate models for each dataset entity further complicates model development. This paper presents a novel Multi-task Learning framework combining LSTM Autoencoder with temporal attention mechanism (MTL-LATAM) for effective time series anomaly detection. Multitask learning models improve adaptability and generalizability, leading to reduced runtime and compute power while supporting zero-shot evaluation. These models offer flexibility in detecting emerging anomalies. Additionally, we introduce a dynamic thresholding mechanism to incorporate temporal context for anomaly detection and provide visualizations of attention weights to enhance interpretability. The study compares MTL- LATAM, with other multi-task models, evaluates multi-task versus single-task models and assesses the performance of the proposed frame- work in zero-shot learning scenarios. The findings indicate MTL- LATAM’s effectiveness across real-world and open-source datasets, achieving 95% and 97% task synergy. The results underscore the superior performance of multi-task models in zero-shot tasks compared to individual models trained exclusively on their respective datasets.

2023[ to top ]

Towards Few-Shot Time Series Anomaly Detection with Temporal Attention and Dynamic Thresholding. Nivarthi, Chandana Priya; Sick, Bernhard. In International Conference on Machine Learning and Applications (ICMLA), bll 1444–1450. IEEE, 2023.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
Anomaly detection plays a pivotal role in diverse realworld applications such as cybersecurity, fault detection, network monitoring, predictive maintenance, and highly automated driving. However, obtaining labeled anomalous data can be a formidable challenge, especially when anomalies exhibit temporal evolution. This paper introduces LATAM (Long short-term memory Autoencoder with Temporal Attention Mechanism) for few-shot anomaly detection, with the aim of enhancing detection performance in scenarios with limited labeled anomaly data. LATAM effectively captures temporal dependencies and emphasizes significant patterns in multivariate time series data. In our investigation, we comprehensively evaluate LATAM against other anomaly detection models, particularly assessing its capability in few-shot learning scenarios where we have minimal examples from the normal class and none from the anomalous class in the training data. Our experimental results, derived from real-world photovoltaic inverter data, highlight LATAM’s superiority, showcasing a substantial 27% mean F1 score improvement, even when trained on a mere two-week dataset. Furthermore, LATAM demonstrates remarkable results on the open-source SWaT dataset, achieving a 12% boost in accuracy with only two days of training data. Moreover, we introduce a simple yet effective dynamic thresholding mechanism, further enhancing the anomaly detection capabilities of LATAM. This underscores LATAM’s efficacy in addressing the challenges posed by limited labeled anomalies in practical scenarios and it proves valuable for downstream tasks involving temporal representation and time series prediction, extending its utility beyond anomaly detection applications.
@inproceedings{nivarthi2023towards, abstract = {Anomaly detection plays a pivotal role in diverse realworld applications such as cybersecurity, fault detection, network monitoring, predictive maintenance, and highly automated driving. However, obtaining labeled anomalous data can be a formidable challenge, especially when anomalies exhibit temporal evolution. This paper introduces LATAM (Long short-term memory Autoencoder with Temporal Attention Mechanism) for few-shot anomaly detection, with the aim of enhancing detection performance in scenarios with limited labeled anomaly data. LATAM effectively captures temporal dependencies and emphasizes significant patterns in multivariate time series data. In our investigation, we comprehensively evaluate LATAM against other anomaly detection models, particularly assessing its capability in few-shot learning scenarios where we have minimal examples from the normal class and none from the anomalous class in the training data. Our experimental results, derived from real-world photovoltaic inverter data, highlight LATAM’s superiority, showcasing a substantial 27% mean F1 score improvement, even when trained on a mere two-week dataset. Furthermore, LATAM demonstrates remarkable results on the open-source SWaT dataset, achieving a 12% boost in accuracy with only two days of training data. Moreover, we introduce a simple yet effective dynamic thresholding mechanism, further enhancing the anomaly detection capabilities of LATAM. This underscores LATAM’s efficacy in addressing the challenges posed by limited labeled anomalies in practical scenarios and it proves valuable for downstream tasks involving temporal representation and time series prediction, extending its utility beyond anomaly detection applications.}, author = {Nivarthi, Chandana Priya and Sick, Bernhard}, booktitle = {International Conference on Machine Learning and Applications (ICMLA)}, keywords = {itegpub}, pages = {1444–1450}, publisher = {IEEE}, title = {Towards Few-Shot Time Series Anomaly Detection with Temporal Attention and Dynamic Thresholding}, year = 2023 }
%0 Conference Paper %1 nivarthi2023towards %A Nivarthi, Chandana Priya %A Sick, Bernhard %B International Conference on Machine Learning and Applications (ICMLA) %D 2023 %I IEEE %P 1444--1450 %R 10.1109/ICMLA58977.2023.00218 %T Towards Few-Shot Time Series Anomaly Detection with Temporal Attention and Dynamic Thresholding %X Anomaly detection plays a pivotal role in diverse realworld applications such as cybersecurity, fault detection, network monitoring, predictive maintenance, and highly automated driving. However, obtaining labeled anomalous data can be a formidable challenge, especially when anomalies exhibit temporal evolution. This paper introduces LATAM (Long short-term memory Autoencoder with Temporal Attention Mechanism) for few-shot anomaly detection, with the aim of enhancing detection performance in scenarios with limited labeled anomaly data. LATAM effectively captures temporal dependencies and emphasizes significant patterns in multivariate time series data. In our investigation, we comprehensively evaluate LATAM against other anomaly detection models, particularly assessing its capability in few-shot learning scenarios where we have minimal examples from the normal class and none from the anomalous class in the training data. Our experimental results, derived from real-world photovoltaic inverter data, highlight LATAM’s superiority, showcasing a substantial 27% mean F1 score improvement, even when trained on a mere two-week dataset. Furthermore, LATAM demonstrates remarkable results on the open-source SWaT dataset, achieving a 12% boost in accuracy with only two days of training data. Moreover, we introduce a simple yet effective dynamic thresholding mechanism, further enhancing the anomaly detection capabilities of LATAM. This underscores LATAM’s efficacy in addressing the challenges posed by limited labeled anomalies in practical scenarios and it proves valuable for downstream tasks involving temporal representation and time series prediction, extending its utility beyond anomaly detection applications.
Multi-Task Representation Learning for Renewable-Power Forecasting: A Comparative Analysis of Unified Autoencoder Variants and Task-Embedding Dimensions. Nivarthi, Chandana Priya; Vogt, Stephan; Sick, Bernhard. In Machine Learning and Knowledge Extraction (MAKE), 5(3), bll 1214–1233. MDPI, 2023.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
- [ URL ]
Typically, renewable-power-generation forecasting using machine learning involves creating separate models for each photovoltaic or wind park, known as single-task learning models. However, transfer learning has gained popularity in recent years, as it allows for the transfer of knowledge from source parks to target parks. Nevertheless, determining the most similar source park(s) for transfer learning can be challenging, particularly when the target park has limited or no historical data samples. To address this issue, we propose a multi-task learning architecture that employs a Unified Autoencoder (UAE) to initially learn a common representation of input weather features among tasks and then utilizes a Task-Embedding layer in a Neural Network (TENN) to learn task-specific information. This proposed UAE-TENN architecture can be easily extended to new parks with or without historical data. We evaluate the performance of our proposed architecture and compare it to single-task learning models on six photovoltaic and wind farm datasets consisting of a total of 529 parks. Our results show that the UAE-TENN architecture significantly improves power-forecasting performance by 10 to 19% for photovoltaic parks and 5 to 15% for wind parks compared to baseline models. We also demonstrate that UAE-TENN improves forecast accuracy for a new park by 19% for photovoltaic parks, even in a zero-shot learning scenario where there is no historical data. Additionally, we propose variants of the Unified Autoencoder with convolutional and LSTM layers, compare their performance, and provide a comparison among architectures with different numbers of task-embedding dimensions. Finally, we demonstrate the utility of trained task embeddings for interpretation and visualization purposes.
@article{nivarthi2023multi, abstract = {Typically, renewable-power-generation forecasting using machine learning involves creating separate models for each photovoltaic or wind park, known as single-task learning models. However, transfer learning has gained popularity in recent years, as it allows for the transfer of knowledge from source parks to target parks. Nevertheless, determining the most similar source park(s) for transfer learning can be challenging, particularly when the target park has limited or no historical data samples. To address this issue, we propose a multi-task learning architecture that employs a Unified Autoencoder (UAE) to initially learn a common representation of input weather features among tasks and then utilizes a Task-Embedding layer in a Neural Network (TENN) to learn task-specific information. This proposed UAE-TENN architecture can be easily extended to new parks with or without historical data. We evaluate the performance of our proposed architecture and compare it to single-task learning models on six photovoltaic and wind farm datasets consisting of a total of 529 parks. Our results show that the UAE-TENN architecture significantly improves power-forecasting performance by 10 to 19% for photovoltaic parks and 5 to 15% for wind parks compared to baseline models. We also demonstrate that UAE-TENN improves forecast accuracy for a new park by 19% for photovoltaic parks, even in a zero-shot learning scenario where there is no historical data. Additionally, we propose variants of the Unified Autoencoder with convolutional and LSTM layers, compare their performance, and provide a comparison among architectures with different numbers of task-embedding dimensions. Finally, we demonstrate the utility of trained task embeddings for interpretation and visualization purposes.}, author = {Nivarthi, Chandana Priya and Vogt, Stephan and Sick, Bernhard}, journal = {Machine Learning and Knowledge Extraction (MAKE)}, keywords = {itegpub}, number = 3, pages = {1214–1233}, publisher = {MDPI}, title = {Multi-Task Representation Learning for Renewable-Power Forecasting: A Comparative Analysis of Unified Autoencoder Variants and Task-Embedding Dimensions}, volume = 5, year = 2023 }
%0 Journal Article %1 nivarthi2023multi %A Nivarthi, Chandana Priya %A Vogt, Stephan %A Sick, Bernhard %D 2023 %I MDPI %J Machine Learning and Knowledge Extraction (MAKE) %N 3 %P 1214--1233 %R 10.3390/make5030062 %T Multi-Task Representation Learning for Renewable-Power Forecasting: A Comparative Analysis of Unified Autoencoder Variants and Task-Embedding Dimensions %U https://www.mdpi.com/2504-4990/5/3/62 %V 5 %X Typically, renewable-power-generation forecasting using machine learning involves creating separate models for each photovoltaic or wind park, known as single-task learning models. However, transfer learning has gained popularity in recent years, as it allows for the transfer of knowledge from source parks to target parks. Nevertheless, determining the most similar source park(s) for transfer learning can be challenging, particularly when the target park has limited or no historical data samples. To address this issue, we propose a multi-task learning architecture that employs a Unified Autoencoder (UAE) to initially learn a common representation of input weather features among tasks and then utilizes a Task-Embedding layer in a Neural Network (TENN) to learn task-specific information. This proposed UAE-TENN architecture can be easily extended to new parks with or without historical data. We evaluate the performance of our proposed architecture and compare it to single-task learning models on six photovoltaic and wind farm datasets consisting of a total of 529 parks. Our results show that the UAE-TENN architecture significantly improves power-forecasting performance by 10 to 19% for photovoltaic parks and 5 to 15% for wind parks compared to baseline models. We also demonstrate that UAE-TENN improves forecast accuracy for a new park by 19% for photovoltaic parks, even in a zero-shot learning scenario where there is no historical data. Additionally, we propose variants of the Unified Autoencoder with convolutional and LSTM layers, compare their performance, and provide a comparison among architectures with different numbers of task-embedding dimensions. Finally, we demonstrate the utility of trained task embeddings for interpretation and visualization purposes.

2022[ to top ]

Unified Autoencoder with Task Embeddings for Multi-Task Learning in Renewable Power Forecasting. Nivarthi, Chandana Priya; Vogt, Stephan; Sick, Bernhard. In International Conference on Machine Learning and Applications (ICMLA), bll 1530–1536. IEEE, 2022.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
- [ URL ]
Renewable power generation forecasts using machine learning are typically implemented as single-task learning models, where a separate model is trained for each photovoltaic or wind park. In recent years, transfer learning is gaining popularity in these systems, as it can be used to transfer the knowledge gained from source parks to a target park. However, for transferring the knowledge to a target park, there is a need to determine the most similar source park(s) among the existing parks. This similarity determination using historical power measurements is challenging when the target park has limited to no historical data samples. Therefore, we propose a simple multi-task learning architecture that initially learns a common representation of input weather features among the tasks, using a Unified Autoencoder (UAE) and then learns the task specific information utilizing a Task Embedding layer in a Neural Network (TENN). This proposed architecture, UAE-TENN, can be easily extended to new parks with or without historical data. An elaborate performance comparison of single and multi-task learning models is performed on six photovoltaic and wind farm datasets comprising a total of 529 parks. UAE-TENN significantly improves the performance of power forecasting by 10 to 19% for photovoltaic parks and 5 to 22% for wind parks compared to the baseline models. Even in the zero-shot learning scenario, when there is no historical data, we successfully demonstrate that the UAE-TENN improves the forecast accuracy for a new park by 19% for photovoltaic parks.
@inproceedings{nivarthi2022unified, abstract = {Renewable power generation forecasts using machine learning are typically implemented as single-task learning models, where a separate model is trained for each photovoltaic or wind park. In recent years, transfer learning is gaining popularity in these systems, as it can be used to transfer the knowledge gained from source parks to a target park. However, for transferring the knowledge to a target park, there is a need to determine the most similar source park(s) among the existing parks. This similarity determination using historical power measurements is challenging when the target park has limited to no historical data samples. Therefore, we propose a simple multi-task learning architecture that initially learns a common representation of input weather features among the tasks, using a Unified Autoencoder (UAE) and then learns the task specific information utilizing a Task Embedding layer in a Neural Network (TENN). This proposed architecture, UAE-TENN, can be easily extended to new parks with or without historical data. An elaborate performance comparison of single and multi-task learning models is performed on six photovoltaic and wind farm datasets comprising a total of 529 parks. UAE-TENN significantly improves the performance of power forecasting by 10 to 19% for photovoltaic parks and 5 to 22% for wind parks compared to the baseline models. Even in the zero-shot learning scenario, when there is no historical data, we successfully demonstrate that the UAE-TENN improves the forecast accuracy for a new park by 19% for photovoltaic parks.}, author = {Nivarthi, Chandana Priya and Vogt, Stephan and Sick, Bernhard}, booktitle = {International Conference on Machine Learning and Applications (ICMLA)}, keywords = {itegpub}, pages = {1530–1536}, publisher = {IEEE}, title = {Unified Autoencoder with Task Embeddings for Multi-Task Learning in Renewable Power Forecasting}, year = 2022 }
%0 Conference Paper %1 nivarthi2022unified %A Nivarthi, Chandana Priya %A Vogt, Stephan %A Sick, Bernhard %B International Conference on Machine Learning and Applications (ICMLA) %D 2022 %I IEEE %P 1530--1536 %R 10.1109/ICMLA55696.2022.00240 %T Unified Autoencoder with Task Embeddings for Multi-Task Learning in Renewable Power Forecasting %U https://ieeexplore.ieee.org/document/10068974 %X Renewable power generation forecasts using machine learning are typically implemented as single-task learning models, where a separate model is trained for each photovoltaic or wind park. In recent years, transfer learning is gaining popularity in these systems, as it can be used to transfer the knowledge gained from source parks to a target park. However, for transferring the knowledge to a target park, there is a need to determine the most similar source park(s) among the existing parks. This similarity determination using historical power measurements is challenging when the target park has limited to no historical data samples. Therefore, we propose a simple multi-task learning architecture that initially learns a common representation of input weather features among the tasks, using a Unified Autoencoder (UAE) and then learns the task specific information utilizing a Task Embedding layer in a Neural Network (TENN). This proposed architecture, UAE-TENN, can be easily extended to new parks with or without historical data. An elaborate performance comparison of single and multi-task learning models is performed on six photovoltaic and wind farm datasets comprising a total of 529 parks. UAE-TENN significantly improves the performance of power forecasting by 10 to 19% for photovoltaic parks and 5 to 22% for wind parks compared to the baseline models. Even in the zero-shot learning scenario, when there is no historical data, we successfully demonstrate that the UAE-TENN improves the forecast accuracy for a new park by 19% for photovoltaic parks.
Transfer Learning as an Essential Tool for Digital Twins in Renewable Energy Systems. Nivarthi, Chandana Priya. In Organic Computing -- Doctoral Dissertation Colloquium 2021, S. Tomforde, C. Krupitzer (reds.), bll 47–59. kassel university press, 2022.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
Transfer learning (TL), the next frontier in machine learning (ML), has gained much popularity in recent years, due to the various challenges faced in ML, like the requirement of vast amounts of training data, expensive and time-consuming labelling processes for data samples, and long training duration for models. TL is useful in tackling these problems, as it focuses on transferring knowledge from previously solved tasks to new tasks. Digital twins and other intelligent systems need to utilise TL to use the previously gained knowledge and solve new tasks in a more self-reliant way, and to incrementally increase their knowledge base. Therefore, in this article, the critical challenges in power forecasting and anomaly detection in the context of renewable energy systems are identified, and a potential TL framework to meet these challenges is proposed. This article also proposes a feature embedding approach to handle the missing sensors data. The proposed TL methods help to make a system more autonomous in the context of organic computing.
@incollection{nivarthi2022transfer, abstract = {Transfer learning (TL), the next frontier in machine learning (ML), has gained much popularity in recent years, due to the various challenges faced in ML, like the requirement of vast amounts of training data, expensive and time-consuming labelling processes for data samples, and long training duration for models. TL is useful in tackling these problems, as it focuses on transferring knowledge from previously solved tasks to new tasks. Digital twins and other intelligent systems need to utilise TL to use the previously gained knowledge and solve new tasks in a more self-reliant way, and to incrementally increase their knowledge base. Therefore, in this article, the critical challenges in power forecasting and anomaly detection in the context of renewable energy systems are identified, and a potential TL framework to meet these challenges is proposed. This article also proposes a feature embedding approach to handle the missing sensors data. The proposed TL methods help to make a system more autonomous in the context of organic computing.}, author = {Nivarthi, Chandana Priya}, booktitle = {Organic Computing – Doctoral Dissertation Colloquium 2021}, editor = {Tomforde, Sven and Krupitzer, Christian}, keywords = {itegpub}, pages = {47–59}, publisher = {kassel university press}, title = {Transfer Learning as an Essential Tool for Digital Twins in Renewable Energy Systems}, year = 2022 }
%0 Book Section %1 nivarthi2022transfer %A Nivarthi, Chandana Priya %B Organic Computing -- Doctoral Dissertation Colloquium 2021 %D 2022 %E Tomforde, Sven %E Krupitzer, Christian %I kassel university press %P 47--59 %T Transfer Learning as an Essential Tool for Digital Twins in Renewable Energy Systems %X Transfer learning (TL), the next frontier in machine learning (ML), has gained much popularity in recent years, due to the various challenges faced in ML, like the requirement of vast amounts of training data, expensive and time-consuming labelling processes for data samples, and long training duration for models. TL is useful in tackling these problems, as it focuses on transferring knowledge from previously solved tasks to new tasks. Digital twins and other intelligent systems need to utilise TL to use the previously gained knowledge and solve new tasks in a more self-reliant way, and to incrementally increase their knowledge base. Therefore, in this article, the critical challenges in power forecasting and anomaly detection in the context of renewable energy systems are identified, and a potential TL framework to meet these challenges is proposed. This article also proposes a feature embedding approach to handle the missing sensors data. The proposed TL methods help to make a system more autonomous in the context of organic computing.

2021[ to top ]

The Problem with Real-World Novelty Detection -- Issues in Multivariate Probabilistic Models. Gruhl, Christian; Hannan, Abdul; Huang, Zhixin; Nivarthi, Chandana; Vogt, Stephan. In Workshop on Self-Improving System Integration (SISSY), ACSOS, bll 204–209. IEEE, 2021.
- [ BibTeX ]
- [ EndNote ]
@inproceedings{gruhl2021problem, author = {Gruhl, Christian and Hannan, Abdul and Huang, Zhixin and Nivarthi, Chandana and Vogt, Stephan}, booktitle = {Workshop on Self-Improving System Integration (SISSY), ACSOS}, keywords = {itegpub}, pages = {204–209}, publisher = {IEEE}, title = {The Problem with Real-World Novelty Detection – Issues in Multivariate Probabilistic Models}, year = 2021 }
%0 Conference Paper %1 gruhl2021problem %A Gruhl, Christian %A Hannan, Abdul %A Huang, Zhixin %A Nivarthi, Chandana %A Vogt, Stephan %B Workshop on Self-Improving System Integration (SISSY), ACSOS %D 2021 %I IEEE %P 204--209 %R 10.1109/acsos-c52956.2021.00055 %T The Problem with Real-World Novelty Detection -- Issues in Multivariate Probabilistic Models

2020[ to top ]

Implementing IoT in India---A Look at Macro Issues and a Framework for Recommendations. Singh, Apoorvaa; Nivarthi, Chandana Priya; Akhilesh, K. B. In Smart Technologies : Scope and Applications, K. B. Akhilesh, D. P. F. Möller (reds.), bll 35–52. Springer, 2020.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
IoT is the latest technology on the block, promising to be a panacea for multiple maladies. India, too, is looking at IoT with palpable interest. In this paper, we look the four major stakeholders in India, at the forefront of adoption and use of IoT, namely the academia, startups, large manufacturers, and the government. A representative of each class of the stakeholders is studied in depth, and the problems that they are facing with respect to implementation are identified. It turns out that a substantial chunk of the macrolevel implementation issues faced by all stakeholders are situated on the threads of one-to-one interactions of these stakeholders, with collaboration and standardization issues enveloping these one-to-one interactions. We propose a framework for formulating solution recommendations for these macroissues and give an example of its use.
@inbook{singh2020implementing, abstract = {IoT is the latest technology on the block, promising to be a panacea for multiple maladies. India, too, is looking at IoT with palpable interest. In this paper, we look the four major stakeholders in India, at the forefront of adoption and use of IoT, namely the academia, startups, large manufacturers, and the government. A representative of each class of the stakeholders is studied in depth, and the problems that they are facing with respect to implementation are identified. It turns out that a substantial chunk of the macrolevel implementation issues faced by all stakeholders are situated on the threads of one-to-one interactions of these stakeholders, with collaboration and standardization issues enveloping these one-to-one interactions. We propose a framework for formulating solution recommendations for these macroissues and give an example of its use.}, author = {Singh, Apoorvaa and Nivarthi, Chandana Priya and Akhilesh, K. B.}, booktitle = {Smart Technologies : Scope and Applications}, chapter = 3, editor = {Akhilesh, K. B. and M{\"o}ller, Dietmar P. F.}, keywords = {not_ies}, pages = {35–52}, publisher = {Springer}, title = {Implementing IoT in India—A Look at Macro Issues and a Framework for Recommendations}, year = 2020 }
%0 Book Section %1 singh2020implementing %A Singh, Apoorvaa %A Nivarthi, Chandana Priya %A Akhilesh, K. B. %B Smart Technologies : Scope and Applications %D 2020 %E Akhilesh, K. B. %E Möller, Dietmar P. F. %I Springer %P 35--52 %R 10.1007/978-981-13-7139-4_3 %T Implementing IoT in India---A Look at Macro Issues and a Framework for Recommendations %X IoT is the latest technology on the block, promising to be a panacea for multiple maladies. India, too, is looking at IoT with palpable interest. In this paper, we look the four major stakeholders in India, at the forefront of adoption and use of IoT, namely the academia, startups, large manufacturers, and the government. A representative of each class of the stakeholders is studied in depth, and the problems that they are facing with respect to implementation are identified. It turns out that a substantial chunk of the macrolevel implementation issues faced by all stakeholders are situated on the threads of one-to-one interactions of these stakeholders, with collaboration and standardization issues enveloping these one-to-one interactions. We propose a framework for formulating solution recommendations for these macroissues and give an example of its use. %& 3 %@ 978-981-13-7139-4
Cybercare---Role of Cyber Security in Healthcare Industry. Nivarthi, Chandana Priya; Akhilesh, K. B. In Smart Technologies : Scope and Applications, K. B. Akhilesh, D. P. F. Möller (reds.), bll 291–304. Springer, 2020.
- [ Abstract ]
- [ BibTeX ]
- [ EndNote ]
The Internet of Things (IoT) is the trend that designs the next generation technologies with the capability to impact the entire spectrum of business. It conceptualizes connection with anyone at any time with anything through any network at anyplace to serve any service. It can be defined as the interconnection of unique smart devices, services and systems. With IoT at play, automation is achievable in any field. The IoT offers wide range of `smart' solutions such as smart cities, smart homes, smart retail, smart banking, smart manufacturing and smart health care. This paper gives an overview on healthcare industry, identifies the primary stakeholders of the ecosystem, discusses the current challenges faced by the industry because of digitization and IoT devices and also suggests preventive measures.
@inbook{nivarthi2020cybercare, abstract = {The Internet of Things (IoT) is the trend that designs the next generation technologies with the capability to impact the entire spectrum of business. It conceptualizes connection with anyone at any time with anything through any network at anyplace to serve any service. It can be defined as the interconnection of unique smart devices, services and systems. With IoT at play, automation is achievable in any field. The IoT offers wide range of `smart' solutions such as smart cities, smart homes, smart retail, smart banking, smart manufacturing and smart health care. This paper gives an overview on healthcare industry, identifies the primary stakeholders of the ecosystem, discusses the current challenges faced by the industry because of digitization and IoT devices and also suggests preventive measures.}, author = {Nivarthi, Chandana Priya and Akhilesh, K. B.}, booktitle = {Smart Technologies : Scope and Applications}, chapter = 22, editor = {Akhilesh, K. B. and M{\"o}ller, Dietmar P. F.}, keywords = {not_ies}, pages = {291–304}, publisher = {Springer}, title = {Cybercare—Role of Cyber Security in Healthcare Industry}, year = 2020 }
%0 Book Section %1 nivarthi2020cybercare %A Nivarthi, Chandana Priya %A Akhilesh, K. B. %B Smart Technologies : Scope and Applications %D 2020 %E Akhilesh, K. B. %E Möller, Dietmar P. F. %I Springer %P 291--304 %R 10.1007/978-981-13-7139-4_22 %T Cybercare---Role of Cyber Security in Healthcare Industry %X The Internet of Things (IoT) is the trend that designs the next generation technologies with the capability to impact the entire spectrum of business. It conceptualizes connection with anyone at any time with anything through any network at anyplace to serve any service. It can be defined as the interconnection of unique smart devices, services and systems. With IoT at play, automation is achievable in any field. The IoT offers wide range of `smart' solutions such as smart cities, smart homes, smart retail, smart banking, smart manufacturing and smart health care. This paper gives an overview on healthcare industry, identifies the primary stakeholders of the ecosystem, discusses the current challenges faced by the industry because of digitization and IoT devices and also suggests preventive measures. %& 22 %@ 978-981-13-7139-4