E-HiDNet enables progressive threat detection using deep learning

Machine Learning


Advanced persistent threats (APTs) pose significant evolving challenges to cybersecurity, characterized by their stealth nature and ability to adapt over time, often bypassing traditional detection methods. Saleem Ishaq Tijjani, Bogdan Ghita and Nathan Clarke from the University of Plymouth, alongside Matthew Craven, present a new framework designed to move beyond reactive security measures and predict the progression of these complex attacks. Their work introduces E-HiDNet, a system that uniquely combines the power of deep learning and probabilistic modeling to predict future stages of APT campaigns. By integrating convolutional and recurrent neural networks with hidden Markov models, the team demonstrated a significant increase in stage prediction accuracy, reaching up to 98.8-100% in simulations using realistic datasets. This effort provides an important step toward proactive APT defense, increasing situational awareness and enabling security teams to anticipate and neutralize threats before they fully materialize.

Traditional methods often struggle with the accuracy and efficiency needed to detect these stealthy, multi-stage attacks. EHI-HMM combines the strengths of hidden Markov models with enhancements leveraging historical event data to provide context and improve state transitions. The system integrates convolutional and recurrent neural networks with hidden Markov models (HMMs) to predict campaign evolution and address the limitations of existing reactive intrusion detection systems. The core of this work lies in extracting hierarchical spatiotemporal representations from correlated alerts, allowing models to understand relationships between isolated events. At the same time, the HMM component models potential attack stages and their probabilistic transitions, enabling principled inference even when data is sparse.

Scientists have developed a modified Viterbi algorithm that enhances the robustness of state decoding under uncertainty. This is an important improvement for real-world scenarios. The algorithm incorporates Chapman-Kolmogorov-based state transition dynamics to effectively handle missing or temporarily sparse alert observations and improve prediction accuracy. In our experiments, we used the synthetically generated structurally realistic APT dataset S-DAPT-2026 to rigorously evaluate the performance of our framework. The system achieves up to 98.8-100% accuracy for stage predictions and shows significant performance improvements over standalone HMMs when four or more observations are available, even with reduced training data.

The CNN-LSTM architecture in E-HiDNet captures the long-range correlation of event sequences, and the HMM infers hidden states from observable system dynamics, providing a comprehensive understanding of the attack lifecycle. This methodological innovation facilitates stage-aware prediction and principled reasoning under uncertainty, enabling proactive APT defense by going beyond simple detection and predicting future attack vectors. This research pioneers a new approach to situational awareness and prioritized response actions against advanced cyber threats by fusing domain knowledge of the APT lifecycle with deep learning representations. The framework’s ability to handle incomplete observations is particularly valuable, increasing its real-time applicability.

E-HiDNet accurately predicts APT attack progression

Scientists have developed E-HiDNet, a new hybrid probabilistic learning framework designed to accurately predict the progression of Advanced Persistent Threat (APT) cyberattacks. This study addresses the limitations of current intrusion detection systems by integrating convolutional and recurrent neural networks with hidden Markov models (HMMs). This unified approach enables principled inference under uncertainty, even when data are sparse or incomplete. This is a common challenge when detecting advanced multi-stage attacks.

The team’s work goes beyond simple alert-centric detection and focuses on predicting attack stages. Experiments utilizing S-DAPT-2026, a synthetically generated structurally realistic dataset, demonstrate that E-HiDNet achieves 98.8% to 100% accuracy in predicting APT campaign stages. Importantly, our framework performs significantly better than standalone HMMs when analyzing scenarios where four or more observations are available, and maintains this improvement even when the training data is reduced. The modified Viterbi algorithm implemented within E-HiDNet ensures robust decoding and accurate stage prediction despite incomplete or uncertain observations.

The core of E-HiDNet lies in its ability to extract hierarchical spatiotemporal representations from correlated alert sequences. Convolutional and recurrent neural network components learn these semantic features, and HMMs model potential attack stages and their probabilistic transitions. This allows the system to infer the current stage of an attack and predict possible future actions even with limited information. Measurements confirm the framework’s ability to handle partial observability, a critical feature for real-world deployments. Researchers have documented that combining deep semantic feature learning and probabilistic state-space modeling significantly improves predictive performance and improves situational awareness for proactive APT defense.

E-HiDNet accurately predicts APT stages

In this study, we introduce E-HiDNet, a novel framework designed to improve prediction of Advanced Persistent Threat (APT) campaign stages. This allows for more accurate prediction of attack progression even when limited information is available during observation.

This study shows that E-HiDNet significantly outperforms traditional hidden Markov models, especially when analyzing sequences of four or more correlated alerts. Importantly, even when trained on a significantly reduced dataset of APT alerts, the model maintains robust performance with minimal loss in accuracy. These findings suggest that a hybrid approach enhances situational awareness and provides a path toward more proactive APT defense strategies. The authors acknowledge that early-stage predictions may exhibit some degree of variability due to initial ambiguity in the alert context, and future research may explore ways to improve performance at these early stages. Their work introduces E-HiDNet, a system that uniquely combines the power of deep learning and probabilistic modeling to predict future stages of APT campaigns. This effort provides an important step toward proactive APT defense, increasing situational awareness and enabling security teams to anticipate and neutralize threats before they fully materialize.

👉 More information
🗞 Deep recurrent hidden Markov learning framework for multi-stage advanced persistent threat prediction
🧠ArXiv: https://arxiv.org/abs/2601.06734



Source link