Milestone Systems announced a generative AI-powered video analytics plugin for XProtect video management software co-developed with NVIDIA. The company aims to reduce the time and effort required to review video footage, automate incident reporting, and allow operators to focus more effectively on important events.
Automation focus
The new plugin aims to address the increasing demands faced by carriers as video surveillance systems generate ever-increasing amounts of footage. Milestone Systems says that by introducing automation, the plugin can summarize, contextualize, and verify video content in real-time. Core features include incident reporting automation, event validation, and natural language summarization of bookmarked footage.
The company says its automated incident reporting feature instantly transforms selected video clips into structured summaries, reducing time spent on manual documentation. The event validation feature analyzes motion events and checks for alarms, promising to reduce false positives and improve overall alert handling. This process is fully integrated with your existing XProtect rules engine.
Contextual summaries allow operators to quickly prioritize incidents by providing natural language descriptions of bookmarked footage, limiting the need to review every clip individually.
Deployment flexibility
This plugin can be deployed on-premises or in the cloud, giving you options to address various compliance and security requirements across your organization. Integration with the XProtect rules engine allows customers to deploy the tool within their current operational framework without requiring significant additional infrastructure.
AI training and compliance
The solution is built on Milestone’s Hafnia Vision Language Model (VLM) and trained using over 75,000 hours of ethically sourced real-world video data from Europe and the United States. NVIDIA Cosmos Curator is used for data preparation, and the platform runs through cloud infrastructure or NVIDIA-supported regional data centers. Milestone leverages NVIDIA Cosmos Reason VLM as part of this setup.
“This new XProtect plug-in gives any city, organization, or operator managing a transportation system access to advanced video intelligence to help them achieve new levels of efficiency, safety, and insight. This is a pivotal step in our mission to transform the way the world manages and learns from visual data, responsibly and at scale.” said Thomas Jensen, CEO of Milestone Systems.
Market adoption
According to Milestone, municipalities such as Genoa, Italy, and Dubuque, Iowa, are among the early users of this feature, reflecting a trend among cities to use advanced artificial intelligence to improve traffic management.
ecosystem development
Alongside plug-ins, Milestone is introducing a VLM as a Service solution through an application programming interface. This enables independent developers, system integrators, and partners to build their own generative AI solutions using Milestone’s video language model, regardless of the video management platform of their choice.
Milestone is partnering with Vaidio to introduce the new plugin’s real-time incident summary capabilities and benchmarking tools. Milestone also plans to reveal more about Hafnia VLM’s capabilities at an upcoming developer summit where the results of related hackathons will be announced.
