SAPIENT autonomous sensor system
Development of a standard approach for AI and autonomy in networked multi-sensor systems in security and defence.
Sensing for Asset Protection with Integrated Electronic Networked Technology (SAPIENT) uses autonomy to reduce the workload of people operating multi-sensor systems, in security and defence scenarios.
It is the concept of a network of advanced sensors with artificial intelligence (AI) at the edge, combined with intelligent fusion and sensor management.
The benefits of SAPIENT include:
- significantly lower cognitive burden on operators
- lower communications bandwidth
- operational flexibility
- dual defence and security use
- lower acquisition cost
SAPIENT has been adopted by MOD as the standard for counter-UAS (uncrewed air system) technology. It is also being evaluated as a potential NATO standard for counter-drone systems.
Use the SAPIENT standard
The SAPIENT architecture is owned by MOD, but we have made the interface control document (ICD) freely available, along with the middleware and test harness, to encourage suppliers and partners to adopt the standard, contribute towards its development, and exploit the technologies created under this initiative.
Limitations of current systems
Most security and situational awareness systems, such as CCTV cameras or drone detection systems, simply collect data from their sensors and feed it ‘raw’ to an operator who assesses the situation and directs the system accordingly. Monitoring and interpreting lots of data requires high communications bandwidth and places a high cognitive burden on the operator.
How SAPIENT works
In the SAPIENT system, the individual sensors are advanced, using artificial intelligence (AI) to make detections and classifications locally, sending only the information not the raw data, to the command and control system. They also make operating decisions autonomously, such as which direction to look or whether to zoom in, in order to fulfil higher-level objectives. These higher-level objectives are managed by a decision-making module which controls the overall system and makes some of the decisions normally made by the operators. This reduces the operator’s need to constantly monitor the output of the sensors.
Encouraging system integration and development of compatible modules
SAPIENT is a MOD-owned, open-architecture that specifies the standards and protocols that allow modern AI algorithms to work in concert across a suite of sensors. These algorithms reside both on-board the autonomous sensor modulesnodes (ASM) - embodying AI at the edge - and at decision-making modules (DMM).nodes. The architecture strongly encourages component modularity (the ability to plug-and-play these modules) which reduces system integration time and creates a competitive supplier ecosystem for the components.
Critically, SAPIENT is designed to enable multi-sensor fusion (correlation, association and tracking) and sensor management (dynamic tasking of the sensors in response to the unfolding scenario). This gives MOD access to the advanced AI solutions that are being developed by our innovative supplier base.
While the key outputs from the SAPIENT initiative are the standards (that is: the ICD, test harnesses and other software tools) to enable innovative suppliers to develop ASMsensor and DMMdecision-making node components, the SAPIENT project has also developed research versions of these components to demonstrate the concept and evaluate the benefits to users.
SAPIENT in action
SAPIENT has been used in a number of high profile international exercises and experiments, leading to wider adoption by industry and partners.
In November 2021 SAPIENT’s ICD was evaluated as an interoperability standard for multi-sensor counter-UAS systems, at the NATO technical interoperability exercise (TIE21) in The Netherlands. It was highly successful in facilitating over 70 connections between C-UASC-UAS sensor systems and Command and Control (C2) systems,systems. andIt enablingwas 17further evaluated at TIE22 in September 2022, where it enabled 31 advanced ASMsautonomous sensor nodes from different vendors to connect to 713 DMMs.decision-making nodes.
In September and October 2021 SAPIENT standards, Decisiondecision-making Makingnodes Module and compatible sensors were used in the Contested Urban Environment 2021 (CUE2021) exercise. This multinational experiment involved over 60 innovative technologies, many of which were developed as SAPIENT compliant and shared their data using the SAPIENT ICD. Multi-sensor fusion and sensor management was provided by the advanced AI in the SAPIENT DMM.decision-making node. This illustrated SAPIENT’s critical place in a scalable, layered intelligence, surveillance and reconnaissance (ISR) capability of the future, delivering enhanced situational awareness to support command and control of operations in complex terrain and more efficient employment of ISR assets.
CUE2021 followed on directly after a NATO Science and Technology Organization trial investigating architectures for Interoperability and Networking of Disparate Sensors and Platforms for ISR Applications. Here SAPIENT was deployed, in concert with other architectures (Open Standards for Unattended Sensors and the OGC’s Sensor Web Enablement), as an integrating infrastructure for multinational mobile and fixed ISR assets.
Future development
SAPIENT started as a jointly funded project by the Defence Science and Technology Laboratory (Dstl) and Innovate UK. Dstl is now working with multiple stakeholders in defence and across government to consider the applicability of the SAPIENT concept, standards and architecture for military and civilian security applications, whilst working with industry partners to exploit the technologies created under this initiative.
The UK MOD has already adopted SAPIENT as a standard for counter-drone technology.technology, Inspecified in the November 2019 Counter-Unmanned Air Systems (C-sUAS) Strategy,Strategy.
The MODRapid Innovation Cell (RIC), specifies:
TopartpreventofcapabilitythegapsUAS Capability Development Centre (UASCDC), holds a regular programme of test andensureevaluationinteroperability,eventsalltoDefenceestablish the efficacy of commercially available capabilities and verifies SAPIENT compatibility for all C-sUASsystemsequipmentwillputuseforwardtheforsametesting.Beginning
openwitharchitectureversion(7 of the SAPIENT).ThisICD,willSAPIENTalsohasensuremovedthatfromourasystemsXML-basedcanmessageevolveformatattotheacomponentbinarylevelProtobuf-basedenablingmessagetheformat.spiralThisdevelopmentreducesofthecapability.
Thecommunications Rapidbandwidth Innovationrequired Cellto (RICrun SAPIENT), hasby beenapproximately established60%. asAlthough partprevious ofXML theinstantiations UASof SAPIENT Capabilitywere Developmentnot Centrehigh-bandwidth, (UASCDC)the transition to testProtobuf andwill evaluatebetter maturesupport C-sUASthe capabilitiesadoption andof generateSAPIENT ain managedchallenging Defencetactical databasemilitary ofoperations availablewhere capabilities.communications Throughbandwidth ais regularvery programmelimited.
Future development of testSAPIENT andwill evaluationinvestigate events,how themultiple RICSAPIENT willsystems establishcan thebe efficacyconnected oftogether commerciallyin availablea capabilities.hierarchy. TheCreating RIChierarchies verifiesof SAPIENT compatibilitysystems forwill allimprove C-sUASthe scalability and robustness of SAPIENT, equipmentand putexpand forwardthe forrange testing.of real-life scenarios where SAPIENT could be credibly deployed.
SAPIENT Interface Management Panel (SIMP)
To support SAPIENT as it matures towards a deployable capability meeting the needs of various stakeholders, Dstl has a cross-industry, cross-stakeholder working group, known as the SAPIENT Interface Management Panel (SIMP). The SIMP aims to create a configuration control framework around the SAPIENT interface and tools.
Membership of the SIMP is open to all but operates on a non-funded, voluntary basis. If you would like to be involved in the SIMP, please contact us.
Contact us
Email dstlsensors@dstl.gov.ukSAPIENT@dstl.gov.uk
You can also find out more about Dstl’s sensing science and technology capability.
Last updated
-
Updated information about version 7 of the interface control document and future development of SAPIENT.
-
Added link to the middleware and test harness for SAPIENT, which are now open source.
-
First published.
Update history
2024-04-16 12:07
Updated link to version 2 of BSI Flex 335 and changed the name of the cross-industry, cross-stakeholder working group to the SAPIENT Standardisation Committee (S3C).
2023-07-24 15:36
Updated link to SAPIENT ICD – the latest version is on the British Standards Institute website as BSI Flex 335; details of the differences are available on the Dstl GitHub.
2023-04-20 18:10
Updated information about version 7 of the interface control document and future development of SAPIENT.
2022-06-22 09:30
Added link to the middleware and test harness for SAPIENT, which are now open source.