ENVISION · Enabling Visual IoT Applications with Advanced Network Coding Algorithms
Horizon 2020 — Marie Skłodowska-Curie Actions
- Duration
- 2018-01-15 → 2020-01-14
- EU contribution
- €195,455
- Participants
- 1
- Scheme
- MSCA-IF-EF-ST
Lines connect the coordinator with its partners.
Results in brief
Enabling Visual IoT Applications with Advanced Network Coding Algorithms
The latest advances and integration of several key technologies such as wireless communications, low-power sensing, Internet protocols and cloud computing, have enabled the emergence of the Internet of Things (IoT) paradigm. The ever-growing deployment of the visual sensing applications within IoT deployments already strains the network and cloud infrastructures used to deliver and store massive amounts of visual data. Along with conventional image and video content, we are witnessing a surge in 360-degree video traffic originating from AR/VR as well as interactive multiview video. At the same time, novel sensing paradigms emerge which depart from the conventional frame-based sensing. A prominent example is neuromorphic visual sensors (NVS). NVS devices record pixel coordinates and timestamps of reflectance events in an asynchronous manner, thereby offering substantial improvements in sampling speed and power consumption. In order to accommodate for the surge in the visual content and deal with emerging visual data types, appropriate transmission and storage mechanisms need to be developed. The ENVISION project aimed at developing such data-driven delivery and storage algorithms based on advanced coding techniques for data acquired by both conventional frame-based video cameras and NVS devices. Specifically, ENVISION has pursued the following interconnected research objectives: (i) design of advanced content-driven delivery mechanisms for the transmission of the visual content captured by both neuromorphic and conventional visual sensors to the cloud service, (ii) development of novel data-driven methods for storage of the visual content, and (iii) design of low-complexity encoding/decoding techniques for robust data representation.
Data: CORDIS, © European Union
Project objective
The latest advances and integration of several key technologies such as wireless communications, low-power sensing, embedded systems, Internet protocols and cloud computing, have enabled the emergence of the Internet of Things (IoT) paradigm. However, the ever-growing deployment of the visual sensing applications within IoT deployments is expected to strain the network and cloud infrastructures used to deliver and store massive amounts of visual data. To partly address these challenges, prototypes of neuromorphic visual sensors, a.k.a. dynamic vision sensors (DVS), have been produced in the last two years. Instead of the conventional raster scan of video cameras, DVS devices record pixel coordinates and timestamps of reflectance events in an asynchronous manner, thereby offering substantial improvements in sampling speed and power consumption. ENVISION argues that, in order to fully exploit the advantages of neuromorphic sensing for IoT applications, such devices should be coupled with appropriate transmission and storage mechanisms that would take advantage of the visual data properties to achieve even higher bandwidth, power and storage efficiency. The ENVISION project aims at developing such data-driven delivery and storage algorithms based on advanced network coding techniques for data acquired by both conventional frame-based video cameras and DVS devices. Specifically, ENVISION is pursuing three interconnected research objectives: (i) designing advanced content-driven network codes for efficient transmission of the visual content captured by neuromorphic and conventional visual sensors to the cloud service under bandwidth and power constraints, (ii) developing novel content-aware network codes for storage of the visual content under the cost-performance optimisation framework, and (iii) investigating approximate decoding techniques including both the theoretical analysis of the performance and the implementation of practical low-complexity decoders.
Original text from CORDIS.
Participants
- UNIVERSITY COLLEGE LONDON · LondonCoordinatorUnited Kingdom
Links
Data: CORDIS, © European Union