VISIONS · Neural Video Processing and Streaming for Real-time Traffic Monitoring
Horizon 2020 — Marie Skłodowska-Curie Actions
- Duration
- 2021-08-01 → 2023-07-31
- EU contribution
- €224,934
- Participants
- 1
- Scheme
- MSCA-IF
Lines connect the coordinator with its partners.
Results in brief
Neural Video Processing and Streaming for Real-time Traffic Monitoring
The problem addressed: This project focuses on how to achieve real-time traffic monitoring in smart cities, through leveraging the emerging machine learning-based methods in video processing and streaming to reduce the required network bandwidth and guarantee the Quality of Experience (QoE) perceived by users in the dynamic network. The importance for society: The expected outcome can promote safer and more efficient travel for millions of users in Europe and billions of users all over the world. Moreover, the results of this project can be used in other multimedia applications, such as cloud virtual reality, distance education, smart transportation, and healthcare where video processing and video streaming are needed. The overall objectives: This project aims to achieve real-time traffic monitoring with high-quality video transmission in smart cities, leveraging the emerging Artificial Intelligence methods in video processing and video streaming. Firstly, the features of human visual systems will be referred on video quality allocation to reduce the required bandwidth for video transmission. Next, an innovative method for end-to-end video processing based on Deep Neural Networks will be developed to allow the video rendering and streaming at a lower resolution and also restore/improve the quality at the user ends. Finally, a new bitrate adaption scheme based on Reinforcement Learning will be designed to accommodate the unexpected network dynamics, guaranteeing the Quality-of-Experience to be perceived by users.
Data: CORDIS, © European Union
Project objective
With the rapid development of urbanization and continuous increase of vehicles on roadways, Intelligent Transportation Systems (ITS) play a key role in revolutionizing the way people commute. To make our cities safer and smarter, real-time traffic monitoring systems are deployed to help operators with observing traffic flows and identifying emergency situations. This project aims to achieve real-time traffic monitoring with high-quality video transmission in smart cities, leveraging the emerging Artificial Intelligence methods in video processing and video streaming. Firstly, the features of human visual systems will be referred on video quality allocation to reduce the required bandwidth for video transmission. Next, an innovative method for end-to-end video processing based on Deep Neural Networks will be developed to allow the video rendering and streaming at a lower resolution and also restore/improve the quality at the user ends. Finally, a new bitrate adaption scheme based on Reinforcement Learning will be designed to accommodate the unexpected network dynamics, guaranteeing the Quality-of-Experience to be perceived by users. The expected outcome can promote safer and more efficient travel for millions of users in Europe and billions of users all over the world. Moreover, the results of this project can be used in other multimedia applications, such as cloud virtual reality, distance education, smart transportation, and healthcare where video processing and video streaming are needed. To broaden the fellow’s knowledge horizon, a series of research, training, and knowledge transfer activities are planned. The new knowledge and skills imparted in these activities will further promote his academic portfolio and significantly enhance his career prosperity. The project will also play a solid foundation for the long-term and wide-range collaborations and eventually lead to more extensive impact of project results, from which both EU and China will benefit.
Original text from CORDIS.
Participants
- THE UNIVERSITY OF EXETER · ExeterCoordinatorUnited Kingdom
Links
Data: CORDIS, © European Union