SCENEUNDERLIGHT · Time-lapse understanding of the static and human scene and its lighting

Time-lapse understanding of the static and human scene and its lighting

SCENEUNDERLIGHT aimed to create a breakthrough in light management systems by bridging the gap between research results in computer vision scene understanding and product development in photonics. SCENEUNDERLIGHT has demonstrated the full automation of light measurement, the online estimation of human light perception, and the integration of both aspects into a smart Light Management System (LMS). Light estimation leverages an RGBD camera and a radiosity model for light propagation, and it distinguishes the scene 3D structure, the object reflectance and the light positions. For human light perception, people were located in the environment, their visual frustum of attention (VFOA) was estimated, as well as the incident light onto their VFOA, depending on their position and gaze. Finally, SCENEUNDERLIGHT has introduced a new end-to-end system architecture and implemented the autonomous system that we call the “invisible light switch” (ILS). ILS encompasses an RGBD camera, a processor, a light controller, a communication bus and the luminaires. Since ILS estimates how much light each person receives, it may switch off or dim those luminaires which are not visible, e.g. on the other side of large open spaces or behind cubicle panels. This removes the need for manual switches and provides a boost in energy efficiency, saving up to 66%, as it was demonstrated, without compromising the light quality. SCENEUNDERLIGHT educated two early stage researchers into experts of computer vision and machine learning, as well as innovation and technology transfer in smart lighting. The research and innovation mission of the project was carried out within an international doctoral programme. The two early stage researchers (ESRs) were enrolled into the University of Verona (UNIVR) PhD program in Computer Science (2015-2018). Throughout the project, the Istituto Italiano di Tecnologia (IIT) provided expert knowledge for the specific challenge of studying the scene structure material properties and hosted ESR1 for six months to pursue fundamental research on those aspects. The industrial partner OSRAM hosted both ESRs for half of the project, provided scientific expertise and supervision on computer vision and machine learning, and offered essential means and support to realize the project demonstrators. Both ESRs proposed and participated in workshops, seminars, courses and schools, to disseminate their research, discuss with world-renowned scientists and peers, and to grow awareness of the state-of-the-art in their field. The training happened in academic as well as industrial environments, to let them experience diverse perspectives in science. Concerning the research and innovation, ESR1 contributed to key advancements in the study of the scene structure properties, under the co-supervision of Dr. Alessio Del Bue (IIT) and Dr. Fabio Galasso (OSRAM). Work includes a system to calibrate the room lighting (the position of luminaires), to estimate the current illumination and to compute new parameters to re-light the room to some desirable lighting pattern. The proposed method holds the state of the art performance and provides better accuracy than commercial CAD modelling solutions. ESR2 focussed on the detection and recognition of the people and their activities, under the supervision of Prof. Marco Cristani and Dr. Fabio Galasso. He developed models to detect people and estimate their VFOA, to track and forecast their motion. Our model, which is motivated by social theories and experimental psychology results regarding attention, is currently state-of-the-art in the challenging recent task of people trajectory forecasting. Excellence of research in SCENEUNDERLIGHT is proven by project publications which appeared at top venues such as CVPR, ICCV, ICIP and WACV. The new disruptive technology, represented by the innovative ILS smart lighting system, has been filed into four patents. We expect the research and innovation to make an impact in the academic community, where it has been acknowledged as original, and the industrial sector, whereby performance beyond current commercial systems and the large energy savings makes it innovative and sustainable. Project website: http://profs.scienze.univr.it/~cristanm/sceneunderlight/ Project coordinator: Dr Fabio Galasso (fabio.galasso@gmail.com)

Текст от CORDIS, на английски · Данни: CORDIS, © Европейски съюз