ETN-FPI — European Training Network on Full Parallax Imaging

Results in brief

European Training Network on Full Parallax Imaging

A full-parallax display is expected to recreate the complete lightfield (LF), i.e. light travelling in every direction through every point in space. The need of such ultimatively-realistic display has been addressed by the European Training Network on Full Parallax Imaging by developing the related concept of and integrating the required work toward capturing, visualizing and interacting with highly realistic 3D visual scenes. The Network’s ultimate goal has been to train 15 next-generation researchers through 15 FPI-related novel multidisciplinary projects, spanning problems in optics, visual neuroscience, visual computing, and advanced signal and data processing. Four objectives have been formulated and addressed by the research and training programmes: • Advance the theory and practice of 3D scene sensing and content creation and develop new imaging systems operating at various scales, employing modern imaging concepts such as integral imaging for microscopy, plenoptic lenslet cameras for macroscopic content, and large-scale full parallax multiview and multi-sensor camera systems. • Advance the theory and practice of LF data analysis and interpretation for novel FPI applications in various fields. Develop novel effective representations for LF data and associated reconstruction and conversion algorithms. Develop computationally-efficient compression and processing methods utilizing modern parallel computing platforms. • Characterize optimal visualization of 3D visual scenes onto various displays aimed at full parallax. Develop methods and systems for realistic interaction with such displays. • Organize network-wide training program aimed at establishing competence for the Early Stage Researchers (ESRs) helping them to become excellent researchers and future research leaders; and to convey the necessity of interdisciplinary and international collaborations to reach ground-breaking results. All objectives have been achieved as planned. The research resulted in new devices, methods, and algorithms that have direct impacts on today’s life and at the same time support the future development of the area of FPI. Fifteen young researchers have received cross-disciplinary training forming a solid fundament for their future careers.

Data: CORDIS, © European Union

Project objective

Current displays fall far short of truly recreating visual reality. This can never be achieved by painting an image on a flat surface such as a TV screen, but requires a full-parallax display which can recreate the complete lightfield, i.e. the light traveling in every direction through every point in space. Recent years have seen major developments towards this goal, promising a new generation of ultra-realistic displays with applications in medicine, informatics, manufacturing, entertainment, gaming and more. However, achieving this will require a new generation of researchers trained both in the relevant physics, and in the biology of human vision. The European Training Network on Full-Parallax Imaging (ETN-FPI) aims at developing this new generation. The research concept of the network is to depart from the notations of plenoptics, light field and integral imaging, used sometimes interchangeably, and to harmonize and advance further the research in these areas under the umbrella of the wider and viewer-centred FPI concept. Fifteen early-stage researchers will be employed on novel inter-disciplinary FPI projects. The training disciplines include theoretical and applied optics, multi-dimensional image processing, and visual neuroscience. The targeted applications range from plenoptic microscopy to interaction with visual content generated by wide field-of-view displays. Extensive studies on perception of continuous parallax and subjective tests on various displays are planned. The training program includes local training, online seminars, workshops, training schools and a conference. The researchers trained within the network are expected to gather competitive skills and become highly competent in bringing innovations to the field of ultra-realistic and interactive visual media. This will enhance their employability in a rapidly growing sector in academia and industry and position Europe as a leader in this emerging multidisciplinary field.

Original text from CORDIS.

Participants

TAMPEREEN KORKEAKOULUSAATIO SR · TampereCoordinatorFinland
CHRISTIAN-ALBRECHTS-UNIVERSITAET ZU KIEL · KielGermany
Centre for Genomic Regulation · BarcelonaSpain
Exact Group GmbH Co & KG · LillienthalGermany
FRAUNHOFER GESELLSCHAFT ZUR FORDERUNG DER ANGEWANDTEN FORSCHUNG EV · MunchenGermany
HOLOGRAFIKA HOLOGRAMELOALLITO FEJLESZTO ES FORGALMAZO KFT · BudapestHungary
HUAWEI TECHNOLOGIES DUESSELDORF GMBH · DUSSELDORFGermany
INNOVAATION OY UUSI TEHDAS · TampereFinland
MITTUNIVERSITETET · SundsvallSweden
NANYANG TECHNOLOGICAL UNIVERSITY · SingaporeSingapore
PAZMANY PETER KATOLIKUS EGYETEM · BudapestHungary
RAYTRIX GMBH · KielGermany
REALEYES GmbH · KielGermany
UNIVERSITAT DE VALENCIA · ValenciaSpain
UNIVERSITY OF NEWCASTLE UPON TYNE · Newcastle Upon TyneUnited Kingdom
YLEISRADIO OY · HelsinkiFinland

ETN-FPI · European Training Network on Full Parallax Imaging

Results in brief

European Training Network on Full Parallax Imaging

Project objective

Participants

Links