H2020Doctoral network2021–2026

PLENOPTIMA · Plenoptic Imaging

Horizon 2020 — Marie Skłodowska-Curie Actions

Duration
2021-01-01 → 2026-01-31
EU contribution
€3,975,116
Participants
5
Scheme
MSCA-ITN

Lines connect the coordinator with its partners.

Results in brief

Plenoptic Imaging

Plenoptic Imaging studies the phenomena of light field formation, propagation, sensing and perception along with the computational methods for extracting, processing and rendering the visual information. The PLENOPTIMA project goal is to establish new cross-sectorial, cross-national, multi-university sustainable doctoral degree programmes in the area of plenoptic imaging and to train the first fifteen future researchers and creative professionals for the benefit of a variety of application sectors. PLENOPTIMA develops a trans-disciplinary approach to imaging, which includes the physics of light, new optical materials and sensing principles, signal processing methods, new computing architectures, and vision science modelling. The project aims at achieving its goals by addressing the following three research objectives: • Advance theory and practice for novel design of full computational plenoptic imaging acquisition systems • Design models and methods for plenoptic data processing, with a focus on dimensionality reduction and compression, and on inverse problems using machine learning • Advance theory and practice for efficient rendering and interactive visualization on displays capable of reproducing all physiological visual depth cues, and enabling realistic interaction Advanced research conducted by cross-disciplinary experts will bring improvements in various areas such as medicine (live cell microscopy), creative industries (gaming, movies), industrial environment (tele-operations), consumer electronics (AR, VR), among others.

Data: CORDIS, © European Union

Project objective

Plenoptic Imaging aims at studying the phenomena of light field formation, propagation, sensing and perception along with the computational methods for extracting, processing and rendering the visual information. The PLENOPTIMA ultimate project goal is to establish new cross-sectorial, international, multi-university sustainable doctoral degree programmes in the area of plenoptic imaging and to train the first fifteen future researchers and creative professionals within these programmes for the benefit of a variety of application sectors. PLENOPTIMA develops a cross-disciplinary approach to imaging, which includes the physics of light, new optical materials and sensing principles, signal processing methods, new computing architectures, and vision science modelling. With this aim, PLENOPTIMA joints five of the strongest research groups in nanophotonics, imaging and machine learning in Europe with twelve innovative companies, research institutes and a pre-competitive business ecosystem developing and marketing plenoptic imaging devices and services. PLENOPTIMA advances the plenoptic imaging theory to set the foundations for developing future imaging systems that handle visual information in fundamentally new ways, augmenting the human perceptual, creative, and cognitive capabilities. More specifically, it develops 1) Full computational plenoptic imaging acquisition systems; 2) Pioneering models and methods for plenoptic data processing, with a focus on dimensionality reduction, compression, and inverse problems; 3) Efficient rendering and interactive visualization on immersive displays reproducing all physiological visual depth cues and enabling realistic interaction.All ESRs will be registered in Joint/Double degree doctoral programmes at academic institutions in Bulgaria, Finland, France, Germany and Sweden. The programmes will be made sustainable through a set of measures in accordance with the Salzburg II Recommendations of the European University Association.

Original text from CORDIS.

Participants

  • TAMPEREEN KORKEAKOULUSAATIO SR · TampereCoordinatorFinland
  • INSTITUT NATIONAL DE RECHERCHE EN INFORMATIQUE ET AUTOMATIQUE · Le Chesnay CedexFrance
  • INSTITUTE OF OPTICAL MATERIALS AND TECHNOLOGIES ""ACADEMICIAN JORDAN MALINOWSKI"" - BULGARIAN ACADEMY OF SCIENCES"" · SofiaBulgaria
  • MITTUNIVERSITETET · SundsvallSweden
  • TECHNISCHE UNIVERSITAT BERLIN · BerlinGermany

Links

Data: CORDIS, © European Union