HEIndividual fellowship2022–2024

FFvsFB-UHF-fMRI · The role of layer-specific population receptive field properties in visual recurrent processing

Horizon Europe — Marie Skłodowska-Curie Actions

Duration
2022-10-01 → 2024-09-30
EU contribution
€189,687
Participants
2
Scheme
HORIZON-TMA-MSCA-PF-EF

Lines connect the coordinator with its partners.

Results in brief

The role of layer-specific population receptive field properties in visual recurrent processing

The brain is constantly presented with large amounts of ambiguous information: a given pattern of sensory signals can arise from many different real-world conditions. Yet, despite this ambiguity, the brain rapidly parses incoming signals into coherent and stable percepts. How does the brain resolve the inherent uncertainty of the world around? A prominent theory proposes that sensory information is combined with expectations originating from a mental model of the environment, which is built and refined through experience. Vision can thus be understood as an inference process, where higher-order cognition guides the interpretation of sensory input. For instance, a Mooney face – a two-tone, minimally informative depiction of a face – is often unrecognizable until exposure to the original undistorted image enables identification. This ability to resolve sensory ambiguity using prior knowledge highlights the crucial role of feedback in shaping visual perception. Every feedforward sensory pathway is paralleled by a reciprocal feedback projection, yet the distinct roles and mechanisms of feedforward and feedback processing remain poorly understood. A key organizing principle of the visual system is retinotopy, in which visual space is topographically mapped from the retina onto the cortex. Receptive fields (RFs) serve as the fundamental unit of this organization, traditionally viewed as fixed spatial filters. However, evidence from animal studies suggests that RFs are dynamic and modulated by feedback, making them a strong candidate for integrating feedforward sensory input with top-down expectations. This project investigated RFs as a mechanism for feedforward-feedback integration, focusing on how spatial context and prior knowledge influence early visual processing. Using ultra-high field (UHF) fMRI with population receptive field (pRF) mapping, this work examined cortical layer-specific processing in the human brain. Complementary psychophysical experiments explored two expectation-related modulations: spatial context, studied via visual crowding, and prior knowledge, examined using Mooney images. By elucidating how feedforward and feedback signals are integrated in the brain, this work advances basic research in cognitive neuroscience while also informing applications in technology and healthcare. Potential impacts include improvements in biologically inspired neural network architectures, better diagnostic tools for conditions involving abnormal recurrent processing (such as schizophrenia or autism spectrum disorder), and novel strategies for vision rehabilitation.

Data: CORDIS, © European Union

Project objective

Visual perception has long been cast as an inference process, in which feedforward sensory signals are integrated with expectation-related feedback. For every feedforward sensory pathway, there is a reciprocal feedback projection, yet standard models continue to represent vision as a feedforward hierarchical network. Such models fail, however, when confronted with cases in which global spatial context, expectations, or other higher-order cognitive functions affect local processing. The characterization of the distinct roles and mechanisms of feedforward and feedback processing is thus crucial for better models of vision. Based on the theory of predictive coding, a proposed implementation of visual inference, we propose the receptive field (RF) as the mechanism by which feedforward and feedback processes interact. We present three projects that harness recent advances in neuroimaging techniques, allowing in vivo imaging of recurrent processing in humans. Ultra-high field (UHF) functional magnetic resonance imaging (fMRI) enables a hitherto impossible investigation of layer-specific cortical processing, with different cortical layers receiving input from either feedforward or feedback channels. We will leverage the sub-millimeter spatial resolution of UHF fMRI, together with population receptive field (pRF) mapping, to target feedforward and feedback RF properties in two behavioral paradigms - visual crowding and Mooney image disambiguation. Crowding is dependent on global spatial context, recruiting recurrent processing between early and mid-level visual areas, whereas the prior object knowledge manipulation involved in Mooney image disambiguation targets early to high visual areas. The investigation of the contextual modulation of layer-specific pRF properties will help elucidate the mechanisms by which higher cortical areas affect early sensory processing - a long-standing question in neuroscience, whose resolution is essential to the progress of vision research.

Original text from CORDIS.

Participants

  • FREIE UNIVERSITAET BERLIN · BerlinCoordinatorGermany
  • MAX-PLANCK-GESELLSCHAFT ZUR FORDERUNG DER WISSENSCHAFTEN EV · MUNCHENGermany

Links

Data: CORDIS, © European Union