In this paper we propose the novel class of hierarchical inverse Q-learning (HIQL) algorithms, which extend the fixed-reward inverse Q-learning (IQL) framework from Kalweit et al. (2020) to solve multiintention IRL problems. We applied HIQL in a real mice decision-making dataset from a dynamic two-armed bandit task (De La Crompe et al., 2023), and mathematically characterized exploitation and exploration behavior of animals during value-based decision-making.
Our Research
The ability to move is a fundamental feature of most animals which allows them to actively interact with our environment. We are investigating the underlying neural mechanisms and circuits of this ability. We do so with electrophysiological recordings and optogenetic manipulations combined with behavioral analysis. We look into the local processing of movement preparation and generation in the motor cortex as well as higher order structures, e.g. prefrontal cortex.
The goal is to create a better understanding of how neural subpopulations and pathways within and across brain areas influence motor behavior. In order to address these scientific aims we are constantly working on improving the existing techniques. We currently focus on the design of new optoelectronic probes and targeting strategies. Apart from advancing our basic knowledge about the neural mechanisms of movements, our results might help improving the design of new prosthetic devices and understanding of disorders in which the normal production of movements is disrupted.
Current News
New Article Published in Neuron
How do brains—biological or artificial—respond and adapt to an ever-changing environment? In a recent meeting, experts from various fields of neuroscience and artificial intelligence met to discuss internal world models in brains and machines, arguing for an interdisciplinary approach to gain deeper insights into the underlying mechanisms.
June 21, 2024: Farewell Party
Dear Brice, it was a pleasure working with you. Thank you for your time and dedication while you worked in our team. All the best for your next step.
“Brice, Brice, au revoir”
Open Positions
August, 2024 – We are looking for a PhD (m/f/d) Student in Neuroscience (in vivo imaging techniques in freely moving mice))
We have an opening for a highly motivated PhD student to help us investigate the mechanisms of movement disorders, epilepsy, motor planning, reward expectation, attention, and action selection. Specifically, we investigate inhibitory control of the motor system by the thalamic reticular nucleus.
November, 2023 – We are looking for a PhD (m/f/d) Student in Neuroscience (in vitro electrophysiology & 2-Photon Imaging)
We have an opening for a highly motivated PhD student to help us investigate the mechanisms of inhibitory control of the motor system by the thalamic reticular nucleus. You will help further our understanding of movement disorders, epilepsy, motor planning, reward expectation, attention, and action selection.
July, 2023 – We are looking for a PhD (m/f/d) Student in Neuroscience (2-Photon Imaging)
Are you ready to embark on a thrilling journey into the intricate world of neuroscience? Do you possess a relentless curiosity, thrive in collaborative environments, and have the motivation to tackle complex challenges in experimental and computational neuroscience?