- A3. Data and knowledge
- A3.1. Data
- A3.3. Data and knowledge analysis
- A3.4. Machine learning and statistics
- A5. Interaction, multimedia and robotics
- A5.1. Human-Computer Interaction
- A5.2. Data visualization
- A5.3. Image processing and analysis
- A5.9. Signal processing
- A6. Modeling, simulation and control
- A6.1. Methods in mathematical modeling
- A6.2. Scientific computing, Numerical Analysis & Optimization
- A6.3. Computation-data interaction
- A7. Theory of computation
- A8.6. Information theory
- A8.7. Graph theory
- A8.8. Network science
- A8.12. Optimal transport
- A9. Artificial intelligence
- A9.2. Machine learning
- A9.3. Signal analysis
- A9.7. AI algorithmics
- B1. Life sciences
- B1.2. Neuroscience and cognitive science
- B1.2.1. Understanding and simulation of the brain and the nervous system
- B1.2.2. Cognitive science
- B1.2.3. Computational neurosciences
- B2.2.2. Nervous system and endocrinology
- B2.2.6. Neurodegenerative diseases
- B2.5. Handicap and personal assistances
- B2.5.1. Sensorimotor disabilities
- B2.5.2. Cognitive disabilities
- B2.5.3. Assistance for elderly
- B2.6.1. Brain imaging
- B2.6.2. Cardiac imaging
- B2.7. Medical devices
- B2.7.1. Surgical devices
- B2.7.2. Health monitoring systems
1 Team members, visitors, external collaborators
- Rachid Deriche [Team leader, Inria, Senior Researcher, HDR]
- Samuel Deslauriers-Gauthier [Inria, Starting Research Position]
- Théodore Papadopoulo [Inria, Senior Researcher, HDR]
- Mauro Zucchelli [Inria, Starting Research Position]
- Abib Olushola Yessouffou Alimi [Inria, until May 2020]
- Joan Belo [Inria]
- Isa Costantini [Inria, until May 2020]
- Matteo Frigo [Inria]
- Ivana Kojcic [Inria]
- Come Le Breton [Inria]
- Sara Sedlar [Inria]
- Federica Turi [Univ Côte d'Azur, until Sep 2020]
- Amandine Audino [Inria, Engineer, until May 2020]
- Yang Ji [Inria, Engineer, from Feb 2020]
Interns and Apprentices
- Sandra Ayas [Inria, from Jun 2020 until Sep 2020]
- Jeanne Benoit [Inria, until Jun 2020]
- Pierre Guetschel [Ecole normale supérieure Paris-Saclay, from Apr 2020]
- Marie Onno [Univ Côte d'Azur, until Jun 2020]
- Paul Emmanuel Ponsenard [Inria, until Jun 2020]
- Claire Senica [Inria]
- Enes Albay [Université d'Istanbul-Turquie, until Mar 2020]
2 Overall objectives
The main objective of Athena is to develop rigorous mathematical models and computational tools for analyzing and modeling the complex Central Nervous System structure and function. These models and tools will help to better understand the structure and the functioning of the human brain and address pressing and challenging clinical and neuroscience questions. Exploring new directions to solve these challenging problems will push forward the state-of-the-art in Structural and Functional Computational Brain Connectivity Mapping.
The relationship between brain structure and function is fundamental in neuroscience. Developing computational models and techniques that recover the structural and functional connectivities of the brain in vivo is thus of utmost importance: it will definitely improve the understanding of the brain and its mechanisms. On the basis of our expertise and contributions to the field of computational neuroimaging and in order to have an impact on this field, our research focusses mainly on the structural and functional Imaging of the brain with a particular emphasis on signal and image recording from diffusion Magnetic Resonance Imaging (dMRI), Magneto-Encephalography (MEG) and Electro-Encephalography (EEG).
In order to further increase the impact of our research, we also aim to push our contributions towards some applications related to brain diseases with characteristic abnormalities in the micro-structure of brain tissues that are not apparent and cannot be revealed reliably by standard imaging techniques. Diffusion MRI, a non invasive imaging modality based on the measurement of the random thermal movement (diffusion) of water molecules within samples can make visible these co-lateral damages to the fibers of the brain white matter and can also help in the development of new biomarkers related to the progression of certain types of neurodegenerative disease. Diffusion MRI is the imaging modality that we will primarly consider to recover the structural brain connectivity.
Connectivity represents the network infrastructure of the brain. Electric activity corresponds to communications over this network. MEG and EEG (jointly as M/EEG), two non-invasive techniques, reveal part of the cortical electric activity and are instrumental in better understanding the brain functional connectivity and in diagnosing diseases linked to anomalous brain function - that in some cases structural or other functional MR images do not reveal. MEG and EEG are the imaging modalities that we will primarly consider to recover the functional brain connectivity.
In some CNS injuries (medullar injuries, strokes, AMS), the peripheral nervous system may not be able to execute commands that are issued by the brain. Brain Computer Interfaces (BCI) use brain signals such as measured through EEG, and translate in real-time the electrical activity of the brain in commands to control external devices. While BCI is advocated as a means to communicate and help restore mobility or autonomy for very severe cases of disabled patients, it is also a new tool for interactively probing and training the human brain.
These considerations support the need to do research on new models and computational tools to analyse brain signals and imaging data. Our main objective is to push forward the state-of-the-art in Structural and Functional Computational Brain Connectivity Mapping to better understand the structure and function of the brain.
In order to tackle these long term and challenging objectives, our strategy is based on the following road map:
- Develop rigorous mathematical and computational tools for the analysis and interpretation of Diffusion MRI and M/EEG data.
- Improve acquisition and processing techniques and push forward the state-of-the-art in Computational brain imaging.
- Use our expertise to address with collaborators clinical and neuroscience questions.
This is implemented through:
- Publications in international conferences and journals dedicated to promoting advances in computational methods for Diffusion MRI and M/EEG analysis and/or use of Diffusion MRI and M/EEG in clinical and neuroscience applications.
- A dense network of collaborations with national as well as international neuroimaging laboratories through which we have access equipment and data and with whom we will jointly contribute to solve common crucial problems of interest.
- Software packages developed to be used in a first stage by our national and international collaborators and then made available to other partners.
3 Research program
3.1 Computational diffusion MRI
Diffusion MRI (dMRI) provides a non-invasive way of estimating in-vivo CNS fiber structures using the average random thermal movement (diffusion) of water molecules as a probe. It's a relatively recent field of research with a history of roughly three decades. It was introduced in the mid 80's by Le Bihan et al 65, Merboldt et al 70 and Taylor et al 84. As of today, it is the unique non-invasive technique capable of describing the neural connectivity in vivo by quantifying the anisotropic diffusion of water molecules in biological tissues.
Diffusion Tensor Imaging & High Angular Resolution Diffusion Imaging
In dMRI, the acquisition and reconstruction of the diffusion signal allows for the reconstruction of the water molecules displacement probability, known as the Ensemble Average Propagator (EAP) 83, 47. Historically, the first model in dMRI is the 2nd order diffusion tensor (DTI) 45, 44 which assumes the EAP to be Gaussian centered at the origin. DTI (Diffusion Tensor Imaging) has now proved to be extremely useful to study the normal and pathological human brain 66, 55. It has led to many applications in clinical diagnosis of neurological diseases and disorder, neurosciences applications in assessing connectivity of different brain regions, and more recently, therapeutic applications, primarily in neurosurgical planning. An important and very successful application of diffusion MRI has been brain ischemia, following the discovery that water diffusion drops immediately after the onset of an ischemic event, when brain cells undergo swelling through cytotoxic edema.
The increasing clinical importance of diffusion imaging has driven our interest to develop new processing tools for Diffusion Tensor MRI. Because of the complexity of the data, this imaging modality raises a large amount of mathematical and computational challenges. We have therefore developed original and efficient algorithms relying on Riemannian geometry, differential geometry, partial differential equations and front propagation techniques to correctly and efficiently estimate, regularize, segment and process Diffusion Tensor MRI (DT-MRI) (see 68 and 67).
In DTI, the Gaussian assumption over-simplifies the diffusion of water molecules. While it is adequate for voxels in which there is only a single fiber orientation (or none), it breaks for voxels in which there are more complex internal structures and limitates the ability of the DTI to describe complex, singular and intricate fiber configurations (U-shape, kissing or crossing fibers). To overcome this limitation, so-called Diffusion Spectrum Imaging (DSI) 87 and High Angular Resolution Diffusion Imaging (HARDI) methods such as Q-ball imaging 85 and other multi-tensors and compartment models 80, 82, 63, 62, 77 were developed to resolve the orientationnality of more complicated fiber bundle configurations.
Q-Ball imaging (QBI) has been proven very successful in resolving multiple intravoxel fiber orientations in MR images, thanks to its ability to reconstruct the Orientation Distribution Function (ODF, the probability of diffusion in a given direction). These tools play a central role in our work related to the development of a robust and linear spherical harmonic estimation of the HARDI signal and to our development of a regularized, fast and robust analytical QBI solution that outperforms the state-of-the-art ODF numerical technique developed by Tuch 85. Those contributions are fundamental and have already started to impact on the Diffusion MRI, HARDI and Q-Ball Imaging community 54. They are at the core of our probabilistic and deterministic tractography algorithms devised to best exploit the full distribution of the fiber ODF (see 51, 3 and 52, 4).
Beyond DTI with high order tensors
High Order Tensors (HOT) models to estimate the diffusion function while overcoming the shortcomings of the 2nd order tensor
model have also been proposed such as the Generalized Diffusion Tensor Imaging (G-DTI) model developed by Ozarslan
et al 75, 76 or 4th order Tensor Model 43.
For more details, we refer the reader to our articles in 58, 80 where we
review HOT models and to our articles in 67, co-authored with some of our close
collaborators, where we review recent mathematical models and computational methods for the processing of Diffusion Magnetic
Resonance Images, including state-of-the-art reconstruction of diffusion models, cerebral white matter connectivity
analysis, and segmentation techniques. We also worked on Diffusion Kurtosis Imaging (DKI), of great interest
for the company Olea Medical (https://
All these powerful techniques are of utmost importance to acquire a better understanding of the CNS mechanisms and have helped to efficiently tackle and solve a number of important and challenging problems 62, 63. They have also opened up a landscape of extremely exciting research fields for medicine and neuroscience. Hence, due to the complexity of the CNS data and as the magnetic field strength of scanners increases, as the strength and speed of gradients increase and as new acquisition techniques appear 2, these imaging modalities raise a large amount of mathematical and computational challenges at the core of the research we develop at Athena 59, 80.
Improving dMRI acquisitions
One of the most important challenges in diffusion imaging is to improve acquisition schemes and analyse approaches to optimally acquire and accurately represent diffusion profiles in a clinically feasible scanning time. Indeed, a very important and open problem in Diffusion MRI is related to the fact that HARDI scans generally require many times more diffusion gradient than traditional diffusion MRI scan times. This comes at the price of longer scans, which can be problematic for children and people with certain diseases. Patients are usually unable to tolerate long scans and excessive motion of the patient during the acquisition process can force a scan to be aborted or produce useless diffusion MRI images. We have developed novel methods for the acquisition and the processing of diffusion magnetic resonance images, to efficiently provide, with just few measurements, new insights into the structure and anatomy of the brain white matter in vivo.
First, we contributed developing real-time reconstruction algorithm based on the Kalman filter 50. Then, we started to explore the utility of Compressive Sensing methods to enable faster acquisition of dMRI data by reducing the number of measurements, while maintaining a high quality for the results. Compressed Sensing (CS) is a relatively recent technique which has been proved to accurately reconstruct sparse signals from undersampled measurements acquired below the Shannon-Nyquist rate 71.
We have contributed to the reconstruction of the diffusion signal and its important features as the orientation distribution function and the ensemble average propagator, with a special focus on clinical setting in particular for single and multiple Q-shell experiments. Compressive sensing as well as the parametric reconstruction of the diffusion signal in a continuous basis of functions such as the Spherical Polar Fourier basis, have been proved through our contributions to be very useful for deriving simple and analytical closed formulae for many important dMRI features, which can be estimated via a reduced number of measurements 71, 48, 49.
We have also contributed to design optimal acquisition schemes for single and multiple Q-shell experiments. In particular, the method proposed in 2 helps generate sampling schemes with optimal angular coverage for multi-shell acquisitions. The cost function we proposed is an extension of the electrostatic repulsion to multi-shell and can be used to create acquisition schemes with incremental angular distribution, compatible with prematurely stopped scans. Compared to more commonly used radial sampling, our method improves the angular resolution, as well as fiber crossing discrimination. The optimal sampling schemes, freely available for download1, have been selected for use in the HCP (Human Connectome Project)2.
We think that such kind of contributions open new perspectives for dMRI applications including, for example, tractography where the improved characterization of the fiber orientations is likely to greatly and quickly help tracking through regions with and/or without crossing fibers 57.
dMRI modelling, tissue microstructures features recovery & applications
The dMRI signal is highly complex, hence, the mathematical tools required for processing it have to be commensurate in their complexity. Overall, these last twenty years have seen an explosion of intensive scientific research which has vastly improved and literally changed the face of dMRI. In terms of dMRI models, two trends are clearly visible today: the parametric approaches which attempt to build models of the tissue to explain the signal based on model-parameters such as CHARMED 39, AxCaliber 40 and NODDI 88 to cite but a few, and the non-parametric approaches, which attempt to describe the signal in useful but generic functional bases such as the Spherical Polar Fourier (SPF) basis 42, 41, the Solid Harmonic (SoH) basis 53, the Simple Harmonic Oscillator based Reconstruction and Estimation (SHORE) basis 73 and more recent Mean Apparent Propagator or MAP-MRI basis 74.
We propose to investigate the feasibility of using our new models and methods to measure extremely important biological tissue microstructure quantities such as axonal radius and density in white matter. These parameters could indeed provide new insight to better understand the brain's architecture and more importantly could also provide new imaging bio-markers to characterize certain neurodegenerative diseases. This challenging scientific problem, when solved, will lead to direct measurements of important microstructural features that will be integrated in our analysis to provide much greater insight into disease mechanisms, recovery and development. These new microstructural parameters will open the road to go far beyond the limitations of the more simple bio-markers derived from DTI that are clinically used to this date – such as MD (Mean Diffusivity) and FA (Fractional Anisotropy) which are known to be extremely sensitive to confounding factors such as partial volume and axonal dispersion, non-specific and not able to capture any subtle effects that might be early indicators of diseases 7.
Towards microstructural based tractography
In order to go far beyond traditional fiber-tracking techniques, we believe that first order information, i.e. fiber orientations, has to be superseeded by second and third order information, such as microstructure details, to improve tractography. However, many of these higher order information methods are relatively new or unexplored and tractography algorithms based on these high order based methods have to be conceived and designed. In this aim, we propose to work with multiple-shells to reconstruct the Ensemble Average Propagator (EAP), which represents the whole 3D diffusion process and use the possibility it offers to deduce valuable insights on the microstructural properties of the white matter. Indeed, from a reconstructed EAP one can compute the angular features of the diffusion in an diffusion Orientation Distribution Function (ODF), providing insight in axon orientation, calculate properties of the entire diffusion in a voxel such as the Mean Squared Diffusivity (MSD) and Return-To-Origin Probability (RTOP), or come forth with bio-markers detailing diffusion along a particular white matter bundle direction such as the Return-to-Axis or Return-to-Plane Probability (RTAP or RTPP). This opens the way to a ground-breaking computational and unified framework for tractography based on EAP and microstructure features 8. Using additional a priori anatomical and/or functional information, we could also constrain the tractography algorithm to start and terminate the streamlines only at valid processing areas of the brain.
This development of a computational and unified framework for tractography, based on EAP, microstructure and a priori anatomical and/or functional features, will open new perspectives in tractography, paving the way to a new generation of realistic and biologically plausible algorithms able to deal with intricate configurations of white matter fibers and to provide an exquisite and intrinsic brain connectivity quantification.
Going beyond the state-of-the-art dMRI
Overall, these last twenty years have seen an explosion of intensive scientific research which has vastly improved and literally changed the face of dMRI.
However, although great improvements have been made, major improvements are still required primarily to optimally acquire dMRI data, better understand the biophysics of the signal formation, recover high order invariant and intrinsic microstructure features, identify bio-physically important bio-markers and improve tractography.
Therefore, there is still considerable room for improvement when it comes to the concepts and tools able to efficiently acquire, process and analyze the complex structure of dMRI data. Develop ground-breaking dMRI tools and models for brain connectomics is one of the major objective we would like to achieve in order to take dMRI from the benchside to the bedside and lead to a decisive advance and breakthrough in this field.
3.2 MEG and EEG
Electroencephalography (EEG) and Magnetoencephalography (MEG) are two non-invasive techniques for measuring (part of) the electrical activity of the brain. While EEG is an old technique (Hans Berger, a German neuropsychiatrist, measured the first human EEG in 1929), MEG is a rather new one: the first measurements of the magnetic field generated by the electrophysiological activity of the brain were made in 1968 at MIT by D. Cohen. Nowadays, EEG is relatively inexpensive and is routinely used to detect and qualify neural activities (epilepsy detection and characterisation, neural disorder qualification, BCI, ...). MEG is, comparatively, much more expensive as SQUIDS (Superconducting QUantum Interference Device) only operate under very challenging conditions (at liquid helium temperature) and as a specially shielded room must be used to separate the signal of interest from the ambient noise. However, as it reveals a complementary vision to that of EEG and as it is less sensitive to the head structure, it also bears great hopes and an increasing number of MEG machines are being installed throughout the world. Inria and Odyssée/Athena have participated in the acquisition of one such machine installed in the hospital "La Timone" in Marseille.
MEG and EEG can be measured simultaneously (M/EEG) and reveal complementary properties of the electrical fields. The two techniques have temporal resolutions of about the millisecond, which is the typical granularity of the measurable electrical phenomena that arise within the brain. This high temporal resolution makes MEG and EEG attractive for the functional study of the brain. The spatial resolution, on the contrary, is somewhat poor as only a few hundred data points can be acquired simultaneously (about 300-400 for MEG and up to 256 for EEG). MEG and EEG are somewhat complementary with fMRI (Functional MRI) and SPECT (Single-Photon Emission Computed Tomography) in that those provide a very good spatial resolution but a rather poor temporal resolution (of the order of a second for fMRI and a minute for SPECT). Also, contrarily to fMRI, which “only” measures an haemodynamic response linked to the metabolic demand, MEG and EEG measure a direct consequence of the electrical activity of the brain: it is acknowledged that the signals measured by MEG and EEG correspond to the variations of the post-synaptic potentials of the pyramidal cells in the cortex. Pyramidal neurons compose approximately 80% of the neurons of the cortex, and it requires at least about 50,000 active such neurons to generate some measurable signal.
While the few hundred temporal curves obtained using M/EEG have a clear clinical interest, they only provide partial information on the localisation of the sources of the activity (as the measurements are made on or outside of the head). Thus the practical use of M/EEG data raises various problems that are at the core of the Athena research in this topic:
- First, as acquisition is continuous and is run at a rate up to 1kHz, the amount of data generated by each experiment is huge. Data selection and reduction (finding relevant time blocks or frequency bands) and pre-processing (removing artifacts, enhancing the signal to noise ratio, ...) are largely done manually at present. Making a better and more systematic use of the measurements is an important step to optimally exploit the M/EEG data 1.
- With a proper model of the head and of the sources of brain electromagnetic activity, it is possible to simulate the electrical propagation and reconstruct sources that can explain the measured signal. Proposing better models 64, 9 and means to calibrate them 86 so as to have better reconstructions are other important aims of our work.
- Finally, we wish to exploit the temporal resolution of M/EEG and to apply the various methods we have developed to better understand some aspects of the brain functioning, and/or to extract more subtle information out of the measurements. This is of interest not only as a cognitive goal, but it also serves the purpose of validating our algorithms and can lead to the use of such methods in the field of Brain Computer Interfaces. To be able to conduct such kind of experiments, an EEG lab has been set up at Athena.
3.3 Combined M/EEG and dMRI
dMRI provides a global and systematic view of the long-range structural connectivity within the whole brain. In particular, it allows the recovery of the fiber structure of the white matter which can be considered as the wiring connections between distant cortical areas. These white matter based tractograms are analyzed e.g. to explore the differences in structural connectivity between pathological and normal populations. Moreover, as a by-product, the tractograms can be processed to reveal the nodes of the brain networks, i.e. by segregating together gray matter that share similar connections to the rest of the white matter. But dMRI does not provide information on:
- the cortico-cortical pathways (not passing through white matter) and to some extent, on the short-range connections in the white matter,
- the actual use of connections over time during a given brain activity.
On the opposite, M/EEG measures brain activation over time and provides, after source reconstruction (solving the so-called inverse problem of source reconstruction), time courses of the activity of the cortical areas. Unfortunately, deep brain structures have very little contribution to M/EEG measurements and are thus difficult to analyze. Consequently, M/EEG reveals information about the nodes of the network, but in a more blurry (because of the inverse problem) and fragmented view than dMRI (since it can only reveal brain areas measurable in M/EEG whose activity varies during the experimental protocol). Given its very high temporal resolution, the signal of reconstructed sources can be processed to reveal the functional connectivity between the nodes 81.
While dMRI and M/EEG have been the object of considerable research separately, there have been very few studies on combining the information they provide. Some existing studies deal with the localization of abnormal MEG signals, particularly in the case of epilepsy, and on studying the white matter fibers near the detected abnormal source 69, 72, but to our knowledge there are very few studies merging data coming both from M/EEG and dMRI at the analysis level 78, 56, 46, 79.
Combining the structural and functional information provided by dMRI and M/EEG is a difficult problem as the spatial and temporal resolutions of the two types of measures are extremely different. Still, combining the measurements obtained by these two types of techniques has the great potential of providing a detailed view both in space and time of the functioning brain at a macroscopic level. Consequently, it is a timely and extremely important objective to develop innovative computational tools and models that advance the dMRI and M/EEG state-of-the-art and combine these imaging modalities to build a comprehensive dynamical structural-functional brain connectivity network to be exploited in brain connectivities diseases.
The CoBCoM ERC project aims to develop a joint dynamical structural-functional brain connectivity network built on advanced and integrated dMRI and M/EEG ground-breaking methods. To this end, CoBCoM develops new generation of computational dMRI and M/EEG models and methods for identifying and characterizing the connectivities on which the joint network is built 5, 6.
Capitalizing on the strengths of dMRI & M/EEG and building on the bio-physical and mathematical foundations of our models, CoBCoM contributes to create a joint and solid network which will be exploited to identify and characterize white matter abnormalities in some high-impact brain diseases such as Multiple Sclerosis (MS), Epilepsy and mild Traumatic Brain Injury (mTBI).
The 3IA UCA Chair AI-based omputational Brain Connectomics project aims to reconstruct and analyse the network of neural connections of the brain, called the connectome via a computational brain connectomics framework based on ground-breaking AI algorithms and machine learning tools to gain insight into brain architecture, functioning and neurodegenerative diseases. The avalanche of big data required to reconstruct the connectome and the study of the high complexity of structural and functional interactions within the connectome clearly position brain connectomics as a big data problem where AI & machine learning in particular, represent a very promising trend, as recently demonstrated in computer vision and in some biomedical image data-driven analysis. Partly related to the ERC Advanced Grant CoBCoM this project aims to construct networks specifically built on new generation of AI algorithms and machine learning tools to reconstruct structural and functional connectomes using advanced and integrated diffusion MRI, Electro and Magneto-Encephalography (EEG & MEG) methods 10.
Capitalizing on the strengths of dMRI & M/EEG and building on the bio-physical and mathematical foundations of our models, CoBCoM and the 3IA UCA Chair AI-based Computational Brain Connectomics contribute to create a joint and solid network which will be exploited to identify and characterize white matter abnormalities in some high-impact brain diseases such as Multiple Sclerosis (MS), Epilepsy and mild Traumatic Brain Injury (mTBI).
4 Application domains
4.1 Applications of diffusion MRI
Clinical domain: Diagnosis of neurological disorder
Various examples of CNS diseases as Alzheimer's and Parkinson's diseases and others like multiple sclerosis, traumatic brain injury and schizophrenia have characteristic abnormalities in the micro-structure of brain tissues that are not apparent and cannot be revealed reliably by standard imaging techniques. Diffusion MRI can make visible these co-lateral damages to the fibers of the CNS white matter that connect different brain regions. This is why in our research, Diffusion MRI is the structural imaging modality that will be considered to recover the CNS connectivity.
4.2 Applications of M/EEG
Clinical domain: Diagnosis of neurological disorders
The dream of all M/EEG researchers is to alleviate the need for invasive recordings (electrocorticograms or intracerebral electrodes), which are often necessary prior to brain surgery, in order to precisely locate both pathological and vital functional areas. We are involved in this quest, particularly through our collaborations with the La Timone hospital in Marseille.
- Diagnosis of neurological disorders such as epilepsy, schizophrenia, tinnitus, ...
- Presurgical planning of brain surgery.
- Collaboration with the Institut de Neurosciences des Systèmes on these topics https://
- Aims at better understanding the brain spatio-temporal organisation.
- Collaboration with the Laboratory for Neurobiology of Cognition in order to develop methods that suit their needs for sophisticated data analysis.
Brain Computer Interfaces (BCI) aim to allow direct control of external devices using brain signals such as measured through EEG. In our project, BCI can be seen as an application of EEG processing techniques, but also as an object of fundamental and applied research as they open the way for more dynamical and active brain cognitive protocols.
We develop a research collaboration with the eemagine/ANT-Neuro company. We collaborate with Nice University Hospital on the usage of BCI-based communication for ALS3 patients.
5 New software and platforms
5.1 New software
- Name: Diffusion MRI Multi-Compartment Modeling and Microstructure Recovery Made Easy
- Keywords: Diffusion MRI, Multi-Compartment Modeling, Microstructure Recovery
- Functional Description: Non-invasive estimation of brain microstructure features using diffusion MRI (dMRI) – known as Microstructure Imaging – has become an increasingly diverse and complicated field over the last decades. Multi-compartment (MC)-models, representing the measured diffusion signal as a linear combination of signal models of distinct tissue types, have been developed in many forms to estimate these features. However, a generalized implementation of MC-modeling as a whole, providing deeper insights in its capabilities, remains missing. To address this fact, we present Diffusion Microstructure Imaging in Python (Dmipy), an open-source toolbox implementing PGSE-based MC-modeling in its most general form. Dmipy allows on-the-fly implementation, signal modeling, and optimization of any user-defined MC-model, for any PGSE acquisition scheme. Dmipy follows a “building block”-based philosophy to Microstructure Imaging, meaning MC-models are modularly constructed to include any number and type of tissue models, allowing simultaneous representation of a tissue's diffusivity, orientation, volume fractions, axon orientation dispersion, and axon diameter distribution. In particular, Dmipy is geared toward facilitating reproducible, reliable MC-modeling pipelines, often allowing the whole process from model construction to parameter map recovery in fewer than 10 lines of code. To demonstrate Dmipy's ease of use and potential, we implement a wide range of well-known MC-models, including IVIM, AxCaliber, NODDI(x), Bingham-NODDI, the spherical mean-based SMT and MC-MDI, and spherical convolution-based single- and multi-tissue CSD. By allowing parameter cascading between MC-models, Dmipy also facilitates implementation of advanced approaches like CSD with voxel-varying kernels and single-shell 3-tissue CSD. By providing a well-tested, user-friendly toolbox that simplifies the interaction with the otherwise complicated field of dMRI-based Microstructure Imaging, Dmipy contributes to more reproducible, high-quality research.
- Authors: Rutger Fick, Demian Wassermann, Rachid Deriche, Samuel Deslauriers-Gauthier
- Contact: Rachid Deriche
- Keywords: Health, Neuroimaging, Medical imaging
- Scientific Description: OpenMEEG provides a symmetric boundary element method (BEM) implementation for solving the forward problem of electromagnetic propagation over heterogeneous media made of several domains of homogeneous and isotropic conductivities. OpenMEEG works for the quasistatic regime (frequencies < 100Hz and medium diameter < 1m).
- Functional Description: OpenMEEG provides state-of-the art tools for modelling bio-electromagnetic propagation in the quasi-static regime. It is based on the symmetric BEM for the EEG/MEG forward problem, with a distributed source model. OpenMEEG has also been used to model the forward problem of ECoG, for modelling nerves or the cochlea. OpenMEEG is a free, open software written in C++ with python bindings. OpenMEEG is used through a command line interface, but is also interfaced in graphical interfaces such as BrainStorm, FieldTrip or SPM.
- Release Contributions: OpenMEEG has had a large update including notably the parallelisation of some operators and bug corrections. The new version allows in addition the use of non-nested domains.
- News of the Year: The python interface of OpenMEEG has been improved and now allows to pass python data structures (meshes, conductivities) to characterize the gain matrices to be calculated without going through files. This is done to ease a future integration of OpenMEEG in MNE-python. A code factorization also took place to allow in the long term to facilitate the integration in OpenMEEG of the work of K. Maksymenko on the efficient calculation of gain matrices for several conductivity values. This work has not yet been released.
openmeeg. github. io/
- Publications: inria-00467061v2, inria-00584205v1, hal-01278377v1
- Contact: Théodore Papadopoulo
- Participants: Alexandre Gramfort, Emmanuel Olivi, Geoffray Adde, Jan Kybic, Kai Dang, Maureen Clerc, Perrine Landreau, Renaud Keriven, Théodore Papadopoulo
- Name: BCI visual applications
- Keywords: Health, Brain-Computer Interface, GUI (Graphical User Interface)
- Scientific Description: Bci-Vizapp is a library that allows (in interaction with OpenViBE) to build BCI (Brain Computer Interfaces) applications based on the P300 speller principle. Bci-Vizapp provides a library that allows you to create the BCI's stimulation part as part of the Qt toolkit. Being able to use a standard toolkit to make BCI applications is a strong Bci-Vizapp originality. Indeed, in general the use of such toolkits is prohibited by the need for a very precise control of the display timings, which generally eliminates high-level graphic toolkits such as Qt.
BCI-VIZAPP includes a virtual keyboard for typing text, a photodiode monitoring application for checking timing issues. It communicates with the OpenViBE acquisition server for signal acquisition and with the OpenViBE designer for signal processing. The configuration is performed through a wizard.
This software is a new version following the CoAdapt P300 stimulator software.
- News of the Year: Bci-Vizapp is undergoing a deep transmutation following, among other things, the impulse of the SED of CRISAM in the ADT BciBrowser. Signal processing which was once based only on OpenViBE can now be done internally by the software. This has led to the development of different substitutable "backends" which can do this processing. This signal processing capability was also used to implement an interface intended for participation in 2020 in the Athena Cybathlon (which did not take place for health reasons). Indeed, the use of an external software such as OpenViBE turned out to be a weak point of the system which was tested during the Cybathlon BCI series in 2019.
- Contact: Théodore Papadopoulo
- Participants: Nathanaël Foy, Romain Lacroix, Maureen Clerc, Théodore Papadopoulo, Yang Ji, Come Le Breton
- Name: Tractograms As Linear Operators in Neuroimaging
- Keywords: Diffusion imaging, Diffusion MRI, Brain MRI, Brain
- Scientific Description: Talon is a Python package that implements Tractograms As Linear Operators in Neuroimaging. It is a general tool which allows users to transform a collection of streamlines (a tractogram) obtained from diffusion magnetic resonance imaging (MRI) into a linear forward model of neuroimaging data. A particularity of Talon is that it allows the user to specify the forward model, therefore being very flexible on the definition of the linear operator. The structure of the operator is exploited, allowing Talon to solve problems with millions of variables and hundreds of millions of data points. By solving a linear system this operator, Talon assigns a weight to each streamline which represents its contribution to imaging data. The current version is directed at diffusion MRI data and supports solving linear systems with non-negative least squares, group sparsity, and hierarchical sparsity. In the future, it will be updated to support more varied structural and functional data.
- Functional Description: Talon is a Python package that implements Tractograms As Linear Operators in Neuroimaging. It is a general tool that assigns a weight to each streamline of a collection (referred to as a tractogram) by fitting the diffusion MRI data. This allows, among other things, to filter a tractogram and remove redundant streamlines. The current version is directed at diffusion MRI data and supports solving linear systems with non-negative least squares, group sparsity, and hierarchical sparsity. In the future, it will be updated to support more varied structural and functional data.
- Release Contributions: Initial version that implements the minimum requirements.
- News of the Year: This first version contains the base functionality of the software.
- Publication: hal-03116143
- Authors: Matteo Frigo, Samuel Deslauriers-Gauthier, Mauro Zucchelli, Rachid Deriche
- Contact: Samuel Deslauriers-Gauthier
6 New results
6.1 Computational Diffusion MRI
A Computational Framework For Generating Rotation Invariant Features and Its Application in Diffusion MRI
Participants: Mauro Zucchelli, Samuel Deslauriers-Gauthier, Rachid Deriche.
In this work, we present a novel computational framework for analytically generating a complete set of algebraically independent Rotation Invariant Features (RIF) given the Laplace-series expansion of a spherical function. Our computational framework provides a closed-form solution for these new invariants, which are the natural expansion of the well known spherical mean, power-spectrum and bispectrum invariants. We highlight the maximal number of algebraically independent invariants which can be obtained from a truncated Spherical Harmonic (SH) representation of a spherical function and show that most of these new invariants can be linked to statistical and geometrical measures of spherical functions, such as the mean, the variance and the volume of the spherical signal. Moreover, we demonstrate their application to dMRI signal modeling including the Apparent Diffusion Coefficient (ADC), the diffusion signal and the fiber Orientation Distribution Function (fODF). In addition, using both synthetic and real data, we test the ability of our invariants to estimate brain tissue microstructure in healthy subjects and show that our framework provides more flexibility and open up new opportunities for innovative development in the domain of microstructure recovery from diffusion MRI.
Diffusion MRI Tractography Filtering Techniques Change the Topology of Structural Connectomes
Participants: Matteo Frigo, Samuel Deslauriers-Gauthier, Drew Parker, Abdol Aziz Ould Ismail, Junghoon John Kim, Ragini Verma, Rachid Deriche.
The use of non-invasive techniques for the estimation of structural brain networks (i.e. connectomes) opened the door to large-scale investigations on the functioning and the architecture of the brain, unveiling the link between neurological disorders and topological changes of the brain network. This study aims at assessing if and how the topology of structural connectomes estimated non-invasively with diffusion MRI is affected by the employment of tractography filtering techniques in structural connectomic pipelines. Additionally, this work investigates the robustness of topological descriptors of filtered connectomes to the common practice of density-based thresholding. In this approach, we investigate the changes in global efficiency, characteristic path length, modularity and clustering coefficient on filtered connectomes obtained with the spherical deconvolution informed filtering of tractograms and using the convex optimization modelling for microstructure informed tractography. The analysis is performed on both healthy subjects and patients affected by traumatic brain injury and with an assessment of the robustness of the computed graph-theoretical measures with respect to density-based thresholding of the connectome. Our results demonstrate that tractography filtering techniques change the topology of brain networks, and thus alter network metrics both in the pathological and the healthy cases. Moreover, the measures are shown to be robust to density-based thresholding. Significance. The present work highlights how the inclusion of tractography filtering techniques in connectomic pipelines requires extra caution as they systematically change the network topology both in healthy subjects and patients affected by traumatic brain injury. Finally, the practice of low-to-moderate density-based thresholding of the connectomes is confirmed to have negligible effects on the topological analysis.
This work has been published in 16.
Fully-Connected Neural Network and Spherical-Harmonics Rotation Invariant Features Improve the Estimation of Brain Tissue Microstructure in Diffusion MRI
Participants: Mauro Zucchelli, Samuel Deslauriers-Gauthier, Rachid Deriche.
Fully connected neural networks (FC-NN) have been successfully trained on the diffusion signal in each brain voxel to fit microstructural indices. In this work, we propose to combine the Fully Connected Neural Networks and the new series of algebraic independent rotation-invariant features (RIF) our group derived from the diffusion signal Spherical Harmonics (SH) expansion, testing if the combination of these two approaches improves the estimation of the microstructural indices with respect to each method taken by itself. In order to test this hypothesis, we created a set of 300000 synthetic voxels simulated using the state of the art multi-compartment models to train 12 FC-NN with an increasing number of perceptrons and hidden layers. Our results show that all the networks are able to outperform the classical fitting using multi-compartment models. RIF-based FC-NN is able to obtain better performances with respect to SH-coefficients and signal based FC-NN for all the networks with less than 64 perceptrons per hidden layer. Increasing the number of perceptrons leads to a convergence of the accuracy of the estimation of the microstructural indices for the three networks. In conclusion, increasing the number of hidden layers from 2 to 5 leads to a general improvement of the estimation of the indices for all the inputs
This work has been published in 27.
Diffusion MRI Fiber Orientation Distribution Function Estimation Using Voxel-wise Spherical U-net
Participants: Sara Sedlar, Théodore Papadopoulo, Rachid Deriche, Samuel Deslauriers-Gauthier.
Diffusion Magnetic Resonance Imaging (dMRI) is an imaging technique which enables analysis of the brain tissue at a microscopic scale, particularly the analysis of white matter. Given a high enough angular resolution, a common way to explain the measured signal is via fiber orientation distribution function (fODF). This function describes the orientation and volume fraction of axon bundles within each voxel and is an essential ingredient of tractography. In this work, we have investigated a deep learning approach for the fODF estimation. U-nets enable fast and high resolution inference by combining multi-scale features from contracting and expanding parts of the network. As dMRI signals are most commonly acquired on spheres, we propose a spherical U-net which is adjusted to the properties of the dMRI data, namely its real nature, antipodal symmetry, uniform sampling and axial symmetry of the signals corresponding to individual fibers. We compared our model with another deep learning approach based on a 3D convolutional neural network and a state-of-the-art approach-multi-shell multi-tissue constrained spherical deconvolution, on real data from Human Connectome Project and synthetic data generated using ball and stick model. The methods are compared in terms of mean square error and mean angular error for dMRI signals of different angular resolutions. Provided quantitative analyses show improved performance with our approach even with significantly reduced number of parameters and results obtained on synthetic data indicate its robustness with respect to noise. Qualitative results illustrating the performance of the methods are also presented.
This work has been published in 21
Multi Tissue Modelling of Diffusion MRI Signal Reveals Volume Fraction Bias
Participants: Matteo Frigo, Rutger Fick, Mauro Zucchelli, Samuel Deslauriers-Gauthier, Rachid Deriche.
This paper highlights a systematic bias in white matter tissue microstructure modelling via diffusion MRI that is due to the common, yet inaccurate, assumption that all brain tissues have a similar T2 response. We show that the concept of “signal fraction” is more appropriate to describe what have always been referred to as “volume fraction”. This dichotomy is described from the theoretical point of view by analysing the mathematical formulation of the diffusion MRI signal. We propose a generalized multi tissue modelling framework that allows to compute the actual volume fractions. The Dmipy implementation of this framework is then used to verify the presence of this bias in two classical tissue microstructure models computed on two subjects from the Human Connectome Project database. The proposed paradigm shift exposes the research field of brain tissue microstructure estimation to the necessity of a systematic review of the results obtained in the past that takes into account the difference between the concepts of volume fraction and signal fraction.
This work has been published in 24
Multi-Compartment Modelling of Diffusion MRI Signal Shows TE-Based Volume Fraction Bias
Participants: Matteo Frigo, Mauro Zucchelli, Rutger Fick, Samuel Deslauriers-Gauthier, Rachid Deriche.
Diffusion MRI (dMRI) has been widely used to estimate brain tissue microstructure in-vivo.Two of the most widely used microstructural indices are the white matter (WM) andintra-cellular (IC) volume fractions (VF). In estimating these fractions, acommon assumption of dMRI-based signal modeling is to assume that the T2-relaxation foreach compartment is equal. However, it has been shown that this assumption is inaccurate. Here, we characterize the bias introduced by this assumption using a generalmulti-compartmental model of the dMRI signal in three distinct scenarios:3-S0) the realistic-case, where each compartment has its T2-dependent signal at b-value 0(S0).2-S0) in which we consider only two separated S0, one for WM and one for CSF.1-S0) a single average S0 is considered for all the compartments, as commonly done indMRI.Our simulations and experiments on real data show fitting the WM and IC VF using the moresimplistic 2-S0 and 1-S0 model, a systematic bias appears that potentially alters the interpretation of conclusions drawn from studies focusing on WM and IC VF.
This work has been published in 25.
Network Alignment and Similarity Reveal Atlas-Based Topological Differences in Structural Connectomes
Participants: Matteo Frigo, Emilio Cruciani, David Coudert, Rachid Deriche, Emanuele Natale, Samuel Deslauriers-Gauthier.
Brain atlases are central objects in network neuroscience, where the interactions between different brain regions are modeled as a graph called connectome. In structural connectomes, nodes are parcels from a predefined cortical atlas and edges encode the strength of the axonal connectivity between regions measured via diffusion Magnetic Resonance Imaging (MRI) tractography. Herein, we aim at providing a novel perspective on the evaluation of brain atlases by modeling it as a network alignment problem, with the goal of tackling the following question: given an atlas, how robustly does it capture the network topology across different subjects? To answer such a question, we introduce two novel concepts arising as natural generalizations of previous ones. First, the graph Jaccard index (GJI), a graph similarity measure based on the well-established Jaccard index between sets; the GJI exhibits natural mathematical properties that are not satisfied by previous approaches. Second, we devise WL-align, a new technique for aligning connectomes obtained by adapting the Weisfeiler-Lehman (WL) graph-isomorphism test. We validated the GJI and WL-align on data from the Human Connectome Project database, inferring a strategy for choosing a suitable parcellation for structural connectivity studies. Code and data are publicly available.
A preprint of this work, currently submitted to a journal and under review, has been published in 34.
Explainable 3D-CNN for Multiple Sclerosis Patients Stratification
Participants: Federica Cruciani, Lorenza Brusini, Mauro Zucchelli, Gustavo Retuci Pinheiro, Francesco Setti, Ilaria Boscolo Galazzo, Leticia Rittner, Massimiliano Calabrese, Rachid Deriche, Gloria Menegaz.
The growing availability of novel interpretation techniques opened the way to the application of deep learning models in the clinical field, including neuroimaging, where their use is still largely underexploited. In this framework, we focus the stratification of Multiple Sclerosis (MS) patients in the Primary Progressive versus the Relapsing- Remitting state of the disease using a 3D Convolutional Neural Network trained on structural MRI data. Within this task, the application of Layer-wise Relevance Propagation visualization allowed detecting the voxels of the input data mostly involved in the classification decision, potentially bringing to light brain regions which might reveal disease state.
Multi-Tissue Multi-Compartment Models of Diffusion MRI
Participants: Matteo Frigo, Rutger Fick, Mauro Zucchelli, Samuel Deslauriers-Gauthier, Rachid Deriche.
State-of-the-art multi-compartment microstructural models of diffusion MRI in the human brain have limited capability to model multiple tissues at the same time. In particular, the available techniques that allow this multi-tissue modelling are based on multi-TE acquisitions. In this work we propose a novel multi-tissue formulation of classical multi-compartment models that relies on more common single-TE acquisitions and can be employed in the analysis of previously acquired datasets. We show how modelling multiple tissues provides a new interpretation of the concepts of signal fraction and volume fraction in the context of multi-compartment modelling. The software that allows to inspect single-TE diffusion MRI data with multi-tissue multi-compartment models is included in the publicly available Dmipy Python package.
This work has been submitted to a journal and is currently under review.
On the Generalizability of Diffusion MRI Signal Representations Across Acquisition Parameters, Sequences, and Tissue Types: Chronicles of the MEMENTO Challenge.
Participants: Alberto De Luca, Matteo Frigo, Rutger Fick, Sara Sedlar, Abib Alimi, Enes Alpay, Mauro Zucchelli, Samuel Deslauriers-Gauthier, Rachid Deriche, Kurt Schilling.
Diffusion MRI (dMRI) has become an invaluable tool to assess the microstructural organization of brain tissue. Depending on the specific acquisition settings, the dMRI signal encodes specific properties of the underlying diffusion process. In the last two decades, several signal representations have been proposed to fit the dMRI signal and decode such properties. Most methods, however, are tested and developed on a limited amount of data, and their applicability to other acquisition schemes remains unknown. With this work, we aimed to shed light on the generalizability of existing dMRI signal representations to different brain tissue types for diffusion encoding parameters. To this end, we organized a community challenge - named MEMENTO, making available the same datasets for fair comparisons across algorithms and techniques. We considered two state-of-the-art diffusion datasets, including single-diffusion-encoding (SDE) spin-echo data from a human brain with over 3820 unique diffusion weightings (the MASSIVE dataset), and double (oscillating) diffusion encoding data (DDE/DODE) of a mouse brain including over 2520 unique data points. A subset of the data sampled in 5 different voxels was openly distributed, and the challenge participants were asked to predict the remaining part of the data. After one year, eight participant teams submitted a total of 80 signal fits. For each submission, we evaluated the mean squared error, the variance of the prediction error and the Bayesian information criteria. Most predictions predicted either multi-shell SDE data (39%) or DODE data (22,5%), followed by cartesian SDE data (20%) and DDE (22,5%). Most submissions predicted the signals measured with SDE remarkably well, with the exception of low and very strong diffusion weightings. The prediction of DDE and DODE data seemed more challenging, likely because none of the submissions explicitly accounted for diffusion time and frequency. Next to the choice of the model, decisions on fit procedure and hyperparameters play a major role in the prediction performance, highlighting the importance of optimizing and reporting such choices. This work is a community effort to highlight strength and limitations of the field at representing dMRI acquired with trending encoding schemes, gaining insights into how different models generalize to different tissue types and fiber configurations over a large range of diffusion encodings.
This work is currently under review.
Lesion-Robust White-Matter Bundle Identification Through Diffusion Driven Label Fusion
Participants: Guillermo Gallardo, Gaston Zanitti, Alfred Anwander, Mat Higger, Sylvain Bouix, Samuel Deslauriers-Gauthier, Demian Wassermann.
Pathologies such as infiltrative tumors disrupt the structure of white matter in the brain, resulting in cognitive deficits. Inferring which pathways are affected by the lesion is key for both pre and post-treatment planning. In the presence of lesions, tractography algorithms fail to wholly track white matter pathways, regardless if these are unaffected by the lesion. In this work, we develop a label fusion technique to localize fiber bundles when whole-bundle tracking is hampered. we solve this by harnessing aggregated healthy subject information. Given a set of labeled major bundles in a group of healthy subjects, we non-linearly register them to our patient’s brain and combine them using a novel label fusion algorithm. A major advantage of label fusion techniques is their high accuracy even when inferring from few subjects. Extant label fusion techniques rely on tissue contrast, not taking into account the fibrous structure of white matter. Leveraging that brain structures constrain the diffusion of water particles differently, we propose a novel diffusion driven technique to improve the localization of brain pathways. We show its feasibility and advantages in both synthetic and human data.
This work has been published in 26.
6.2 Unveiling brain activity using M/EEG
A Comprehensive Study on Electroencephalography and Magnetoencephalography Sensitivity to Cortical and Subcortical Sources
Participants: Maria Carla Piastra, Andreas Nüßing, Johannes Vorwerk, Maureen Clerc, Christian Engwer, Carsten Wolters.
Signal‐to‐noise ratio (SNR) maps are a good way to visualize electroencephalography (EEG) and magnetoencephalography (MEG) sensitivity. SNR maps extend the knowledge about the modulation of EEG and MEG signals by source locations and orientations and can therefore help to better understand and interpret measured signals as well as source reconstruction results thereof. Our work has two main objectives. First, we investigated the accuracy and reliability of EEG and MEG finite element method (FEM)‐based sensitivity maps for three different head models, namely an isotropic three and four‐compartment and an anisotropic six‐compartment head model. As a result, we found that ignoring the cerebrospinal fluid leads to an overestimation of EEG SNR values. Second, we examined and compared EEG and MEG SNR mappings for both cortical and subcortical sources and their modulation by source location and orientation. Our results for cortical sources show that EEG sensitivity is higher for radial and deep sources and MEG for tangential ones, which are the majority of sources. As to the subcortical sources, we found that deep sources with sufficient tangential source orientation are recordable by the MEG. Our work, which represents the first comprehensive study where cortical and subcortical sources are considered in highly detailed FEM‐based EEG and MEG SNR mappings, sheds a new light on the sensitivity of EEG and MEG and might influence the decision of brain researchers or clinicians in their choice of the best modality for their experiment or diagnostics, respectively.
This work has been published in 17.
Convolutional Autoencoder for Waveform Learning
Participants: Sara Sedlar, Sandra Ayas, Rachid Deriche, Théodore Papadopoulo.
Electro- or Magneto-encephalographic (M/EEG) signals measured on the scalp can be modeled as a linear combination of source signals occurring in different cortical regions. Analysis of specific recurrent waveforms from measurements can help in the evaluation of several neurological disorders such as epilepsy, Alzheimer's disease, and narcolepsy. In addition, detection of the neural events evoked by certain stimuli is crucial for brain-computer interfaces. Such M/EEG signals are quite faint and inherently affected by an important noise, generated by irrelevant brain activities, by other organs, by external ambient noise or imperfections of the measuring devices. In addition, there are intra- and inter-subject variabilities, meaning that the relevant waveforms vary in terms of amplitudes, shapes, and time delays. This makes waveform learning on such signals a quite complex task. In order to address these problems, a number of dictionary (here waveforms) learning based approaches has been proposed. The common framework behind those approaches is an alternative estimation of data-driven waveforms and their corresponding activations in terms of amplitudes and positions over time. Motivated by the success of these methods and the advances in deep learning, we propose a method based on a convolutional auto-encoder that aims at improving more traditional approaches. Auto-encoders are unsupervised neural network models that have been successfully used for data compression, feature learning, denoising and clustering. Auto-encoders are composed of an encoder which creates a code also known as bottle-neck and decoder that is supposed to reconstruct input signal given the code. By penalizing reconstruction loss function with certain constraints we can guide the auto-encoder to perform compression, denoising, clustering etc. For the moment, the properties of the model are investigated on single-channel synthetic data imitating three types of neurological activities (spikes, short oscillatory and low frequency saw-tooth waveforms) mixed using a realistic leadfield matrix (source space to sensor space transform).
This work is in current progress.
Automatic Detection of Epileptic Spikes in EEG Signals
Participants: Pierre Guetschel, Fabrice Duprat, Massimo Mantegazza, Théodore Papadopoulo.
Epilepsy is a serious condition that affects almost 50 million people worldwide. Despite several generations of antiepileptic treatments, the rate of drug-resistant patients remains around 30% and the discovery of new pharmacological targets is therefore a crucial issue.
In order to find pharmacological targets, several animal models make it possible to study the mechanisms of establishment of epileptic disease, or epileptogenesis, and the consequences of repeated spontaneous attacks which characterize epilepsy. Recording an electroencephalogram (EEG) remains the best way to understand these mechanisms. However, the placement of electrodes on small animals such as mice is difficult or even impossible depending on the age of the animal or other used protocols. The use of video recordings over several days, weeks or months makes it possible to observe the animals with a minimum of disturbances and to assess the severity of the crises on a behavioral scale. In both cases, the visual analysis of hundreds of hours of video and/or EEG recordings is very long and error-prone.
The goal of this joint IPMC, Athena work was to improve software tools to automate EEG analysis in long recording sequences. We started from the "Adaptive Waveform Learning" method that was developed in the group a few years ago 61. In the context of video EEG recordings, the method proved to work poorly due to the motion artifacts generated by the mice activities. The method was thus revisited and re-implemented using the alphacsc code base and used along with some outlier suppression techniques
Embeddings for EEG Signals
Participants: Pierre Guetschel, Yang Ji, Michael Tangerman, Théodore Papadopoulo.
The goal of this work is to generate embedding for EEG recordings in order to use them in various BCI tasks. To produce them, we used EEGNet, a CNN model that was originally designed for EEG classification where we just changed the output size. We chose it for it's light weight, allowing relatively fast training and experimentation. We introduced a new loss function to train this model that can be seen as a generalization of the triplet loss. It can encode in the embeddings multiple independent labels (ie. all the metadata coming with EEG recordings), their relative importance and their weight. The flexibility of this new loss allows us to express some expert knowledge in the embeddings. To evaluate if the desired information is actually encoded in the embeddings, we test if simple models (i.e. linear classifier or KNN) can classify them according to one of the labels, and we do so for all the labels independently. In the future, we will investigate whether some interesting properties might have been encoded in these embeddings without having explicitly been trained for (like it was the case for word embeddings in NLP). These could include, for example, one of the metadata that has been ignored during the training phase.
This is work in progress.
6.3 Combined fMRI, M/EEG and dMRI
A Unified Framework for Multimodal Structure-function Mapping Based on Eigenmodes
Participants: Samuel Deslauris-Gauthier, Mauro Zucchelli, Matteo Frigo, Rachid Deriche.
Characterizing the connection between brain structure and brain function is essential for understanding how behaviour emerges from the underlying anatomy. A number of studies have shown that the network structure of the white matter shapes functional connectivity. Therefore, it should be possible to predict, at least partially, functional connectivity given the structural network. Many structure–function mappings have been proposed in the literature, including several direct mappings between the structural and functional connectivity matrices. However, the current literature is fragmented and does not provide a uniform treatment of current methods based on eigendecompositions. In particular, existing methods have never been compared to each other and their relationship explicitly derived in the context of brain structure–function mapping. In this work, we propose a unified computational framework that generalizes recently proposed structure–function mappings based on eigenmodes. Using this unified framework, we highlight the link between existing models and show how they can be obtained by specific choices of the parameters of our framework. By applying our framework to 50 subjects of the Human Connectome Project, we reproduce 6 recently published results, devise two new models and provide a direct comparison between all mappings. Finally, we show that a glass ceiling on the performance of mappings based on eigenmodes seems to be reached and conclude with possible approaches to break this performance limit.
Connectivity-Informed M/EEG Inverse Problem
Participants: Ivana Kojčić, Théodore Papadopoulo, Rachid Deriche, Samuel Deslauriers-Gauthier.
In the context of regularizing the dynamics of M/EEG and recovering electrical activity of the brain from M/EEG measurements, traditional linear inverse methods deploy different constraints such as minimum norm, maximum-smoothness in space and/or time along the cortical surface. However, they usually do not take into account the structural connectivity and very few include delays supported by dMRI as a prior information. The goal of this work is to include these delays into the MEG source reconstruction process by imposing temporal smoothness in structurally connected sources, with the corresponding delays. We propose to encapsulate delays provided by dMRI in a graph representation and show their potential in improving the MEG source reconstruction when compared to a state-of-the-art approach. Our preliminary results show that including the conduction delays provided by dMRI encapsulated in a graph representation improves MEG source localization when compared to the state-of-the-art Cortical Graph Smoothing (CGS) method.
This work has been published in 20.
Using Structural Connectivity to Reconstruct Brain Activation and Effective Connectivity
Participants: Brahim Belaoucha, Théodore Papadopoulo.
Understanding how brain regions interact to perform a specific task is very challenging. EEG and MEG are two noninvasive imaging modalities that allow the measurement of brain activation with high temporal resolution. Several works in EEG/MEG source reconstruction show that estimating brain activation can be improved by considering spatio-temporal constraints but only few of them use structural informa on to do so. We present a source estimation algorithm that uses brain structural connectivity, obtained from diffusion MRI (dMRI), to constrain the EEG/MEG source reconstruction. Contrarily to most source reconstruction methods which reconstruct activation for each time instant, the proposed method estimates an initial reconstruction for the first time instants and a multivariate auto-regressive model that explains the data in further time instants. This auto-regressive model can be thought as an estimation of the effective connectivity between brain regions.
We called this algorithm iterative Source and Dynamics reconstruction (iSDR). This work presents the overall iSDR approach and how the proposed model is optimized to obtain both brain activation and brain region interactions. The accuracy of our method is demonstrated using synthetic data in which it shows a good capability to reconstruct both activation and connectivity. iSDR is also tested with real data (face recognition task). The results are in phase with other works published with the same data and others that used different imaging modalities with the same task showing that the choice of using an autoregressive model gives relevant results. This work shows that complex EEG/MEG datasets can be explained by an initial state and a MAR model for effective connectivity. This is a compact way to describe brain dynamics and offers a direct access to effective connectivity
Non–invasive Inference of Information Flow Using Diffusion MRI, Functional MRI, and MEG
Participants: Samuel Deslauriers-Gauthier, Isa Costantini, Rachid Deriche.
To infer information flow in the white matter of the brain and recover cortical activity using functional MRI, diffusion MRI, and MEG without a manual selection of the white matter connections of interest. A Bayesian network which encodes the priors knowledge of possible brain states is built from imaging data. Diffusion MRI is used to enumerate all possible connections between cortical regions. Functional MRI is used to prune connections without manual intervention and increase the likelihood of specific regions being active. MEG data is used as evidence into this network to obtain a posterior distribution on cortical regions and connections. We show that our proposed method is able to identify connections associated with the a sensory–motor task. This allows us to build the Bayesian network with no manual selection of connections of interest. Using sensory–motor MEG evoked response as evidence into this network, our method identified areas known to be involved in a visuomotor task. In addition, information flow along white matter fiber bundles connecting those regions was also recovered. Significance. Current methods to estimate white matter information flow are extremely invasive, therefore limiting our understanding of the interaction between cortical regions. The proposed method makes use of functional MRI, diffusion MRI, and M/EEG to infer communication between cortical regions, therefore opening the door to the non–invasive exploration of information flow in the white matter.
Towards Linking Diffusion MRI Based Macro- and Microstructure Measures with Cortico-Cortical Transmission in Brain Tumor Patients
Participants: Patryk Filipiak, Fabien Almairac, Marie Onno, Theo Papadopoulo, Denys Fontaine, Lydiane Mondot, Stéphane Chanalet, Rachid Deriche, Maureen Clerc, Demian Wassermann.
We aimed to link macro- and microstructure measures of brain white matter obtained from diffusion MRI with effective connectivity measures based on a propagation of cortico-cortical evoked potentials induced with intrasurgical direct electrical stimulation. For this, we compared streamline lengths and log-transformed ratios of streamlines computed from presurgical diffusion-weighted images, and the delays and amplitudes of N1 peaks recorded intrasurgically with electrocorticography electrodes in a pilot study of 9 brain tumor patients. Our results showed positive correlation between these two modalities in the vicinity of the stimulation sites (Pearson coefficient 0.54±0.13 for N1 delays, and 0.47±0.23 for N1 amplitudes), which could correspond to the neural propagation via U-fibers. In addition, we reached high sensitivities (0.78±0.07) and very high specificities (0.93±0.03) in a binary variant of our comparison. Finally, we used the structural connectivity measures to predict the effective connectivity using a multiple linear regression model, and showed a significant role of brain microstructure-related indices in this relation.
Part of this work has been published in 15.
A Paradigm Free Regularization Approach to Recover Brain Activations: Validation on Task fMRI
Participants: Isa Costantini, Samuel Deslauriers-Gauthier, Rachid Deriche.
Resting-state functional MRI (rs-fMRI) provides insight into brain function in the absence of stimuli and allows to map brain activity for subjects whose condition does not allow to perform tasks. This has emphasized the need to recover neural activations from fMRI signals in the absence of an experimental paradigm. To avoid the need for prior information on the timing of the activations, techniques to deconvolve brain activity from the blood-oxygen-level-dependent (BOLD) response have been proposed. In particular, by supposing the brain activates in constant blocks, Farouj et al. developed an approach which involves both spatial and temporal regularization (Total Activation, TA). However, it splits the optimization problem into two decoupled spatial and temporal regularization which doubles the number of parameters to set and requires the solver to alternate between the constraints. Starting from the idea that large image variations should be preserved as they occur during brain activation, whereas small variations should be smoothed to remove noise, we previously proposed an alternative paradigm-free algorithm based on partial differential equations (PDEs) named PFFMRI (Paradigm-Free fMRI). In this work, we validate PFFMRI on task-fMRI data from 51 subjects using the experimental paradigm as ground truth and compare its performance to TA. We also show that PFFMRI recovers activity that agrees with the general linear model (GLM) without knowledge of the experimental paradigm.
This work has been published in 23.
Diffusion MRI-Based Connectivity Enriched with Microstructure Information Predicts the Propagation of Cortico-Cortical Evoked Potentials
Participants: Patryk Filipiak, Fabien Almairac, Theodore Papadopoulo, Denys Fontaine, Lydiane Mondot, Stéphane Chanalet, Rachid Deriche, Maureen Clerc, Demian Wassermann.
Propagation of Cortico-Cortical Evoked Potentials (CCEPs) varies depending on numerous structural features of brain tissue. In this work, we show that dMRI-based connectivity enriched with microstructure data has the potential to measure cortico-cortical communication as it predicts CCEP-based effective connectivity. Our multiple linear regression model incorporates q-space indices like Q-space Inverse Variance, Non-Gaussianity and Return to Plane Probability with minimum streamline lengths obtained from tractography to predict delays and amplitudes of the N1 peaks in CCEPs. In our experiment, we use presurgical dMRI and intrasurgical ECoG recordings of 9 patients operated on brain tumor in the awake condition.
This work has been published in 19.
Analytical and Fast Fiber ODF Reconstruction in 3D Polarized Light Imaging
Participants: Abib Olushola Yessouffou Alimi, Samuel Deslauriers-Gauthier, Felix Matuschke, Andreas Muller, Sacha Muenzing, Markus Axer, Rachid Deriche.
Three dimensional Polarized Light Imaging (3D-PLI) is an optical technique which allows mapping the spatial fiber architecture of fibrous postmortem tissues, at sub-millimeter resolutions. Here, we propose an analytical and fast approach to compute the fiber orientation distribution (FOD) from high-resolution vector data provided by 3D-PLI. The FOD is modeled as a sum of K orientations/Diracs on the unit sphere, described on a spherical harmonics basis and analytically computed using the spherical Fourier transform. Experiments are performed on rich synthetic data which simulate the geometry of the neuronal fibers and on human brain data. Results indicate the analytical FOD is computationally efficient and very fast, and has high angular precision and angular resolution. Furthermore, investigations on the right occipital lobe illustrate that our strategy of FOD computation enables the bridging of spatial scales from microscopic 3D-PLI information to macro-or mesoscopic dimensions of diffusion Magnetic Resonance Imaging (MRI), while being a means to evaluate prospective resolution limits for diffusion MRI to reconstruct regionspecific white matter tracts. These results demonstrate the interest and great potential of our analytical approach.
Quantitative Assessment of Multi-Scale Tractography: Bridging the Resolution Gap With 3D-PLI
Participants: Abib Olushola Yessouffou Alimi, Matteo Frigo, Samuel Deslauriers-Gauthier, Rachid Deriche.
The in vivo validation of diffusion MRI (dMRI)-based tractography has been shown to be a challenging task. Therefore, we have been investigating how 3D Polarized Light Imaging (3D-PLI) could be used as a validation tool for dMRI-based fiber orientation estimation and tractography. PLI is an optical imaging technique that provides us with high-resolution fiber orientation measurements at micrometer scale. For this reason, it has been presented as a good candidate for the afore mentioned validation tasks. In some previous works, we introduced an approach to close the resolution gap between dMRI and 3D-PLI. The study of the brain network from the topological point of view has seen an increasing interest in the last years. In this work, we show how tractograms obtained at different spatial scales using 3D-PLI human brain datasets can bein spected using homology theory to perform a quantitative comparison between them. In particular, we investigate the persistence of the number of connected components in brain networks estimated from data at different resolutions.
This work has been published in 22.
Improving Auto-Encoders' Self-Supervised Image Classification Using Pseudo-Labelling via Data Augmentation and the Perceptual Loss
Participants: Aymene Mohamed Bouayed, Karim Atif, Rachid Deriche, Abdelhakim Saim.
In this work, developed within the framework of a collaboration on a AI based subject, not yet related to brain imaging, we introduce a novel method to pseudo-label unlabelled images and train an Auto-Encoder to classify them in a self-supervised manner that allows for a high accuracy and consistency across several datasets. The proposed method consists of first applying a randomly sampled set of data augmentation transformations to each training image. As a result, each initial image can be considered as a pseudo-label to its corresponding augmented ones. Then, an Auto-Encoder is used to learn the mapping between each set of the augmented images and its corresponding pseudo-label. Furthermore, the perceptual loss is employed to take into consideration the existing dependencies between the pixels in the same neighbourhood of an image. This combination encourages the encoder to output richer encodings that are highly informative of the input's class. Consequently, the Auto-Encoder's performance on unsupervised image classification is improved both in termes of stability and accuracy becoming more uniform and more consistent across all tested datasets. Previous state-of-the-art accuracy on the MNIST, CIFAR-10 and SVHN datasets is improved by 0.3%, 3.11% and 9.21% respectively.
This work has been published in 31.
6.4 Brain Computer Interfaces
Auto-Calibration of c-VEP BCI by Word Prediction
Participants: Federica Turi, Nathalie Gayraud, Maureen Clerc.
A code-modulated Visual Evoked Potential Brain Computer Interface (c-VEP BCI) allows for spelling from a virtual keyboard of flashing characters. All characters flash simultaneously, and each character flashes according to a predefined pseudo-random binary sequence, circular-shifted by a different time lag. For a given character, the pseudo-random stimulus sequence evokes a VEP in the electroencephalogram (EEG) of the subject, which can be used as a template. This template is usually obtained during a calibration phase and it is applied for the target identification during the spelling phase. A downside of a c-VEP BCI system is that it needs a long calibration phase to reach good performance. This work proposes an unsupervised method that avoids the calibration phase in a c-VEP BCI, by extracting relative lags from the VEP responses, between successive characters, and predicting the full word using a dictionary. We tested it in offline experiments on a public dataset. We simulated the spelling of four groups of words with a different total number of characters selected from an English dictionary. Each experiment is parameterized by the number of stimulus cycles. The obtained results show that a word-prediction-based auto-calibration method in c-VEP BCIs can be efficient and effective. This work has been published in 35 and is part of the PhD thesis 30.
Finding the Best Classifier for the Cybathlon Competition
Participants: Yang Ji, Paul-Emmanuel Ponsenard, Amandine Audino, Maureen Clerc, Théodore Papadopoulo.
In 2020, the Athena team was supposed to participate to the Cybathlon BCI competition. For this, the team had developped a mental imagery based protocol which was relying on four mental tasks that were used to drive a car on a track in a virtual game. Each mental task corresponds to one of the simple actions (go straight, go left, go right, put lights on) that were needed to play the game. The data that the team gathered during 2019 was used in this study to find the best combination of classification method and parameters that led to the best classification scores. The study was based on the classifiers available in sckit-learns. The winning method was a Random Forest Classifier. In order to use it in a BCIO setup, this classifier has been re-implemented in C++. This will be useful for the BCI developments in the team, even if, in the end, due to the COVID-19 crisis the team has not participated to the virtual Cybathlon BCI race.
An Integrated BCI System for Cybathlon
Participants: Yang Ji, Côme Le Breton, Théodore Papadopoulo.
In 2019, the Athena team participated to a BCI competition preparatory to the 2020 Cybathlon BCI competition. The system that was used proved to be too complex: the solution was based on OpenViBE and was running on a small network of two computers. This complexity and the modularity that it brought was needed in the development phase of the system, but was counterproductive during the competition as the team had to struggle to deal with networking problems instead of concentrating on the competition and training the pilot. With the principles of the system fixed, it seemed valuable to develop a simplified system less modular but completely architectured around the needs of a competition to prepare the 2020 Cybathlon competition. Even though, in the end, the team had to cancell its participation due to the COVID-19 crisis, most of the work for such an integrated system has been done and will be valuable for the future BCI developments of the team.
EEG Neurofeeback for Epilepsy
Participants: Côme Le Breton, Jeanne Benoît, Fabrice Bartolomei, Christian Bénar, Maureen Clerc, Théodore Papadopoulo.
This work in progress is in collaboration with "Institut de Neurosciences des Systèmes" (Marseille). It focusses on alternative ways – without medication – to ease epilepsy symptoms. The team in Marseille had recently observed positive outcomes to Galvanic Skin Response (skin conductance) biofeedback.Given the relatively slow latency of this response (approx 3s), and the fact that this derived neural information is condensed in a single property varying with time, a scalp EEG informed biofeedback (neurofeedback) seems interesting to explore with the hope of getting better results. A review of the litterature for clues of neural synchrony in scalp EEG signals revealed in particular a paper discussing analysis of long range / short range synchrony in epileptic patients and control group. This paper claimed a reduced long range synchrony in epileptic patients. Such a claim seemed a good base to develop a neuromarker based on measuring this impaired long range synchrony. The different algorithms used in the paper were implemented and applied to both a Nice hospital database of recordings of epileptic patients EEG, and some new EEG recordings on healthy subjects. Unfortunately, the claims made in the paper were by no mean reproducible on their data, the variability of synchrony inside either group beeing way to strong to statistically infer differences based on the group. They are still investigating intra/interhemispheric synchrony with regard to the lateralisation of the epileptic focus, on the same dataset.
7 Partnerships and cooperations
7.1 International initiatives
Informal international partners
- Sherbrooke University, CA (M. Descoteaux)
- CMRR, University of Minnesota, USA (C. Lenglet)
- Verona University, IT (G. Menegaz)
- Department of CISE, the University of Florida, Gainesville, USA (B. C. Vemuri)
- Centre for Medical Image Computing (CMIC), Dept. Computer Science, UCL, UK (D. Alexander)
- SBIA, University of Pennsylvania Medical School, USA (R. Verma).
- EEMagine company on EEG/MEG hardware.
7.2 International research visitors
7.2.1 Visits of international scientists
- Enes Albay - Ph.D. student in Computer Engineering (Cont.), Istanbul Technical University, From Nov. 2019 to March 2020.
7.3 European initiatives
7.3.1 ERC AdG CoBCoM
- Program: H2020-EU.1.1. (ERC-ADG-2015 - ERC Advanced Grant)
- Project acronym: CoBCoM - ID: 694665
- Project title: Computational Brain Connectivity Mapping
- Start date: 2016-09-01, End date: 2021-08-31
- P.I. : R. Deriche
- Partners: Athena project-team
One third of the burden of all the diseases in Europe is due to problems caused by diseases affecting brain. Although exceptional progress has been obtained for exploring it during the past decades, the brain is still terra-incognita and calls for specific research efforts to better understand its architecture and functioning.
CoBCoM is our response to this great challenge of modern science with the overall goal to develop a joint Dynamical Structural-Functional Brain Connectivity Network (DSF-BCN) solidly grounded on advanced and integrated methods for diffusion Magnetic Resonance Imaging (dMRI) and Electro & Magneto-Encephalography (EEG & MEG).
To take up this grand challenge and achieve new frontiers for brain connectivity mapping, we will develop a new generation of computational models and methods for identifying and characterizing the structural and functional connectivities that will be at the heart of the DSF-BCN. Our strategy is to break with the tradition to incrementally and separately contributing to structure or function and develop a global approach involving strong interactions between structural and functional connectivities. To solve the limited view of the brain provided just by one imaging modality, our models will be developed under a rigorous computational framework integrating complementary non invasive imaging modalities: dMRI, EEG and MEG.
CoBCoM will push far forward the state-of-the-art in these modalities, developing innovative models and ground-breaking processing tools to provide in-fine a joint DSF-BCN solidly grounded on a detailed mapping of the brain connectivity, both in space and time.
Capitalizing on the strengths of dMRI, MEG & EEG methodologies and building on the bio-physical and mathematical foundations of our new generation of computational models, CoBCoM will be applied to high-impact diseases, and its ground-breaking computational nature and added clinical value will open new perspectives in neuroimaging.
7.4 National initiatives
3IA UCA Chair : AI-Based Computational Brain Connectomics
Participants: Rachid Deriche, Samuel Deslauriers-Gauthier, Sara Sedlar, Mauro Zuccheli.Start date: 2019-10-01 Duration:48 months.
This project aims to reconstruct and analyse the network of neural connections of the brain, called the connectome via a computational brain connectomics framework based on ground-breaking AI algorithms and machine learning tools to gain insight into brain architecture, functioning and neurodegenerative diseases.
The avalanche of big data required to reconstruct the connectome and the study of the high complexity of structural and functional interactions within the connectome clearly position brain connectomics as a big data problem where AI & machine learning in particular, represent a very promising trend, as recently demonstrated in computer vision and in some biomedical image data-driven analysis. Partly related to the ERC AdG CoBCoM, the computational brain connectomics framework we develop in this project will construct networks specifically built on new generation of AI algorithms and machine learning tools to reconstruct a structural and functional connectome using advanced and integrated dMRI, EEG & MEG methods. This project completes CoBCoM by specifically investigating the AI added value in brain mapping, opens also exciting prospects and paves the way to translate the large amounts of high dimensional heterogeneous and complex brain data into knowledge for better contribute to neurodegenerative diseases detection and diagnosis.
Participants: Théodore Papadopoulo, Maureen Clerc, Kostiantyn Maksymenko, Alexandre Gramfort, Joan Massich.
Duration: 24 months.
The OpenMEEG ADT aims at improving OpenMEEG along 3 main directions:
- Offer a user interface for the creation and verification of head models most importantly for a simpler management of non-nested head models.
- Improve the Python interface (extension and reliability). This will also be useful to develop new research axes (in connection with point 3).
- Enrich the available operators and refactor the code to offer new possibilities in OpenMEEG and reduce the cost of maintenance.
In addition to the expected gains in code maintenance, these improvements will allow a number of new – more sophisticated – applications as well as open OpenMEEG to a larger audience with a simplified interface for classical use-cases.
This contract is part of the AMDT initiative.
8.1 Promoting scientific activities
Member of the organizing committees
- T. Papadopoulo is member of the Program Commitee of Soph.IA 2020.
8.1.1 Scientific events: selection
- R. Deriche serves several international conferences (ISBI, MICCAI, ISMRM, ...) and international workshops (CD-MRI MICCAI, MFCA Miccai...)
- T. Papadopoulo served for the ISBI international conference.
Member of the editorial boards
- R. Deriche is member of the Editorial Board of the Journal of Neural Engineering, editorial board member at Springer for the book series entitled Computational Imaging and Vision and member of the Editorial Board of the Medical Image Analysis Journal
- M. Clerc, R. Deriche and T. Papadopoulo serve as Guest Editor for the special issue on Non-invasive brain imaging of the Journal of Neural Engineering.
Reviewer - reviewing activities
- R. Deriche serves several international journals (NeuroImage, IEEE Transactions on Medical Imaging, Magnetic Resonance in Medicine,Journal of Mathematical Imaging and Vision, Medical Image Analysis Journal, ...).
- T. Papadopoulo served several international journals (Frontiers in Neuroscience, Brain Computer Interfaces, Journal of Neural Engneering, Medical & Biological Engineering & Computing).
- S. Deslauriers-Gauthier serves several international journals (NeuroImage, IEEE Transactions on Biomedical Engineering, Journal of Neural Engineering).
- M. Zucchelli serves several international journals (NeuroImage, BioMedical Engineering OnLine).
8.1.3 Invited talks
- T. Papadopoulo has been invited to give a pretentation on Brain Computer Interfaces at Institute for Language, Communication and the Brain (ILCB), on Sep. 1st, 2020
8.1.4 Leadership within the scientific community
- T. Papadopoulo is a member of the scientific committee of the NeuroMod institute of Université Côte d'Azur.
- T. Papadopoulo is a member of the COSP of the EUR Healthy of Université Côte d'Azur.
8.1.5 Scientific expertise
- T. Papadopoulo served in reviewing applications for the Neuromod institute of Université Côte d'Azur.
- R. Deriche served several national and international institutions in reviewing applications : 3IA UCA Chairs, ERC AdG and StG Grants, Swiss National Science Foundation, EPFL, the Netherlands Organisation for Scientific Research (NWO).
8.1.6 Research administration
- T. Papadopoulo was a member of the CRCN/ISFP hiring committee at Inria Sophia Antipolis.
- T. Papadopoulo has been appointed as the head of the Inria Sophia Software committeee (CDT) since June, 1st, 2020.
- T. Papadopoulo is a member of the Computer Users committee (CUMI) since September, 2020.
8.2 Teaching - Supervision - Juries
- Master: T. Papadopoulo, Inverse problems for brain functional imaging, 24 ETD, M2, Mathématiques, Vision et Apprentissage, ENS Cachan, France.
- Master: T. Papadopoulo, Functional Brain Imaging, 20ETD, M1,M2 in the MSc Mod4NeuCog of Université Côte d'Azur.
- PhD defended on May 27th, 2020: Abib Alimi, “3D Polarized Light Imaging : Towards Multiscale and Multimodal Analysis with Diffusion MRI. Université Côte d'Azur. Supervisors: Rachid Deriche and Samuel Deslauriers-Gauthier.
- PhD in progress: To be defended on Feb. 22th, 2021 Matteo Frigo, “Computational brain connectivity mapping: from multi-compartment modeling to network topology via tractography filtering” started Nov, 1st, 2017, Université Côte d'Azur. Supervisors: Rachid Deriche and Samuel Deslauriers-Gauthier.
- PhD defended on May 28th, 2020: Isa Costantini, “Paradigm Free Regularization for fMRI Brain Activation Recovery” Université Côte d'Azur. Supervisors: Rachid Deriche and Samuel Deslauriers-Gauthier.
- PhD defended on Sep. 23rd, 2020: Federica Turi, “User-adapted Brain Computer Interaction” Université Côte d'Azur, started October 2016. Supervisor: Maureen Clerc.
- PhD in progress: Sara Sedlar,"Reconstruction and analysis of dynamical functional networks from EEG, MEG and dMRI measurements", Université Côte d'Azur, started October 2018. Supervisors: Théodore Papadopoulo and Maureen Clerc.
- PhD in progress: Ivana Kojcic, "Estimation of cortical activity and of the structure–function link using EEG and dMRI", Université Côte d'Azur, started October 2018. Supervisors: Théodore Papadopoulo and Samuel Deslauriers-Gauthier.
- PhD in progress: Côme Le Breton, "Non invasive analysis of epileptogenetic networks and their response to neurofeedback", started June 2019. Supervisors: Maureen Clerc and Théodore Papadopoulo.
- PhD in progress: Joan Belo, "Electroencephalography analysis of auditory attention when listening to music", started June 2019. Supervisors: Maureen Clerc and Daniele Schön.
- R. Deriche, S. Deslauriers-Gauthier and T. Papadopoulo participated in the PhD Jury of A. Alimi at Université Côte d'Azur on May. 27th, 2020.
- R. Deriche, S. Deslauriers-Gauthier and T. Papadopoulo participated in the PhD Jury of I. Costantini at Université Côte d'Azur on May. 28th, 2020.
- T. Papadopoulo and M. Clerc participated in the PhD Jury of F. Turi at Université Côte d'Azur on Sep. 23rd, 2020.
9 Scientific production
9.1 Major publications
- 1 article'Consensus Matching Pursuit for Multi-Trial EEG Signals'.Journal of Neuroscience Methods1802009, 161-170
- 2 article'Design of multishell sampling schemes with uniform coverage in diffusion MRI'.Magnetic Resonance in Medicine696June 2013, 1534-1540
- 3 article'Regularized, Fast, and Robust Analytical Q-Ball Imaging'.Magnetic Resonance in Medicine5832007, 497-510URL: ftp://ftp-sop.inria.fr/odyssee/Publications/2007/descoteaux-angelino-etal:07.pdf
- 4 article'Deterministic and Probabilistic Tractography Based on Complex Fibre Orientation Distributions'.IEEE Transactions in Medical Imaging282February 2009, 269-286URL: ftp://ftp-sop.inria.fr/odyssee/Publications/2009/descoteaux-deriche-etal:09.pdf
- 5 article 'White Matter Information Flow Mapping from Diffusion MRI and EEG'. NeuroImage July 2019
- 6 article'A Unified Framework for Multimodal Structure-function Mapping Based on Eigenmodes'.Medical Image AnalysisAugust 2020, 22
- 7 article'MAPL: Tissue microstructure estimation using Laplacian-regularized MAP-MRI and its application to HCP data'.Neuroimage134July 2016, 365-385
- 8 article'AxTract: Toward microstructure informed tractography'.Human Brain Mapping3811November 2017, 5485-5500URL: http://onlinelibrary.wiley.com/doi/10.1002/hbm.23741/abstract
- 9 article'A Trilinear Immersed Finite Element Method for Solving the Electroencephalography Forward Problem'.SIAM Journal on Scientific Computing3242010, 2379-2394
- 10 article 'A Computational Framework For Generating Rotation Invariant Features And Its Application In Diffusion MRI'. Medical Image Analysis February 2020
9.2 Publications of the year
International peer-reviewed conferences
Conferences without proceedings
Doctoral dissertations and habilitation theses
Reports & preprints
Other scientific publications
9.4 Cited publications
- 39 article'Composite hindered and restricted model of diffusion (CHARMED) MR imaging of the human brain'.Neuroimage271August 2005, 48-58
- 40 article'AxCaliber: a method for measuring axon diameter distribution from diffusion MRI'.Magnetic Resonance in Medicine5962008, 1347--54URL: http://www.ncbi.nlm.nih.gov/pubmed/18506799
- 41 incollection'Apparent Intravoxel Fibre Population Dispersion (FPD) Using Spherical Harmonics'.Medical Image Computing and Computer-Assisted Intervention -- MICCAI 20116892Lecture Notes in Computer ScienceSpringer Berlin / Heidelberg2011, 157-165URL: http://dx.doi.org/10.1007/978-3-642-23629-7_20
- 42 article'Efficient and robust computation of PDF features from diffusion MR signal'.Medical Image Analysis1352009, 715--729
- 43 article'Regularized Positive-Definite Fourth-Order Tensor Field Estimation from DW-MRI'.NeuroImage451March 2009, S153-162.URL: http://www.sciencedirect.com/science/journal/10538119
- 44 article'Estimation of the effective self-diffusion tensor from the NMR spin echo'.Journal of Magnetic ResonanceB1031994, 247--254
- 45 article'MR Diffusion Tensor Spectroscopy and imaging'.Biophysical Journal6611994, 259--267
- 46 conference 'Using diffusion MRI information in the Maximum Entropy on Mean framework to solve MEG/EEG inverse problem'. BIOMAG Halifax, Canada August 2014
- 47 book 'Principles of nuclear magnetic resonance microscopy'. Oxford Oxford University Press 1991
- 48 phdthesis 'Q-Space diffusion MRI: Acquisition and signal processing'. University of Nice Sophia Antipolis July 2012
- 49 phdthesis 'Estimation and Processing of Ensemble Average Propagator and Its Features in Diffusion MRI'. University of Nice Sophia Antipolis May 2012
- 50 article'Optimal Real-Time Q-Ball Imaging Using Regularized Kalman Filtering with Incremental Orientation Sets'.Medical Image Analysis134August 2009, 564--579URL: http://dx.doi.org/10.1016/j.media.2009.05.008
- 51 article'Apparent Diffusion Coefficients from High Angular Resolution Diffusion Imaging: Estimation and Applications'.Magnetic Resonance in Medicine562006, 395--410URL: ftp://ftp-sop.inria.fr/odyssee/Publications/2006/descoteaux-angelino-etal:06c.pdf
- 52 article'High Angular Resolution Diffusion MRI Segmentation Using Region-Based Statistical Surface Evolution'.Journal of Mathematical Imaging and Vision332February 2009, 239-252URL: ftp://ftp-sop.inria.fr/odyssee/Publications/2009/descoteaux-deriche:09.pdf
- 53 article'Multiple q-shell diffusion propagator imaging'.Medical Image Analysis1542011, 603--621
- 54 phdthesis'High Angular Resolution Diffusion MRI: From Local Estimation to Segmentation and Tractography'.University of Nice Sophia AntipolisFebruary 2008, URL: ftp://ftp-sop.inria.fr/odyssee/Publications/PhDs/descoteaux_thesis.pdf
- 55 article'Clinical Applications of Diffusion Tensor Imaging'.Journal of Magnetic Resonance Imaging192004, 6--18
- 56 conference 'Glial tumor localization and characterization using DTI augmented MEG modelling'. Proceedings of Biomag Biomag Halifax, Canada 2014
- 57 incollection'From Diffusion MRI to Brain Connectomics'.Modeling in Computational Biology and Medicine: A Multidisciplinary EndeavorSpringer2013, 6193--231
- 58 incollection'From Second to Higher Order Tensors in Diffusion-MRI'.Tensors in Image Processing and Computer VisionAdvances in Pattern RecognitionSpringer LondonMay 2009, 9315-URL: http://www.springer.com/computer/computer+imaging/book/978-1-84882-298-6
- 59 phdthesis'High Order Models in Diffusion MRI and Applications'.University of Nice Sophia AntipolisApril 2011, URL: ftp://ftp-sop.inria.fr/athena/Publications/PhDs/ghosh:11.pdf
- 60 article 'Constrained Diffusion Kurtosis Imaging Using Ternary Quartics & MLE'. Magnetic Resonance in Medicine Article first published online: 2 JUL 2013 - Volume 71, Issue 4, April 2014, Pages: 1581--1591 July 2013
- 61 article'Adaptive Waveform Learning: A Framework for Modeling Variability in Neurophysiological Signals'.IEEE Transactions on Signal Processing6516April 2017, 4324--4338
- 62 book H. Johansen-Berg T. Behrens 'Diffusion MRI : From Quantitative Measurement to In vivo Neuroanatomy'. Elevier - Academic Press 2009
- 63 book D. Jones 'Diffusion MRI: Theory, Methods, and Applications'. Oxford University Press 2011
- 64 article'A Common Formalism for the Integral Formulations of the Forward EEG Problem'.IEEE Transactions on Medical Imaging24January 2005, 12--28URL: ftp://ftp-sop.inria.fr/odyssee/Publications/2005/kybic-clerc-etal:05.pdf
- 65 article'Imagerie de Diffusion in vivo par Résonnance Magnétique Nucléaire'.CR Académie des Sciences3011985, 1109-1112
- 66 article'Diffusion tensor imaging: concepts and applications'.J Magn Reson Imaging.1342001, 534-46URL: http://www.ncbi.nlm.nih.gov/pubmed/11276097
- 67 article'Mathematical Methods for Diffusion MRI Processing'.NeuroImage451March 2009, S111--S122URL: ftp://ftp-sop.inria.fr/odyssee/Publications/2009/lenglet-campbell-etal:09.pdf
- 68 article'DTI Segmentation by Statistical Surface Evolution'.IEEE Transactions on Medical Imaging,2506June 2006, 685--700URL: ftp://ftp-sop.inria.fr/odyssee/Publications/2006/lenglet-rousson-etal:06c.pdf
- 69 inproceedings'White Matter Abnormalities in Children with Temporal Lobe Epilepsy: A DTI and MEG Study'.17th International Conference on Biomagnetism Advances in Biomagnetism--Biomag2010Springer2010, 397--400
- 70 article'Self-diffusion NMR Imaging Using Stimulated Echoes'.J. Magn. Reson.641985, 479--486
- 71 phdthesis 'Diffusion MRI & Compressive Sensing'. Nice Sophia Antipolis University September 2013
- 72 article'Magnetoencephalography and diffusion tensor imaging in gelastic seizures secondary to a cingulate gyrus lesion'.Clinical neurology and neurosurgery10922007, 182--187
- 73 inproceedings'Simple harmonic oscillator based reconstruction and estimation for three-dimensional q-space MRI'.ISMRM 17th Annual Meeting and Exhibition, Honolulu,2009, 1396.URL: http://stbb.nichd.nih.gov/abstracts.html
- 74 article'Mean apparent propagator (MAP) MRI: a novel diffusion imaging method for mapping tissue microstructure'.Neuroimage78September 2013, 16--32URL: https://www.sciencedirect.com/science/article/pii/S1053811913003431
- 75 article'Generalized Diffusion Tensor Imaging and Analytical Relationships Between Diffusion Tensor Imaging and High Angular Resolution Imaging'.Magnetic Resonance in Medicine502003, 955--965
- 76 article'Generalized Scalar Measures for Diffusion MRI Using Trace, Variance and Entropy'.Magnetic Resonance in Medicine5342005, 866-876
- 77 article'Compartment models of the diffusion MR signal in brain white matter: A taxonomy and comparison'.NeuroImage592012, 2241--2254URL: https://doi.org/10.1016/j.neuroimage.2011.09.081
- 78 inproceedings'A nested cortex parcellation combining analysis of MEG forward problem and diffusion MRI tractography'.IEEE International Symposium on Biomedical Imaging (ISBI)IEEEBarcelonaMay 2012, 518--521
- 79 conference'Propagation of epileptic spikes revealed by diffusion-based constrained MEG source reconstruction'.19th International Conference on Biomagnetism (BIOMAG 2014)Halifax, CanadaAugust 2014, URL: http://www.biomag2014.org
- 80 incollection 'Higher-Order Tensors in Diffusion Imaging'. Visualization and Processing of Tensors and Higher Order Descriptors for Multi-Valued Data Dagstuhl Reports Springer 2013
- 81 conference 'Detection of large-scale networks in EEG and comparison with fMRI'. Proceedings of Biomag BIOMAG Paris, France August 2012
- 82 article'Ball and Rackets: Inferring Fibre Fanning from Diffusion-weighted MRI'.NeuroImage60January 2012, 1412--1425URL: http://dx.doi.org/10.1016/j.neuroimage.2012.01.056
- 83 article'Spin diffusion measurements: spin echoes in the presence of a time-dependent field gradient'.Journal of Chemical Physics421965, 288--292
- 84 article'The spatial mapping of translational diffusion coefficients by the NMR imaging technique'.Phys. Med. Biol.301985, 345-349URL: https://iopscience.iop.org/article/10.1088/0031-9155/30/4/009
- 85 article'Q-Ball Imaging'.Magnetic Resonance in Medicine5262004, 1358--1372
- 86 inproceedings'In vivo conductivity estimation using somatosensory evoked potentials and cortical constraint on the source'.Proceedings of ISBIApril 2007, 1036--1039URL: http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=4193466
- 87 article'Mapping complex tissue architecture with diffusion spectrum magnetic resonance imaging'.Magnetic Resonance in Medicine5462005, 1377--1386
- 88 article'NODDI: Practical in vivo neurite orientation dispersion and density imaging of the human brain'.NeuroImage61March 2012, 1000--1016URL: http://dx.doi.org/10.1016/j.neuroimage.2012.03.072