Overall Objectives
Scientific Foundations
Application Domains
New Results
Contracts and Grants with Industry
Other Grants and Activities

Section: New Results

Keywords : sparse approximation, high dimension, scalable algorithms, dictionary design (dictionary, design).

Recent results on sparse representations

The team has had a substantial activity ranging from theoretical results to algorithmic design and software contributions in the field of sparse representations, which is at the core of the Equipe Associée SPARS (see Section  8.1.1 ) initiated in 2006 between METISS and the LTS2 lab at EPFL as well as the FET-Open European project (FP7) SMALL (Sparse Models, Algorithms and Learning for Large-Scale Data, to begin in 2009, see Section  7.2.1 ) and the ANR project ECHANGE (ECHantillonnage Acoustique Nouvelle GEnération, see, Section  6.5.1 ).

Algorithmic breakthrough in sparse approximation : LoCOMP

Participants : Boris Mailhé, Rémi Gribonval, Frédéric Bimbot.

Main collaborations: Pierre Vandergheynst (EPFL), Thomas Blumensath (Univ. Edinburgh), Emmanuel Ravelli, Laurent Daudet (LAM, Université Pierre et Marie Curie, Paris 6)

Our team had already made a substantial breakthrough in 2005 when first releasing the Matching Pursuit ToolKit (MPTK, see Section  5.3 ) which allowed for the first time the application of the Matching Pursuit algorithm to large scale data such as hours of CD-quality audio signals. This year, we designed a variant of Matching Pursuit called LoCOMP (ubiquitously for LOw Complexity Orthogonal Matching Pursuit or Local Orthogonal Matching Pursuit) speifically designed for shift-invariant dictionaries. LoCOMP has been shown to achieve an approximation quality very close to that of a full Orthonormal Matching Pursuit while retaining a much lower computational complexity of the order of that of Matching Pursuit. The complexity reduction is substantial, from one day of computation to 15 minutes for a typical audio signal (submitted to the conference ICASSP 2009 [31] ) and the algorithm is being integrated into MPTK, in collaboration with Dr Thomas Blumensath . Moreover, joint experiments have been performed together with Dr Emmanuel Ravelli and Pr Laurent Daudet to assess the impact of this new algorithm on the audio codec developed at LAM which is based on MPTK. A journal paper is in preparation.

Theoretical results on dictionary learning

Participant : Rémi Gribonval.

Main collaboration: Karin Schnass (EPFL)

While diverse heuristic techniques have been proposed in the litterature to learn a dictionary from a collection of training samples, there are little existing results which provide an adequate mathematical understanding of the behaviour of these techniques and their ability to recover an ideal dictionary from which the training samples may have been generated.

This year, we initiated a pioneering work on this topic, concentrating in particular on the fundamental theoretical question of the identifiability of the learned dictionary. Within the framework of the Ph.D. of Karin Schnass, we developed an analytic approach which was published at the conference ISCCSP 2008  [24] and allowed us to describe "geometric" conditions which guarantee that a (non overcomplete) dictionary is "locally identifiable" by $ \ell$1 minimization.

In a second step, we focused on estimating the number of sparse training samples which is typically sufficient to guarantee the identifiability (by $ \ell$1 minimization), and obtained the following result, which is somewhat surprising considering that previous studies seemed to require a combinatorial number of training samples to guarantee the identifiability: the local identifiability condition is typically satisfied as soon as the number of training samples is roughly proportional to the ambient signal dimension. This second result was published at the conference EUSIPCO 2008 [23] , and a journal paper is in preparation.

Theoretical results on identification of sparse representations

Participant : Rémi Gribonval.

Main collaboration: Mike Davies (Univ. Edinburgh)

We pursued our investigation of conditions on an overcomplete dictionary which guarantee that certain ideal sparse decompositions can be recovered by some specific optimization principles. Our results from the previous years, published this year  [16] , [13] , [17] concentrated on positive results for greedy algorithms and convex optimization ( $ \ell$1 -minimization). In contrast this year, in collaboration with Pr Michael Davies, we concentrated on $ \ell$p -minimization, 0< p$ \le$1 , and our results highlight the pessimistic nature of sparse recovery analysis when recovery is predicted based on the restricted isometry constants (RIC) of the associated matrix (submitted for publication  [47] ).

Shift-invariant dictionary learning algorithms and experiments with atrial signal extraction in ECG.

Participants : Boris Mailhé, Rémi Gribonval, Frédéric Bimbot.

Main collaborations: Pierre Vandergheynst and Matthieu Lemay (EPFL)

In addition to our pioneering theoretical work on dictionary identifiability, we amplified the effort begun in 2007 on the design of dictionary learning algorithms for structured shift-invariant dictionaries. This work, performed in the framework of the Ph.D. of Boris Mailhé, was published at the conference EUSIPCO 2008 [32] . The proposed approach was further developed to study the problem of ventricular cancellation and atrial modelling in the ECG of patients suffering from atrial fibrillation, in collaboration with Mathieu Lemay from EPFL (submitted to the conference ICASSP09  [30] ).


Logo Inria