Please use this identifier to cite or link to this item:
https://hdl.handle.net/20.500.12008/2854
How to cite
Title: | Second generation sparse models |
Authors: | Ramirez, Ignacio |
Obtained title: | Doctor in Electrical Engineering |
University or service that grants the title: | University of Minnesota |
Tutor: | Sapiro, Guillermo |
Type: | Tesis de doctorado |
Issue Date: | 2011 |
Abstract: | Sparse data models, where data is assumed to be well represented as a linear combination of a few elements from a learned dictionary, have gained considerable attention in recent years, and their use has led to state-of-the-art results in many applications. The success of these models is largely attributed to two critical features: the use of sparsity as a robust mechanism for regularizing the linear coefficients that represent the data, and the flexibility provided by overcomplete dictionaries that are learned from the data. These features are controlled by two critical hyper-parameters: the desired sparsity of the coefficients, and the size of the dictionaries to be learned. However, lacking theoretical guidelines for selecting these critical parameters, applications based on sparse models often require hand-tuning and cross-validation to select them, for each application, and each data set. This can be both inefficient and ineffective. On the other hand, there are multiple scenarios in which imposing additional constraints to the produced representations, including the sparse codes and the dictionary itself, can result in further improvements. This thesis is about improving and/or extending current sparse models by addressing the two issues discussed above, providing the elements for a new generation of more powerful and flexible sparse models. First, we seek to gain a better understanding of sparse models as data modeling tools, so that critical parameters can be selected automatically, efficiently, and in a principled way. Secondly, we explore new sparse modeling formulations for effectively exploiting the prior information present in different scenarios. In order to achieve these goals, we combine ideas and tools from information theory, statistics, machine learning, and optimization theory. The theoretical contributions are complemented with applications in audio, image and video processing. |
Citation: | RAMIREZ, I. Second generation sparse models. Tesis de doctorado. University of Minnesota, 2011. |
License: | Licencia Creative Commons Atribución – No Comercial – Sin Derivadas (CC BY-NC-ND 4.0) |
Appears in Collections: | Tesis de posgrado - Instituto de Ingeniería Eléctrica |
This item is licensed under a Creative Commons License