A novel information theory method for filter feature selection
Empreu sempre aquest identificador per citar o enllaçar aquest ítem
http://hdl.handle.net/10045/23400
Títol: | A novel information theory method for filter feature selection |
---|---|
Autors: | Bonev, Boyan | Escolano, Francisco | Cazorla, Miguel |
Grups d'investigació o GITE: | Robótica y Visión Tridimensional (RoViT) | Laboratorio de Investigación en Visión Móvil (MVRLab) |
Centre, Departament o Servei: | Universidad de Alicante. Departamento de Ciencia de la Computación e Inteligencia Artificial |
Paraules clau: | Filter feature selection | Information theory method | Mutual information estimation | Entropy estimation |
Àrees de coneixement: | Ciencia de la Computación e Inteligencia Artificial |
Data de publicació: | 2007 |
Editor: | Springer Berlin / Heidelberg |
Citació bibliogràfica: | BONEV, Boyan; ESCOLANO, Francisco; CAZORLA, Miguel Ángel. "A novel information theory method for filter feature selection". En: MICAI 2007: Advances in Artificial Intelligence 6th Mexican International Conference on Artificial Intelligence, Aguascalientes, Mexico, November 4-10, 2007, Proceedings / Alexander Gelbukh, Ángel Fernando Kuri Morales (Eds.). Berlin : Springer, 2007. (Lecture Notes in Computer Science; 4827). ISBN 978-3-540-76630-8, pp. 431-440 |
Resum: | In this paper, we propose a novel filter for feature selection. Such filter relies on the estimation of the mutual information between features and classes. We bypass the estimation of the probability density function with the aid of the entropic-graphs approximation of Rényi entropy, and the subsequent approximation of the Shannon one. The complexity of such bypassing process does not depend on the number of dimensions but on the number of patterns/samples, and thus the curse of dimensionality is circumvented. We show that it is then possible to outperform a greedy algorithm based on the maximal relevance and minimal redundancy criterion. We successfully test our method both in the contexts of image classification and microarray data classification. |
Patrocinadors: | This research is funded by the project DPI2005-01280 from the Spanish Government. |
URI: | http://hdl.handle.net/10045/23400 |
ISBN: | 978-3-540-76630-8 |
ISSN: | 0302-9743 (Print) | 1611-3349 (Online) |
DOI: | 10.1007/978-3-540-76631-5_41 |
Idioma: | eng |
Tipus: | info:eu-repo/semantics/conferenceObject |
Drets: | The original publication is available at www.springerlink.com |
Revisió científica: | si |
Versió de l'editor: | http://dx.doi.org/10.1007/978-3-540-76631-5_41 |
Apareix a la col·lecció: | INV - RoViT - Comunicaciones a Congresos, Conferencias, etc. |
Arxius per aquest ítem:
Arxiu | Descripció | Tamany | Format | |
---|---|---|---|---|
2007_Cazorla_etal_MICAI.pdf | Versión revisada (acceso abierto) | 668,65 kB | Adobe PDF | Obrir Vista prèvia |
2007_Cazorla_etal_MICAI_final.pdf | Versión final (acceso restringido) | 965,06 kB | Adobe PDF | Obrir Sol·licitar una còpia |
Tots els documents dipositats a RUA estan protegits per drets d'autors. Alguns drets reservats.