Skip to content
JournalsWorldThe Global Research Discovery Platform
Login Sign Up
SCHOLARLY PUBLICATION ✓ Open Access

Normalized Mutual Information Feature Selection

P. A. Estévez, M. Tesmer, Carlos A. Perez, Jacek M. Żurada

📖 IEEE Transactions on Neural Networks → 📅 2009-01-16 🔗 DOI: 10.1109/tnn.2008.2005601
View Journal Profile → ⬇ Download PDF View Official Paper ↗

📄 Abstract

A filter method of feature selection based on mutual information, called normalized mutual information feature selection (NMIFS), is presented. NMIFS is an enhancement over Battiti’s MIFS, MIFS-U, and mRMR methods. The average normalized mutual information is proposed as a measure of redundancy among features. NMIFS outperformed MIFS, MIFS-U, and mRMR on several artificial and benchmark data sets without requiring a user-defined parameter. In addition, NMIFS is combined with a genetic algorithm to form a hybrid filter/wrapper method called GAMIFS. This includes an initialization procedure and a mutation operator based on NMIFS to speed up the convergence of the genetic algorithm. GAMIFS overcomes the limitations of incremental search algorithms that are unable to find dependencies between groups of features.

📤 Share this page

Found this useful? Share it with your network.

𝕏XfFacebookinLinkedIn✆WhatsApp✈Telegram✉EmailMMendeley
✓ Link copied! Paste it on ResearchGate / Academia.edu

🔬 Related Research Papers

IEEE Transactions on Neural Networks

OP-ELM: Optimally Pruned Extreme Learning Machine

Yoan Miché, A. Sorjamaa et al. 2009-12-10 · Read paper → IEEE Transactions on Neural Networks

Lower Upper Bound Estimation Method for Construction of Neural Network-Based Prediction Intervals

Abbas Khosravi, Saeid Nahavandi et al. 2010-12-23 · Read paper → IEEE Transactions on Neural Networks

Efficient and Robust Feature Extraction by Maximum Margin Criterion

Haizhou Li, Tao Jiang, Kai Zhang 2006-01-01 · Read paper → IEEE Transactions on Neural Networks

MPCA: Multilinear Principal Component Analysis of Tensor Objects

Haiping Lu, Konstantinos N. Plataniotis, A.N. Venetsanopoulos 2008-01-01 · Read paper → IEEE Transactions on Neural Networks

Incremental Learning of Concept Drift in Nonstationary Environments

Ryan Elwell, Robi Polikar 2011-08-15 · Read paper → IEEE Transactions on Neural Networks

A VLSI Array of Low-Power Spiking Neurons and Bistable Synapses With Spike-Timing Dependent Plasticity

Giacomo Indiveri, Elisabetta Chicca, Rodney J. Douglas 2006-01-01 · Read paper → IEEE Transactions on Neural Networks

Adaptive Neural Control for Output Feedback Nonlinear Systems Using a Barrier Lyapunov Function

Beibei Ren, Shuzhi Sam Ge et al. 2010-07-08 · Read paper → IEEE Transactions on Neural Networks

Semi-Supervised Learning (Chapelle, O. et al., Eds.; 2006) [Book reviews]

Olivier Chapelle, Bernhard Schölkopf, Eds. A. Zien 2009-02-26 · Read paper → IEEE Transactions on Neural Networks

Neural Network-Based Adaptive Dynamic Surface Control for a Class of Uncertain Nonlinear Systems in Strict-Feedback Form

Dan Wang, Jie Huang 2005-01-01 · Read paper → IEEE Transactions on Neural Networks

2011 International Joint Conference on Neural Networks

H. AMADOU BOUBACAR, Lecoeuche et al. 2010-08-01 · Read paper → IEEE Transactions on Neural Networks

2011 International Joint Conference on Neural Networks

2011-01-01 · Read paper → IEEE Transactions on Neural Networks

A Fast and Accurate Online Sequential Learning Algorithm for Feedforward Networks

Nanying Liang, Guang-Bin Huang et al. 2006-11-01 · Read paper →