Abstract: Aiming at the problem of redundant feature identification, this article analyzes the internal relationship between two kinds of correlation (correlation between feature and feature, correlation between feature and target value) and provides criterions for redundant feature determination. Approximate redundant feature is defined and a feature selection method based on redundancy is presented thereafter. The algorithm is divided into two steps to remove irrelevant features and redundant features respectively. Simulatios demonstrate that the proposed feature selection algorithms can effectively reduce feature dimension, and improve the accuracy.

Key words: feature selection, relevance, redundancy, Pearson correlation coefficient, prediction