Structure Preserving Unsupervised Feature Selection Based on Autoencoder and Manifold Regularization

Jisuanji kexue

YANG Lei, JIANG Ai-lian, QIANG Yan¹ 

[1] College of Information and Computer,Taiyuan University of Technology,Jinzhong,Shanxi 030600,China;

关键词: feature selection|subspace learning|manifold regularization|structure preservation|autoencoder;   

DOI  :  10.11896/jsjkx.200700211

来源: DOAJ

【 摘 要 】

There are a lot of redundant and irrelevant features in high-dimensional data,which seriously affect the efficiency and quality of data mining and the generalization performance of machine learning.Therefore,feature selection has become an important research direction in the computer field.In this paper,an unsupervised feature selection algorithm is proposed by using the non-linear learning ability of the autoencoder.First,based on the reconstruction error of the autoencoder,a single feature is selec-ted which is important for data reconstruction.Second,the feature weights finally select the feature subsets that contribute greatly to the reconstruction of other features.Manifold learning is introduced to capture the local and non-local structure of the original data space,and L2/1 sparse regularization is added to the feature weights to improve the sparsity of the feature weights so that they can select more distinctive features.Finally,a new objective function is constructed,and a gradient descent algorithm is used to optimize the proposed objective function.Experiments on six different types of typical data sets,and the proposed algorithm is compared with five commonly used unsupervised feature selection algorithms.Experiment results verify that the proposed algorithm can effectively select important features,significantly improve the classification accuracy rate and clustering accuracy rate.

【 授权许可】

Unknown