On the selection of dimension reduction techniques for scientific applications

Fan, Y J ; Kamath, C

关键词: DIMENSIONS;    EVALUATION;    PERFORMANCE;   

DOI  :  10.2172/1036865
RP-ID  :  LLNL-TR-531131
PID  :  OSTI ID: 1036865
Others  :  TRN: US201207%%45

学科分类：数学（综合）

美国|英语

来源: SciTech Connect

【 摘 要 】

Many dimension reduction methods have been proposed to discover the intrinsic, lower dimensional structure of a high-dimensional dataset. However, determining critical features in datasets that consist of a large number of features is still a challenge. In this paper, through a series of carefully designed experiments on real-world datasets, we investigate the performance of different dimension reduction techniques, ranging from feature subset selection to methods that transform the features into a lower dimensional space. We also discuss methods that calculate the intrinsic dimensionality of a dataset in order to understand the reduced dimension. Using several evaluation strategies, we show how these different methods can provide useful insights into the data. These comparisons enable us to provide guidance to a user on the selection of a technique for their dataset.