Variable selection plays a significant role in statistics. There are many variable selection methods. Forward stagewise regression takes a different approach among those. In this thesis Least Angle Regression (LAR) is discussed in detail. This approach has similar principles as forward stagewise regression but does not suffer from its computational difficulties. By using a small artificial data set and the well-known Longley data set, the LAR algorithm is illustrated in detail and the coefficient profiles are obtained. Furthermore a penalized approach to variable reduction called the LASSO is discussed, and it is shown how to compute its coefficient profiles efficiently using the LAR algorithm with a small modification. Finally, a method called K-fold cross validation used to select the constraint parameter for the LASSO is presented and illustrated with the Longley data.
【 预 览 】
附件列表
Files
Size
Format
View
Computation of Least Angle Regression coefficient profiles and LASSO estimates.