Robust Test for Batch-to-batch Variable Selection
Date Issued
2004
Date
2004
Author(s)
Lin, Chia-Lung
DOI
en-US
Abstract
When the variable selection is used in regression, the selection reliability is greatly affected by the number of candidate variables as compared to the sample size. However, very often we could only collect limited data for analysis, while there are a large number of possible independent variables. In the forward selection procedure, problems arise when the sample size n is very smaller than the number of variables p. Under the conventional F-test selecting criterion, noise variables are often mistakenly selected if the sample size is relatively small or the number of candidate variables is relatively large. The number of selected variables is also limited by the sample size. A new test statistic, named MaxF with a known null distribution will be proposed in this study. The test statistic can improve the reliability of the forward selection procedure and can be numerically calculated. Based on the new criteria, an extended selection procedure is developed to overcome the limitation of sample size and to continuously select significant variables into different batches. After batch-to-batch selection, we propose dependency analysis methodologies to figure out the inter-relationships among batches of selected variables. The proposed test statistic is examined by simulated data under various scenarios with different sample size and number of candidate variables. The dependency analysis methodologies will handle more complex simulation cases. The approach is also demonstrated and tested through a semiconductor yield data and gene express cases.
Subjects
批次變數選取
MaxF test Batch-to-batch Selection
Type
thesis
File(s)![Thumbnail Image]()
Loading...
Name
ntu-93-R91546022-1.pdf
Size
23.53 KB
Format
Adobe PDF
Checksum
(MD5):e354d530e25490351433e7dbe6955bdb