CCMP:面向高维特征选择的类条件多重共线性剪枝
CCMP: Class-Conditional Multicollinearity Pruning for High-Dimensional Feature Selection
Abdullah Al Bashit, Prakash Nepal, Lee Makowski
AI 速读 基于摘要
提出类条件多重共线性剪枝(CCMP),通过在每个类别内迭代剔除高度相关特征对中的一个特征,实现高维科学测量数据的特征选择,并给出剪枝误差的理论界。
eess.IV · cs.LG
查看原文摘要
In high-dimensional scientific measurements, many features in a single sample often capture the same underlying physical attributes, producing severe multicollinearity. Supervised feature selectors fit on the entire dataset, so a feature can be informative for classification overall while still redundant with another feature in the same class. Class-conditional selectors, by contrast, trade some accuracy for a narrower, per-class view, since they never see data outside one class, but this lets new classes be added without refitting the whole model. They still cannot determine, however, which feature to drop from a correlated group. To close this gap, we propose classconditional multicollinearity pruning (CCMP), which iteratively prunes one feature from every highly correlated pair, per class. Four theoretical guarantees establish explicit bounds on the error induced by pruning under stated assumptions. Across four benchmark datasets spanning spectroscopic and hyperspectral imaging modalities, CCMP retains as few as 42 of 1531 features (3%) and as many as 60 of 145 (41%), outperforms every classconditional baseline, and remains competitive with supervised methods.