數學系 Seminar 第 2064期
報告主題：Smoothing fast iterative hard thresholding algorithm for L0 regularized nonsmooth convex regression problem
報 告 人：邊偉 教授 （哈爾濱工業大學）
邀 請 人：徐姿
報告摘要： We first investigate a class of constrained sparse regression problem with cardinality penalty, where the feasible set is box constraint, and the loss function is convex, not differentiable. We put forward a smoothing fast iterative hard thresholding (SFIHT) algorithm for solving such optimization problems, which combines smoothing approximations, extrapolation techniques and iterative hard thresholding methods. The extrapolation coefficients satisfy in the proposed algorithm. We establish that any accumulated point of the iterative sequence is a local minimizer of the original cardinality penalty problem. We then consider that the case where the loss function is differentiable. We propose the fast iterative hard thresholding (FIHT) algorithm to solve such problems. We prove that the iterates converges to a local minimizer with lower bound property of the problem. In particular, we show that the convergence rate of the corresponding objective function value sequence is . Finally, we perform some numerical examples to illustrate the theoretical results.