An Alternating Direction Method of Multipliers for MCP-penalized Regression with High-dimensional Data

Citation
Shi, Yue Yong et al., An Alternating Direction Method of Multipliers for MCP-penalized Regression with High-dimensional Data, Acta mathematica Sinica. English series (Print) , 34(12), 2018, pp. 1892-1906
ISSN journal
14398516
Volume
34
Issue
12
Year of publication
2018
Pages
1892 - 1906
Database
ACNP
SICI code
Abstract
The minimax concave penalty (MCP) has been demonstrated theoretically and practically to be effective in nonconvex penalization for variable selection and parameter estimation. In this paper, we develop an efficient alternating direction method of multipliers (ADMM) with continuation algorithm for solving the MCP-penalized least squares problem in high dimensions. Under some mild conditions, we study the convergence properties and the Karush.Kuhn.Tucker (KKT) optimality conditions of the proposed method. A high-dimensional BIC is developed to select the optimal tuning parameters. Simulations and a real data example are presented to illustrate the efficiency and accuracy of the proposed method.