Bayesian sparse linear regression with unknown symmetric error

Abstract

We study Bayesian procedures for sparse linear regression when the unknown error distribution is endowed with a non-parametric prior. Specifically, we put a symmetrized Dirichlet process mixture of Gaussian prior on the error density, where the mixing distributions are compactly supported. For the prior on regression coefficients, a mixture of point masses at zero and continuous distributions is considered. Under the assumption that the model is well specified, we study behavior of the posterior with diverging number of predictors. The compatibility and restricted eigenvalue conditions yield the minimax convergence rate of the regression coefficients in $\ell _1$- and $\ell _2$-norms, respectively. In addition, strong model selection consistency and a semi-parametric Bernstein–von Mises theorem are proven under slightly stronger conditions.

Document Details

Document Type
Pub Defense Publication
Publication Date
Jan 09, 2019
Source ID
10.1093/imaiai/iay022

Entities

People

  • David B. Dunson
  • Lizhen Lin
  • Minwoo Chae

Organizations

  • Army Research Office
  • Case Western Reserve University
  • Duke University
  • National Science Foundation
  • Office of Naval Research
  • University of Notre Dame

Tags

Fields of Study

  • Mathematics

Readers

  • Approximation Theory.
  • Operations Research
  • Regression Analysis.

Technology Areas

  • AI & ML
  • AI & ML - Bayesian Inference
  • AI & ML - Machine Learning Algorithms