Sparsity-Promoting Bootstrap Method For Large-Scale Data

No Thumbnail Available

URL

Journal Title

Journal ISSN

Volume Title

Sähkötekniikan korkeakoulu | Master's thesis
Ask about the availability of the thesis by sending email to the Aalto University Learning Centre oppimiskeskus@aalto.fi

Date

2017-12-11

Department

Major/Subject

Signal, Speech and Language Processing

Mcode

ELEC3031

Degree programme

CCIS - Master’s Programme in Computer, Communication and Information Sciences (TS2013)

Language

en

Pages

57

Series

Abstract

Performing statistical inference on massive data sets may not be computationally feasible using the conventional statistical inference methodology. In particular, there is a need for methods that are scalable to large volume and variability of data. Moreover, veracity of the inference is crucial. Hence, there is a need to produce quantitative information on the statistical correctness of parameter estimates or decisions. In this thesis, a scalable non-parametric bootstrap method that operates with smaller number of distinct data points on multiple disjoint subsets of data is proposed. The resampling approach stems from the Bag of Little Bootstraps method and is compatible with distributed storage systems and distributed and parallel processing architectures. Iterative reweighted l_1 norm minimization method is used for each bootstrap replica to find a sparse solution in the face of high-dimensional data set. The proposed method finds reliable estimates even if the problem is not overdetermined for distinct subsets of data by exploiting sparseness. The performance of the proposed method is studied in extensive simulations. It is demonstrated that method gives smaller Root MSE and significantly lower bias than bootstrap employing widely used sparse estimator Basis Pursuit DeNoising. Moreover, better performance is obtained in terms of classification error rate (CER) and recovery rate (RER) in identifying sparse parameters. Estimated confidence intervals are also highly concentrated around the true parameter values.

Description

Supervisor

Koivunen, Visa

Thesis advisor

Koivunen, Visa

Keywords

bag of little bootstraps, sparsity, reweighted 1_1 norm minimization, scalable inference, underdetermined systems, parameter estimation

Other note

Citation