Change-point analysis in predictive relationships

Thumbnail Image

Files

isbn9789526082721.pdf (5.17 MB)

URL

Journal Title

Journal ISSN

Volume Title

School of Business | Doctoral thesis (article-based)
Unless otherwise stated, all rights belong to the author. You may download, display and print this publication for Your own personal use. Commercial use is prohibited.

Authors

Date

2018

Department

Tieto ja palvelujohtamisen laitos
Department of Information and Service Management

Major/Subject

Mcode

Degree programme

Language

en

Pages

37 + app. 96

Series

Aalto University publication series DOCTORAL DISSERTATIONS, 214/2018

Abstract

Data is the foundation of the Information Age. Knowing how to perform proper data analysis is essential and unavoidable for most companies today because it gives meaning to meaningless numbers and shows the hidden insights of information behaviour. From this perspective, change-point analysis is one of the most interesting and crucial fields, as it studies change detection in data structures and the way these changes affect underlying relationships. Change-point analysis has a considerably long history. However, the biggest part of the proposed techniques in this field are designed with a number of model restrictions, which significantly reduces the number of possible applications. In this Dissertation, we aim to study and develop robust approaches to solve the change detection problem in high-dimensional predictive structures. In Essay I, we develop a technique that allows to estimate the unknown number of changes in large datasets under normality assumptions. The proposed approach, called PSA (Parametric Splitting Algorithm), appears to be considerably accurate and efficient. In Essay II,we study a way to extend the PSA method to nonparametric settings and test it with different artificial datasets. We describe this extension as the new algorithm NSA (Nonparametric Splitting Algorithm), which solves the change detection problem in a robust manner. In Essay III, we continue considering the same problem and present the new method NDP (Nonparametric Dynamic Programming) along with the proofs of its consistency. We test NDP against NSA and other baselines and conclude that, although NDP has a higher accuracy, NSA is still more preferred due to its computational efficiency. Finally, we apply NSA to news analytics to study the financial crisis of 2006–2009. Taken all together, the Essays in this Dissertation present the continuous development of the ideas towards finding a robust solution for structural changepoint detection problems in predictive relationships

Description

Supervising professor

Malo, Pekka, Asst. Prof., Aalto University, Department of Information and Service Economy, Finland

Thesis advisor

Ilmonen, Pauliina, Asst. Prof., Aalto University, Department of Mathematics and Systems Analysis, Finland

Keywords

data analysis, structural change, time-series, predictive relationships, quantitative methods

Other note

Parts

  • [Publication 1]: Olga Gorskikh. Splitting Algorithm for Detecting Structural Changes in Predictive Relationships. In ICDM, Advances in Data Mining. Applications and Theoretical Aspects, 2016, New York, pp. 405-419,
    DOI: 10.1007/978-3-319-41561-1_30 View at publisher
  • [Publication 2]: Olga Gorskikh, Pekka Malo, Pauliina Ilmonen. Nonparametric Splitting Algorithm for Detecting Structural Changes in Predictive Relationships. In ICCDA 2017, Lakeland, FL, USA, pp. 143-149,
    DOI: 10.1145/3093241.3093282 View at publisher
  • [Publication 3]: Pekka Malo, Lauri Vitasaari, Olga Gorskikh, Pauliina Ilmonen. Non-parametric Structural Change Detection in Multivariate Systems. Submitted to Journal of the American Statistical Association , May 2018.

Citation

Permanent link to this item

https://urn.fi/URN:ISBN:978-952-60-8272-1

Collections

[diss] Kauppakorkeakoulu / BIZ