Supervised learning for relationship extraction from textual documents

Thumbnail Image

URL

Journal Title

Journal ISSN

Volume Title

School of Science | Master's thesis
Checking the digitized thesis and permission for publishing
Instructions for the author

Authors

Date

2013

Department

Perustieteiden korkeakoulu

Major/Subject

Informaatiotekniikka

Mcode

T-61

Degree programme

Language

en

Pages

(8) + 55

Series

Abstract

Information Extraction (IE) is the task of automatically extracting structured information from unstructured data, aiming to facilitate the use of said data by other applications. A typical sub-problem is the extraction of relationships from textual documents, which aims at identifying and classifying the relationships expressed between entities mentioned in the texts. In order to extract relationships from a raw text, it is important to pre-process the data, organizing the textual contents into useful data structures, with techniques from Natural Language Processing. Furthermore, since relationships are expressed between entities, it is mandatory to identify the entities using an entity extraction method, which is another sub problem of IE. Assigning a relationship type to a pair of entities can be seen as a classification problem. Therefore, supervised machine learning techniques can be applied. In this thesis, we used Support Vector Machines (SVM), which we trained with basis on online methods similar to Pegasos. Two specific modelling choices have been tested. The first one is a simple online solution that trains SVM models considering a single kernel. The second approach is based on the idea of online multiple kernel learning. With existing datasets and common pre-processing tools, we formulated a benchmark, which was then used to evaluate kernel-based methods. We then implemented state-of-the-art kernels, specifically designed for relationship extraction. The results show that a multiple kernel learning solution obtains the best performance, and that multiple kernel learning solutions can perform better than heuristic solutions learning with linear combinations of the same kernels.

Description

Supervisor

Oja, Erkki

Thesis advisor

Martins, Bruno

Keywords

relationship extraction, support vector machines, online learning, multiple kernel learning

Other note

Citation

Permanent link to this item

https://urn.fi/URN:NBN:fi:aalto-2020122859986

Collections

[dipl] Perustieteiden korkeakoulu / SCI