Semantic and stylistic text analysis and text summary evaluation
Loading...
Journal Title
Journal ISSN
Volume Title
Perustieteiden korkeakoulu |
Master's thesis
Unless otherwise stated, all rights belong to the author. You may download, display and print this publication for Your own personal use. Commercial use is prohibited.
Author
Date
2015
Department
Major/Subject
Human Computer Interaction and Design
Mcode
HCID
Degree programme
Master's Programme in ICT Innovation
Language
en
Pages
4+42
Series
Abstract
The main contribution of this Master's thesis is a novel way of doing text comparison using word vector representations (word2vec) and dimensionality reduction (t-SNE). This yields a bird’s-eye view of different text sources, including text summaries and their source material, and enables users to explore a text source like a geographical map. The main goal of the thesis was to support the quality control and quality assurance efforts of a company. This goal was operationalized and subdivided into several modules. In this thesis, the Topic and Topic Comparison modules are described. For each module, the state of the art in natural language processing and machine learning research was investigated and applied. The implementation section of this thesis discusses what each module does, how it relates to theory, how the module is implemented, the motivation for the chosen approach and self-criticism. The thesis also describes how to derive a text quality gold standard using machine learning.Description
Supervisor
Kaski, SamuelThesis advisor
Laaksonen, JormaKeywords
text analysis, machine learning, distributional semantics, word representations, word2vec, dimensionality reduction