Improving Cross-Subject Activity Recognition via Adversarial Learning

dc.contributorAalto-yliopistofi
dc.contributorAalto Universityen
dc.contributor.authorSouza Leite, Clayton
dc.contributor.authorXiao, Yu
dc.contributor.departmentDepartment of Communications and Networking
dc.date.accessioned2020-06-25T08:40:38Z
dc.date.available2020-06-25T08:40:38Z
dc.date.issued2020-05-11
dc.description| openaire: EC/H2020/777222/EU//ATTRACT
dc.description.abstractDeep learning has been widely used for implementing human activity recognition from wearable sensors like inertial measurement units. The performance of deep activity recognition is heavily affected by the amount and variability of the labeled data available for training the deep learning models. On the other hand, it is costly and time-consuming to collect and label data. Given limited training data, it is hard to maintain high performance across a wide range of subjects, due to the differences in the underlying data distribution of the training and the testing sets. In this work, we develop a novel solution that applies adversarial learning to improve cross-subject performance by generating training data that mimic artificial subjects - i.e. through data augmentation - and enforcing the activity classifier to ignore subject-dependent information. Contrary to domain adaptation methods, our solution does not utilize any data from subjects of the test set (or target domain). Furthermore, our solution is versatile as it can be utilized together with any deep neural network as the classifier. Considering the open dataset PAMAP2, nearly 10% higher cross-subject performance in terms of F1-score can be achieved when training a CNN-LSTM-based classifier with our solution. A performance gain of 5% is also observed when our solution is applied to a state-of-the-art HAR classifier composed of a combination of inception neural network and recurrent neural network. We also investigate different influencing factors of classification performance (i.e. selection of sensor modalities, sampling rates and the number of subjects in the training data), and summarize a practical guideline for implementing deep learning solutions for sensor-based human activity recognition.en
dc.description.versionPeer revieweden
dc.format.extent13
dc.format.extent90542-90554
dc.format.mimetypeapplication/pdf
dc.identifier.citationSouza Leite , C & Xiao , Y 2020 , ' Improving Cross-Subject Activity Recognition via Adversarial Learning ' , IEEE Access , vol. 8 , 9091200 , pp. 90542-90554 . https://doi.org/10.1109/ACCESS.2020.2993818en
dc.identifier.doi10.1109/ACCESS.2020.2993818
dc.identifier.issn2169-3536
dc.identifier.otherPURE UUID: 9b0282e2-c071-48ee-9d1c-b701118273ef
dc.identifier.otherPURE ITEMURL: https://research.aalto.fi/en/publications/9b0282e2-c071-48ee-9d1c-b701118273ef
dc.identifier.otherPURE LINK: http://www.scopus.com/inward/record.url?scp=85085573859&partnerID=8YFLogxK
dc.identifier.otherPURE FILEURL: https://research.aalto.fi/files/43528914/Leite_Improving_cross_subject_IEEEAccess.pdf
dc.identifier.urihttps://aaltodoc.aalto.fi/handle/123456789/45177
dc.identifier.urnURN:NBN:fi:aalto-202006254134
dc.language.isoenen
dc.publisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
dc.relationinfo:eu-repo/grantAgreement/EC/H2020/777222/EU//ATTRACT
dc.relation.ispartofseriesIEEE Accessen
dc.relation.ispartofseriesVolume 8en
dc.rightsopenAccessen
dc.subject.keywordHuman activity recognition
dc.subject.keyworddeep learning
dc.subject.keywordadversarial learning
dc.subject.keyworddata augmentation
dc.subject.keywordcross-subject performance
dc.titleImproving Cross-Subject Activity Recognition via Adversarial Learningen
dc.typeA1 Alkuperäisartikkeli tieteellisessä aikakauslehdessäfi
dc.type.versionpublishedVersion
Files