Redundancy Removing Aggregation Network with Distance Calibration for Video Face Recognition

Thumbnail Image

Access rights

openAccess
acceptedVersion

URL

Journal Title

Journal ISSN

Volume Title

A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
This publication is imported from Aalto University research portal.
View publication in the Research portal (opens in new window)
View/Open full text file from the Research portal (opens in new window)

Authors

Date

2021-05-01

Department

Department of Communications and Networking

Major/Subject

Mcode

Degree programme

Language

en

Pages

9

Series

IEEE Internet of Things Journal, Volume 8, issue 9, pp. 7279-7287

Abstract

Attention-based techniques have been successfully used for rating image quality, and have been widely employed for set-based face recognition. Nevertheless, for video face recognition, where the base convolutional neural network (CNN) trained on large-scale data already provides discriminative features, fusing features with only predicted quality scores to generate representation are likely to cause duplicate sample dominant problem, and degrade performance correspondingly. To resolve the problem mentioned above, we propose a redundancy removing aggregation network (RRAN) for video face recognition. Compared with other quality-aware aggregation schemes, RRAN can take advantage of similarity information to tackle the noise introduced by redundant video frames. By leveraging metric learning, RRAN introduces a distance calibration scheme to align distance distributions of negative pairs of different video representations, which improves the accuracy under a uniform threshold. A series of experiments is conducted on multiple realistic data sets to evaluate the performance of RRAN, including YouTube Faces, IJB-A, and IJB-C. In comprehensive experiments, we demonstrate that our method can diminish the overall influence of poor quality components with large proportion in the video and further improve the overall recognition performance with individual difference. Specifically, RRAN achieves a 96.84% accuracy on YouTube Face, outperforming all existing aggregation schemes.

Description

Keywords

Aggregates, Calibration, Computer architecture, Convolutional Neural Networks, Face recognition, Feature Aggregation, Feature extraction, Metric Learning, Redundancy, Training, Video-based Face Recognition.

Other note

DOI

10.1109/JIOT.2020.3038776

Citation

Ou, Z, Hu, Y, Song, M, Yan, Z & Pan, H 2021, 'Redundancy Removing Aggregation Network with Distance Calibration for Video Face Recognition', IEEE Internet of Things Journal, vol. 8, no. 9, pp. 7279-7287. https://doi.org/10.1109/JIOT.2020.3038776

Permanent link to this item

https://urn.fi/URN:NBN:fi:aalto-202103312772

Collections

[article-cris] Sähkötekniikan korkeakoulu / ELEC