Sensors and AI Techniques for Situational Awareness in Autonomous Ships: A Review

Loading...
Thumbnail Image
Access rights
openAccess
Journal Title
Journal ISSN
Volume Title
A1 Alkuperäisartikkeli tieteellisessä aikakauslehdessä
Date
2022-01-01
Major/Subject
Mcode
Degree programme
Language
en
Pages
20
64-83
Series
IEEE Transactions on Intelligent Transportation Systems, Volume 23, issue 1
Abstract
Autonomous ships are expected to improve the level of safety and efficiency in future maritime navigation. Such vessels need perception for two purposes: to perform autonomous situational awareness and to monitor the integrity of the sensor system itself. In order to meet these needs, the perception system must fuse data from novel and traditional perception sensors using Artificial Intelligence (AI) techniques. This article overviews the recognized operational requirements that are imposed on regular and autonomous seafaring vessels, and then proceeds to consider suitable sensors and relevant AI techniques for an operational sensor system. The integration of four sensors families is considered: sensors for precise absolute positioning (Global Navigation Satellite System (GNSS) receivers and Inertial Measurement Unit (IMU)), visual sensors (monocular and stereo cameras), audio sensors (microphones), and sensors for remote-sensing (RADAR and LiDAR). Additionally, sources of auxiliary data, such as Automatic Identification System (AIS) and external data archives are discussed. The perception tasks are related to well-defined problems, such as situational abnormality detection, vessel classification, and localization, that are solvable using AI techniques. Machine learning methods, such as deep learning and Gaussian processes, are identified to be especially relevant for these problems. The different sensors and AI techniques are characterized keeping in view the operational requirements, and some example state-of-the-art options are compared based on accuracy, complexity, required resources, compatibility and adaptability to maritime environment, and especially towards practical realization of autonomous systems.
Description
Publisher Copyright: © 2000-2011 IEEE.
Keywords
camera, GNSS, LiDAR, machine learning, maritime, microphone, Positioning, RADAR, sensor fusion
Other note
Citation
Thombre, S, Zhao, Z, Ramm-Schmidt, H, Vallet Garcia, J M, Malkamäki, T, Nikolskiy, S, Hammarberg, T, Nuortie, H, Bhuiyan, M Z H, Särkkä, S & Lehtola, V V 2022, ' Sensors and AI Techniques for Situational Awareness in Autonomous Ships : A Review ', IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 1, pp. 64-83 . https://doi.org/10.1109/TITS.2020.3023957