Geo-AI to aid disaster response by memory-augmented deep reservoir computing

Demertzis, Konstantinos; Iliadis, Lazaros; Pimenidis, Elias

Abstract

It is a fact that natural disasters often cause severe damage both to ecosystems and humans. Moreover, man-made disasters can have enormous moral and economic consequences for people. A typical example is the large deadly and catastrophic explosion in Beirut on 4 August 2020, which destroyed a very large area of the city. This research paper introduces a Geo-AI disaster response computer vision system, capable to map an area using material from Synthetic Aperture Radar (SAR). SAR is a unique form of radar that can penetrate the clouds and collect data day and night under any weather conditions. Specifically, the Memory-Augmented Deep Convolutional Echo State Network (MA/DCESN) is introduced for the first time in the literature, as an advanced Machine Vision (MAV) architecture. It uses a meta-learning technique, which is based on a memory-augmented approach. The target is the employment of Deep Reservoir Computing (DRC) for domain adaptation. The developed Deep Convolutional Echo State Network (DCESN) combines a classic Convolutional Neural Network (CNN), with a Deep Echo State Network (DESN), and analog neurons with sparse random connections. Its training is performed following the Recursive Least Square (RLS) method. In addition, the integration of external memory allows the storage of useful data from past processes, while facilitating the rapid integration of new information, without the need for retraining. The proposed DCESN implements a set of original modifications regarding training setting, memory retrieval mechanisms, addressing techniques, and ways of assigning attention weights to memory vectors. As it is experimentally shown, the whole approach produces remarkable stability, high generalization efficiency and significant classification accuracy, significantly extending the state-of-the-art Machine Vision methods.

• Journal Article Type: Article
• Acceptance Date: Jun 4, 2021
• Online Publication Date: Jun 11, 2021
• Publication Date: Aug 27, 2021
• Deposit Date: Jun 18, 2021
• Publicly Available Date: Jun 18, 2021
• Journal: Integrated Computer-Aided Engineering
• Print ISSN: 1069-2509
• Publisher: IOS Press
• Peer Reviewed: Peer Reviewed
• Volume: 28
• Issue: 4
• Pages: 383-398
• DOI: https://doi.org/10.3233/ICA-210657
• Public URL: https://uwe-repository.worktribe.com/output/7477726
• Publisher URL: https://content.iospress.com/articles/integrated-computer-aided-engineering/ica210657