Identifying Research Gap and Opportunities in the use of Multimodal Deep Learning for Emergency Management (2019)
Type of ContentConference Contributions - Other
- QuakeCoRE: Posters 
With the proliferation of smart mobile devices, people are now increasingly using social media applications during disasters to share updates, check on loved ones, or inform officials. Additionally, there are many other sources such as remote sensing, CCTV monitoring, wireless sensor networks and mobile GPS which provide disaster-related data. As a result, an overwhelming amount of data is generated in different modalities (text, audio, video and images) during a crisis. However, extracting, analysing and interpreting a huge variety of multimodal data within a short period of time is a major challenge faced by emergency responders. Therefore, decisions still mostly depend on text-based reports prepared by field officers.
In order to better understand the problem, to make more informed decisions and to have well-coordinated responses, it is necessary to process multiple modalities of data. As Multimodal Deep Learning (MMDL) techniques gain popularity among Artificial Intelligence (AI) researchers, it is timely to discuss the potential of such techniques for use in emergency management. MMDL addresses the problem of relating different representations from multimodal data to each other. Applying MMDL techniques on disaster data would help decision makers by improving the accuracy of data, reducing uncertainty in decision making, and reducing the time taken to analyse data thus assisting emergency responders to understand the “big picture” clearly and support effective disaster relief. Furthermore, the community may benefit by being better prepared, stronger and more resilient during emergencies.
This work focuses on defining the research gap, opportunities and limitations of using MMDL techniques in disaster research.
RightsCC-BY 4.0 International
Showing items related by title, author, creator and subject.
Algiriyage, Nilani; Prasanna, Raj; Stock, Kristin; Hudson-Doyle, Emma; Johnston, David (2020)Emergency response has to start within seconds of the onset of a disaster. However, getting a quick understanding of the situation as it unfolds is a challenging task for responding organisations due to time-consuming and ...
Lambie, Emily; Campbell, Emily; Johnston, David; Elwood, Ken; Stephens, Max; Uma, SR; Prasanna, Raj; Becker, Julia; Rangika, Nilani; Syed, Yasir Imtiaz; Hudson-Doyle, Emma; Hopkins, John (2019)Emerging technology and data processing tools are transforming the cities we live in, and the way we live in them. Understanding the confluence of trends and evolving relationship between people, systems and data is key ...
Tan, Marion; Prasanna, Raj; Stock, Kristin; Hudson-Doyle, Emma; Leonard, Graham; Johnston, David (2017)Background The general public has access to a plethora of ‘disaster apps’ through App Markets like iTunes and Google Play. However, limited research has studied these ‘disaster apps’ and how the public perceives their ...