Predicting environmental features by learning spatiotemporal embeddings from social media

Jeawak, Shelan S.; Jones, Christopher B.; Schockaert, Steven

Abstract

Spatiotemporal modelling is an important task for ecology. Social media tags have been found to have great potential to assist in predicting aspects of the natural environment, particularly through the use of machine learning methods. Here we propose a novel spatiotemporal embeddings model, called SPATE, which is able to integrate textual information from the photo-sharing platform Flickr and structured scientific information from more traditional environmental data sources. The proposed model can be used for modelling and predicting a wide variety of ecological features such as species distribution, as well as related phenomena such as climate features. We first propose a new method based on spatiotemporal kernel density estimation to handle the sparsity of Flickr tag distributions over space and time. Then, we efficiently integrate the spatially and temporally smoothed Flickr tags with the structured scientific data into low-dimensional vector space representations. We experimentally show that our model is able to substantially outperform baselines that rely only on Flickr or only on traditional sources.

• Journal Article Type: Article
• Acceptance Date: Nov 4, 2019
• Online Publication Date: Nov 8, 2019
• Publication Date: Jan 1, 2020
• Deposit Date: Jun 5, 2020
• Journal: Ecological Informatics
• Print ISSN: 1574-9541
• Publisher: Elsevier
• Peer Reviewed: Peer Reviewed
• Volume: 55
• Article Number: 101031
• DOI: https://doi.org/10.1016/j.ecoinf.2019.101031
• Keywords: Ecological Modelling; Ecology; Modelling and Simulation; Computational Theory and Mathematics; Applied Mathematics; Ecology, Evolution, Behavior and Systematics; Computer Science Applications; Social media; Flickr; Text mining; Vector space embeddings; Spatiotemporal data
• Public URL: https://uwe-repository.worktribe.com/output/5986225
• Related Public URLs: http://orca.cf.ac.uk/127431/
• Additional Information: This article is maintained by: Elsevier; Article Title: Predicting environmental features by learning spatiotemporal embeddings from social media; Journal Title: Ecological Informatics; CrossRef DOI link to publisher maintained version: https://doi.org/10.1016/j.ecoinf.2019.101031; Content Type: article; Copyright: © 2019 Elsevier B.V. All rights reserved.