Par@Graph-a parallel toolbox for the construction and analysis of large complex climate networks

Ihshaish, H.; Tantet, A.; Dijkzeul, J. C. M.; Dijkstra, H. A.

Abstract

© 2015 Author(s). In this paper, we present Par@Graph, a software toolbox to reconstruct and analyze complex climate networks having a large number of nodes (up to at least 106) and edges (up to at least 1012). The key innovation is an efficient set of parallel software tools designed to leverage the inherited hybrid parallelism in distributed-memory clusters of multi-core machines. The performance of the toolbox is illustrated through networks derived from sea surface height (SSH) data of a global high-resolution ocean model. Less than 8 min are needed on 90 Intel Xeon E5-4650 processors to reconstruct a climate network including the preprocessing and the correlation of 3 × 105 SSH time series, resulting in a weighted graph with the same number of vertices and about 3.2 × 108 edges. In less than 14 min on 30 processors, the resulted graph's degree centrality, strength, connected components, eigenvector centrality, entropy and clustering coefficient metrics were obtained. These results indicate that a complete cycle to construct and analyze a large-scale climate network is available under 22 min Par@Graph therefore facilitates the application of climate network analysis on high-resolution observations and model results, by enabling fast network reconstruct from the calculation of statistical similarities between climate time series. It also enables network analysis at unprecedented scales on a variety of different sizes of input data sets.

Citation

Ihshaish, H., Tantet, A., Dijkzeul, J. C. M., & Dijkstra, H. A. (2015). Par@Graph-a parallel toolbox for the construction and analysis of large complex climate networks. Geoscientific Model Development, 8(10), 3321-3331. https://doi.org/10.5194/gmd-8-3321-2015

• Journal Article Type: Article
• Acceptance Date: Jul 25, 2015
• Online Publication Date: Oct 22, 2015
• Publication Date: Oct 22, 2015
• Deposit Date: Oct 28, 2015
• Publicly Available Date: Sep 6, 2016
• Journal: Geoscientific Model Development
• Print ISSN: 1991-959X
• Electronic ISSN: 1991-9603
• Publisher: European Geosciences Union
• Peer Reviewed: Peer Reviewed
• Volume: 8
• Issue: 10
• Pages: 3321-3331
• DOI: https://doi.org/10.5194/gmd-8-3321-2015
• Keywords: complex networks, parallel algorithms, scientific computing, climate dynamics, supercomputing
• Public URL: https://uwe-repository.worktribe.com/output/842545
• Publisher URL: http://dx.doi.org/10.5194/gmd-8-3321-2015