** Progress in Earth and Planetary Science is the official journal of the Japan Geoscience Union, published in collaboration with its 50 society members.

    >>Japan Geoscience Union

    >>Links to 50 society members

    • Progress in Earth and Planetary Science
    • Progress in Earth and Planetary Science
    • Progress in Earth and Planetary Science
    • Progress in Earth and Planetary Science
    • Progress in Earth and Planetary Science
    Progress in Earth and Planetary Science

    Gallery View of PEPS Articles

    Methodology

    Interdisciplinary research

    202002202002

    Development of a system for efficient content-based retrieval to analyze large volumes of climate data

    Nakagawa Y, Onoue Y, Kawahara S, Araki F, Koyamada K, Matsuoka D, Ishikawa Y, Fujita M, Sugimoto S, Okada Y, Kawazoe S, Watanabe S, Ishii M, Mizuta R, Murata A, Kawase H

    Climate data, Relational database, Web application

    Schematic of the expected advantages of using SEAL. The elapsed times shown in the diagram are actual measured values for the +4K future climate simulations based on download speed from DIAS to JAMSTEC (4-120 Mbps).

    Analyses of large ensemble data on future climate are significantly useful for the probabilistic future projection of climate change in various interdisciplinary fields. However, the data volume of the Database for Policy Decision making for Future climate change or d4PDF, which is a mega-ensemble dataset, exceeds  3 PB, which is too large to download to local computers. To allow users for retrieve and downloading necessary data, we developed a user-friendly system called “System for Efficient content-based retrieval to Analyze Large volume climate data” (SEAL) under the Social Implementation Program on Climate Change Adaptation Technology (SI-CAT). Conventional web-based retrieval systems allow retrievals using metadata associated with a data file itself. In contrast, SEAL allows the users to retrieve the necessary data by using metadata associated with contents, such as physical values, of a data file. We confirmed that SEAL can reduce data sizes and total time required for obtaining necessary data to less than 0.5% and 1%, respectively, compared to conventional web-based retrieval systems.