Logos LIMSI & FAST

Séminaire de Mécanique d'Orsay

Le Jeudi 13 décembre 2018 à 14h00 - Salle de conférences du LIMSI

Hydrodynamic data storage using wavelet compression

Dmitry Kolomenskiy
Japan Agency for Marine-Earth Science and Technology

High-performance computing can produce large volumes of output data. A computational fluid dynamics simulation using several hundred or thousands of processor cores would allocate three-dimensional fields of many Gigabytes per hydrodynamic variable. Even though data reduction may be performed during the course of computation in order to only store the quantities of interest including hydrodynamic forces, etc., it is often necessary to store full three-dimensional fields for purposes such as simulation restart, time-resolved flow visualization or exploratory analyses. In this talk, I will present a wavelet-based method for compression of fluid flow simulation data. It is inspired by image compression, and it consists of discrete wavelet transform, quantization adapted for floating-point data, and entropy coding. I will discuss different aspects of these numerical methods, open-source software implementation and show example numerical tests, ranging from idealized configurations to realistic global weather simulation data.

Accès Salle de conférences du LIMSI