TY - CPAPER T1 - The Pangeo Big Data Ecosystem and its use at CNES A1 - Eynard-Bontemps,Guillaume A1 - Abernathey,Ryan A1 - Hamman,Joseph A1 - Ponte,Aurelien A1 - Rath,Willi AD - Centre National d’Etudes Spatiales (CNES), Toulouse, France AD - Columbia University / Lamont Doherty Earth Observatory, New-York, USA AD - National Center for Atmospheric Research (NCAR), Boulder, USA AD - Ifremer, Univ. Brest, CNRS, IRD, Laboratoire dOcanographie Physique et Spatiale (LOPS), IUEM, Brest 29280, France AD - GEOMAR Helmholtz Centre for Ocean Research Kiel, Kiel, Germany UR - https://archimer.ifremer.fr/doc/00503/61441/ KW - Pangeo KW - Dask KW - Jupyter KW - HPC KW - Cloud KW - Big Data KW - Analysis KW - Open Source N2 - Pangeo[1] is a community-driven effort for open-source big data initially focused on the Earth System Sciences. One of its primary goals is to enable scientists in analyzing petascale datasets both on classical high-performance computing (HPC) and on public cloud infrastructure. In only a few years, Pangeo has grown into a very productive community collaborating on the development of open-source analysis tools for science. It provides a set of example deployments based on open-source Scientific Python packages like Jupyter[2], Dask[3], and Xarray[4] that bring together scientists and developer with their actual use-cases. In this paper, we first describe Pangeo ecosystem and community. We then present its impact on the work of scientists from CNES on the HPC deployment there. We conclude with a future outlook for Pangeo in this agency and beyond. Y1 - 2019 CY - Big Data from Space (BiDS'19) .... Turning Data into insights... 19-21 fébruary 2019, Munich, Germany SO - P. Soille, S. Loekken, and S. Albani (Eds.) Proc. of the 2019 conference on Big Data from Space (BiDS’2019), EUR 29660 EN, Publications Office of the European Union, Luxembourg, 2019, ISBN 978-92-76-00034-1 , doi:10.2760/848593, 2019. Part. Interactive Processing and Visualisation, pp.49-52 ID - 61441 ER -