FN Archimer Export Format
PT C
TI The Pangeo Big Data Ecosystem and its use at CNES
BT 
AF Eynard-Bontemps, Guillaume
   Abernathey, Ryan
   Hamman, Joseph
   PONTE, Aurelien
   Rath, Willi
AS 1:1;2:2;3:3;4:4;5:5;
FF 1:;2:;3:;4:PDG-ODE-LOPS-OH;5:;
C1 Centre National d’Etudes Spatiales (CNES), Toulouse, France
   Columbia University / Lamont Doherty Earth Observatory, New-York, USA
   National Center for Atmospheric Research (NCAR), Boulder, USA
   Ifremer, Univ. Brest, CNRS, IRD, Laboratoire dOcanographie Physique et Spatiale (LOPS), IUEM, Brest 29280, France
   GEOMAR Helmholtz Centre for Ocean Research Kiel, Kiel, Germany
C2 CNES, FRANCE
   UNIV COLUMBIA, USA
   NCAR, USA
   IFREMER, FRANCE
   GEOMAR HELMHOLTZ CTR OCEAN RES, GERMANY
SI BREST
SE PDG-ODE-LOPS-OH
UM LOPS
UR https://archimer.ifremer.fr/doc/00503/61441/65160.pdf
LA English
DT Proceedings paper
DE ;Pangeo;Dask;Jupyter;HPC;Cloud;Big Data;Analysis;Open Source
AB Pangeo[1] is a community-driven effort for open-source big data initially focused on the Earth System Sciences. One of its primary goals is to enable scientists in analyzing petascale datasets both on classical high-performance computing (HPC) and on public cloud infrastructure. In only a few years, Pangeo has grown into a very productive community collaborating on the development of open-source analysis tools for science. It provides a set of example deployments based on open-source Scientific Python packages like Jupyter[2], Dask[3], and Xarray[4] that bring together scientists and developer with their actual use-cases. In this paper, we first describe Pangeo ecosystem and community. We then present its impact on the work of scientists from CNES on the HPC deployment there. We conclude with a future outlook for Pangeo in this agency and beyond. 
PY 2019
CT P. Soille, S. Loekken, and S. Albani (Eds.) Proc. of the 2019 conference on Big Data from Space (BiDS’2019), EUR 29660 EN, Publications Office of the European Union, Luxembourg, 2019, ISBN 978-92-76-00034-1 , doi:10.2760/848593, 2019. Part. Interactive Processing and Visualisation, pp.49-52
ID 61441
ER

EF