ESDM
Middleware for Earth System Data
|
The middleware for earth system data is a prototype to improve I/O performance for earth system simulation as used in climate and weather applications. ESDM exploits structural information exposed by workflows, applications as well as data description formats such as HDF5 and NetCDF to more efficiently organize metadata and data across a variety of storage backends.
A compiler for C99 such as GCC5.0
Ensure you cloned the repository with the required submodules:
The installation instructions for the full stack with ESDM and NetCDF can be found in the Dockerfiles that we use for testing.
$ grep RUN dev/docker/ubuntu-whole-stack/Dockerfile
$ grep RUN dev/docker/centos7-whole-stack/Dockerfile
Installation of spack itself:
First get the recent GCC:
dev
contains helpers for development purposes. For example, this project requires a development variant of HDF5 that provides the Virtual Object Layer (VOL). This and other dependencies can be installed into a development environment using the following script: ./dev/setup-development-environment.sh
src
contains the source code... To build the project call: source dev/activate-development-environment.bash ./configure --debug cd build make -jTo run the test suite call:
cd build make testYou may also choose to configure with a different hdf5 installation (see ./configure –help) e.g.:
./configure --with-hdf5=$PWD/install
doc
contains documentation which uses doxygen to build a HTML or a PDF version:For the HTML Reference use the following commands (assuming ./configure completed successfully): cd build doxygen build/doc/html/index.html For a PDF Reference (requries LaTeX) run: cd build doxygen cd /doc/latex make
tools
contains separate programs, e.g., for benchmarking HDF5. They should only be loosely coupled with the source code and allow to be used with the regular HDF5.