Index
NSHM System Architecture¶
This section describes the info technology supporting the wider NSHM team and the public-facing web applications. This infrastructure is developed and maintained by the NZSHM Compute Working Group (CWG) team of three.
Table of contents¶
In this section you will find :
- Core technology describes the main technologies used in NSHM.
- Applications section covers the Web apps (2) and specialised analysis tools for scientists and engineers.
- Web APIs covers the NSHM service layers and service APIs.
- Libraries covers the various python libraries developed for NSHM.
- [ ] Cloud Services
- [ ] Data Management
- [ ] Compute Abstraction
NSHM system guiding tenets¶
- Make our work public at https://github.com/GNS-Science.
- capture all the things(TM) and make them accessible.
- minimise fixed overhead, using cloud & serverless technology.
- keep options open for compute intensive tasks (local, HPC, cloud).
Background reading¶
The team has produced some papers and presentations about this work, covering, high level goals, teeam setup, technical challenges and architecture. Rather than repeat all that we're including the PDF document you can peruse.
Here's a brief summary of some of these:
NZ eResearch Presentation, January 2024¶
The Chris's (DiCaprio and Chamberlain) presented an overview of the teams work for the NSHM. This covers the teams purpose, the technical vision and then describes the particular technical challenges and key technology choices made to meet these. It features a great deal of the software and solutions in this documentation.
eRangahau/eResearch 2024 slides in PDF format
NSHM Workshop 21 05 2024 - Toshi Hazard Post etc¶
Re-engineering the Hazard Calculation: toshi-hazard-post & toshi-hazard-store v2.
The Chris's (DiCaprio and Chamberlain) presented on how Hazard processing and Hazard storage has evolved and changed. An introduction to the new Pyarrow dataset format with pros/cons vs earlier data formats.