Skip to content

Sprint 63

Jump to bottom
drotheram edited this page Sep 13, 2022 · 4 revisions

Started Sept 6, 2022; Due by Sept 15, 2022 (Review on Sept 15, 2022)

Sprint Goals:

RiskProfiler

  • RiskProfiler QA/QC script (Drew)

    • Integrate Lighthouse check - Drew
    • Investigate WCAG Compliance - Drew
      • NRCan has an internal resource - Joost
      • Waiting on French pages
      • Run on English Pages - Venessa Greebe to follow up with internal NRCan resources
    • Link-checker in gh-actions - riskprofiler repo - Drew/Damon
      • Follow up on link-checker dead links

  • Move riskprofiler-cms code, issues, content etc. to riskprofiler (Anthony) > Hard deadline before October release

  • Review remaining translations (Drew, Joost, Phil, Will, Julie) - in progress

  • Fully automate riskprofiler static website generation in Docker WordPress instance (Anthony)

  • Close out Critical RiskProfiler Issues/Bugs (Drew, Anthony, Phil E.)

  • Add 6 additional DSRA Scenario Pages (Phil E. Drew, Anthony, Damon)

    • ES Indices Available (Drew)
    • Vector Tiles available (Damon)
    • Updated RiskProfiler Codebase/Database (Phil E.)
    • New beta RiskProfiler Deployment (Anthony)

GitHub

  • New Private earthquake-scenarios-private repo for 6 new DSRA scenarios
    • port existing github actions (Damon)
    • re-organize earthquake-scenarios-2022-jrimando-google-drive file structure to match earthquake-scenarios (Damon)
    • create PR workflow to bring scenarios into public earthquake-scenarios repo (Anthony)
    • investigate impacts of reorganizing earthquake scenarios directories (Damon, Anthony, Tiegan, Drew)

ElasticSearch - Kibana - PostGIS

  • v1.4.4 updates (Will) - To be pushed after RiskProfiler Launch

    • EPSG:3857 hexgrids

  • Document Required data sets for version/subversion release (Drew)

  • Test AWS CLI script to build opendrr-api docker-compose build and dump db to S3 bucket (Anthony/Drew) - backlog Blocked technical bugs

  • Contract for pygeoapi versioning (Drew/Joost) > backlog

  • Break up add_data.sh (#214)

    • Determine persistent storage of pre-PSRA/DSRA db dump (Anthony/Drew/Will)
      • pre-PSRA/DSRA version on S3
      • 2 Gb versioned release assets chunks
    • Consider splitting db dump by schema
    • break up into PSRA-DSRA dependencies and actual PSRA/DSRA processing
    • add config parameters for processing PSRA(true/false) and DSRA(named scenarios)

  • DSRA Dashboards in Kibana (Drew, Damon)

    • DFC examples in code for direct data access via PyGeoAPI - wiki or python notebook
    • DSRA dashboards for 6 new scenarios - backlog

Data Dissemination

  • Publish FGP records (Joost) - waiting on Charles FGP blocking

    • Send revised data files and MXD's to FGP (Will, Phil)
      • Physical Exposure - To be released alongside social fabric
      • Social Fabric - Will sent on Feb 11
      • PSRA - waiting on changes to seismic risk index > sprint 64
      • DSRA 1KM, 5KM, 25KM - DG signoff pending
    • Review revised FGP data layers (Murray, Phil, Tiegan, Joost, Will)
      • Physical Exposure
      • Social Fabric - Waiting on release of supporting publication
      • PSRA - waiting on changes to seismic risk index > sprint 64
      • DSRA
    • Prep legend files (MXD's) for FGP data See issue
      • Physical Exposure
      • Social Fabric
      • PSRA - French language legends in progress > sprint 64
      • DSRA (Carol)
    • Update API endpoints to prod in FGP metadata - To be released in October - Joost

  • GPKG generation via GitHub Actions for release assets opendrr-api (Damon, Anthony) > Blocked

    • Blocked by diskspace limits on GitHub Actions - Stack need to be optimized for disk usage - Blocked
    • might be able to unblock with changes to add_data.sh - using db dump instead of building from scratch

  • Generate layer tiles (Joost, Damon, Anthony) - Done with SAUID, all but one CSD done, will work on hex grid layers next.

    • List of v1.4.3 vector tiles:

      • Document vector tile generation workflow with comprehensive list of source data (Damon/Anthony/Joost)
      • PSRA aggregations Sauid/CSD hexgrid (at all resolutions) - CSD agg blocked by disk space limitations, need to run on EC2
      • 900913 priority (4326 if time remaining)

    • Automate vector tiles for DSRA scenarios (Possible for 3857, Investigating if possible for 900913 & 4326 (Damon, Anthony)
      * document and report bug to GDAL

    • Automate vector tile backup on GitHub and serve the vector tiles on GitHub Pages (10GB limit) (Anthony)

    • Create 3857 Hexgrid geometries (Will)

    • New Vector Tile suite for 6 new DSRA scenarios

OpenDRR Administrative

  • Security Documentation (Joost) - pending Director signoff

    • FGP CSV document

  • Use of compressed release assets to reduce Git LFS data storage and bandwidth usage (Anthony) > backlogged

  • Document Process for adding new DSRA scenario in earthquake-scenarios Wiki (Damon, Drew, Will, Anthony)

Demos:

  • add_data.sh demo - Drew
  • DRSA processing - Damon
  • Quick beta.riskproifler deploy demo - Anthony
  • v1.4.4 data versions - Will

Scrum Notes:

  • Sept 8, 2022

  • Damon

  • Working on getting new scenarios in
  • Plan: make a branch with 5 scenarios
  • Anthony
  • editing python-env dockerfile
  • working through bugs in add_data.sh refactor
  • Drew
  • broke up add_data.sh into 2 parts
  • pre-generate exposure and ancillary database and indicators
  • today, start working on faster leaner add_data.sh

  • Sept 13, 2022

  • Anthony

  • update to beta.riskprofiler.ca
  • fixed bug with 'explore scenarios'
  • updated python-env container, replaced p7zip with 7zz
  • Damon
  • earthquake scenarios repo github actions workflow
  • Will
  • working v1.4.4
  • sorting out some bugs
  • Drew
  • going through open rp issues
  • pg_dump error different version
  • finishing re-write of add_data.sh, almost ready to test

Sprint Planning | Sprint Review
Wikis: data | model-factory | opendrr-api | opendrr | python-env | riskprofiler-cms

Clone this wiki locally