Library to Ingest: weekly OpenData templates

[sf-dcp]

Closes #1247. Reports for specific datasets can be found there.

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 70.00%. Comparing base (72a4932) to head (3b0b26d).
Report is 2 commits behind head on main.

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #1289      +/-   ##
==========================================
- Coverage   70.10%   70.00%   -0.10%     
==========================================
  Files         115      114       -1     
  Lines        6141     6121      -20     
  Branches      702      702              
==========================================
- Hits         4305     4285      -20     
  Misses       1690     1690              
  Partials      146      146              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[sf-dcp]

latitude & longitude columns no longer exist at the source - remove. These columns are actually not used in the build, so no impact. Added wkb_geometry bc it's actually expected.

[fvankrieken]

I'm actually very curious with dpr_parksproperties that we're still getting a timestamp for that field but losing timezone. Can you look at the raw geojson if you have it and see the format of the timestamps? Wondering if library is assuming a time zone or if ingest is missing it

[fvankrieken]

Looks largely good though, both code changes and reports. I'd like someone other than me to approve if that's alright, just think it would be good for others to see and think about the decisions/thoughts around the reports since these same types of issues will definitely keep coming up

[sf-dcp]

@damonmcc @alexrichey

[sf-dcp]

I'm actually very curious with dpr_parksproperties that we're still getting a timestamp for that field but losing timezone. Can you look at the raw geojson if you have it and see the format of the timestamps? Wondering if library is assuming a time zone or if ingest is missing it

Here is an example of how it looks in the raw gejson for both library and ingest: "acquisitiondate": "1900-09-22T00:00:00.000"

[damonmcc]

appreciate the notes in the issue on report diffs!

[sf-dcp]

@fvankrieken the weekly OpenData job ran successfully 🎉 And now I have my very own bucket