2019 Household Survey

Purpose: To automate the data cleaning process, minimize the data quality human errors and save staff time.

**code source: **

https://github.com/psrc/travel-studies/tree/master/survey_data_cleaning https://github.com/psrc/data-science/tree/master/HHSurvey

Phase 1: Online survey data cleaning

Rulesy: A SQL script queries trip logic. The input for the script would be raw online survey data. The output from the script would clean survey trips, and error flagged trips. The error flagged trip table will directly feed to tools.

Toolsie: A visualization platform everybody can use to understand trip logic. The input for the dashboard would be error flagged trip table from Rulesy, along with the person and household information. Toolsie dashboard helps the team visualize trip strings on the interactive map, as well as providing trip, person, household information in a more efficient and pleasant vision than excel tables.

**May 2nd meeting memo: ** To serve a purpose to visualize single trip on by one, Angela update Toolsie to be a simple dashboard. The dashboard starts with the basic trip, household, person information, with an interactive map. To help Toolsie directly interpreting data from Rulesy, Angela and Micheal work together to create a list of critical columns to pull, based on error types, Neil’s experience, etc. Neil and Micheal will explore Tableau Reader.