Skip to content
matthew-schultz edited this page Aug 27, 2019 · 8 revisions

1. What you will find here

How to set up a new lonoa project or add new sensors to an existing project.

https://github.com/erdl/lonoa/wiki/Lonoa-User-Guide

We found missing data in the IT database. Is this also missing in the data source?

This wiki is all about the question above. Here you will find documentation to check the original source for missing data, and then use the notebooks in this Github project to download them.

If you want to find out if there is data in the IT database instead, refer to the Github project monitor, where you will find Tableau workbooks to identify missing and outlier data.

Because each database contains a different schema, you will need to understand how information is organized on them before storing the missing data. See the Github project database to learn about each of them and where to store the missing data.

2. How to check/upload data

2.1 WebCtrl

2.1.1 Checking data source for data

  1. Log into WebCtrl.
  2. Click on the gear symbol (if you mouse over it will say "System Configuration") in the left-hand panel. This will take you to the My settings page.
  3. In the same panel, click on the "System Settings" option.
  4. At the very top of the screen there will be a few tabs to choose from: General, Security, Communications, Scheduled Tasks, Daylight Saving, and Add-ons. Click on the "Add-ons" tab.
  5. From the "Installed" list select "Bulk Trans Server".
  6. Under the "Details" section on this page, click on the "Main page" link (this will open another tab).
  7. On the "Trend Server" page, click on "Search for trend sources".
  8. Enter the query string path in the "Search below" box, and hit search. (If you know the purpose_id of the sensor that you want to check, you can find the matching "query_string" path in the "purpose" table.)
  9. Click on the "Lookup ID" link.
  10. Input the start and end date for the time period you want to check for data, then click on "Get Trends".
  11. If the data is missing, there is no data available for that time period for that sensor. If there is data, continue on to uploading the missing data using Python scripts (to be documented at a later time)

2.1.2 Manual Download

Can't be done manually.

2.1.3 Script Download

TO-DO

2.2 Egauge

2.2.1 Checking data source for data

  1. Retrieve the Sensor name/number for the sensor that you want to check.
  2. Log into Egauge website.
  3. Mouse over "eGaurd", and select "Portfolio".
  4. Find and click on the matching sensor name/number under the Name column.
  5. A graph will pop up showing a full day's data for the selected sensor.

2.2.2 Manual Download

At the top left of the graph there is an arrow pointed downward, click on the arrow and select the option, "Export data to spreadsheet (CSV)".

  1. Specify the date range you want to download data for, and choose an interval (eg 1 data point per minute) and click export.
  2. Open the CSV. If you see the data is on the CSV file then proceed to uploading the missing data to the database, if it's not on the file that means that there is no data available for that time period.

2.2.3 Script Download

TO-DO

2.3 HOBO

2.3.1 Checking data source for data

TO-DO

2.3.2 Manual Download

TO-DO

2.3.3 Script Download

TO-DO