You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For the eviction settings scraper the code should rescrape jobs that return an overflow of results (200+). The scrape jobs can be split up either recursively or into 3 day scrapes (assuming that no 3 days will have more than 200 cases). The first option is the preferred solution.
The text was updated successfully, but these errors were encountered:
For the eviction settings scraper the code should rescrape jobs that return an overflow of results (200+). The scrape jobs can be split up either recursively or into 3 day scrapes (assuming that no 3 days will have more than 200 cases). The first option is the preferred solution.
After taking a look at the code, it seems as though the search is already split up into 1-day scrapes. I think it's very unlikely that any 1-day range will have over 200 results, so maybe this issue is unnecessary? lmk if you disagree though
That sounds good to me. We might want to add a new column to the DB and flag if it does but we can save that for future dev as I doubt that will happen.
For the eviction settings scraper the code should rescrape jobs that return an overflow of results (200+). The scrape jobs can be split up either recursively or into 3 day scrapes (assuming that no 3 days will have more than 200 cases). The first option is the preferred solution.
The text was updated successfully, but these errors were encountered: