Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable scraping automatically each week #10

Open
vcavanna opened this issue Sep 27, 2023 · 3 comments
Open

Enable scraping automatically each week #10

vcavanna opened this issue Sep 27, 2023 · 3 comments
Labels
enhancement New feature or request

Comments

@vcavanna
Copy link
Owner

Use some sort of cloud infrastructure tool to make loads into the redshift database get done automatically.

==== Suggestions =====
Use prefect to do it. It offers a free cloud-based data orchestration for 1 user. Research more before you switch, but yeah.

@vcavanna vcavanna converted this from a draft issue Sep 27, 2023
@vcavanna vcavanna added the enhancement New feature or request label Sep 27, 2023
@vcavanna vcavanna moved this from 🆕 New to 📋 Backlog in 💾 Database Sep 27, 2023
@vcavanna
Copy link
Owner Author

vcavanna commented Oct 6, 2023

@RyanRearden What are the priorities here:

  1. having multiple cars of different makes and models, or
  2. having week by week measurements of a particular make and model

@RyanRearden
Copy link
Collaborator

I think that a having a system to check week by week measurements would help consumers the most. But we should have that for as many cars as possible. I think 2 is a priority as long as we can expand that system to new cars we put into the database.

@vcavanna
Copy link
Owner Author

vcavanna commented Oct 9, 2023

Okay. Well I'll work on automating first. After that, it should be easy to expand that to more cars.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
Status: 📋 Backlog
Development

No branches or pull requests

2 participants