Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPIKE] Add caching and key data storage with SQLite #24

Draft
wants to merge 17 commits into
base: bk-repo-data-class
Choose a base branch
from

Conversation

domoscargin
Copy link
Contributor

@domoscargin domoscargin commented Jan 5, 2025

What

Implements caching via an SQLite database.

  • ➕ Avoids parsing large JSON files
  • ➖ Less human-readable
  • ➖ Requires SQL knowledge to change

Also produces key stats by querying the database

PR: #29

@domoscargin domoscargin changed the title Add caching Add caching and key data storage Jan 5, 2025
@domoscargin domoscargin force-pushed the bk-repo-data-class branch 4 times, most recently from 0871587 to 7aeda71 Compare January 6, 2025 21:52
@domoscargin domoscargin force-pushed the bk-caching branch 2 times, most recently from 5d6894a to ddb891e Compare January 6, 2025 21:57
@domoscargin domoscargin changed the title Add caching and key data storage [SPIKE] Add caching and key data storage Jan 8, 2025
@domoscargin domoscargin mentioned this pull request Jan 8, 2025
27 tasks
@domoscargin
Copy link
Contributor Author

I've run this script a coupla times and the returned data is consistent.

If you're running Prettier or somesuch on your IDE, you'll want to make sure that at workspace level you're using eslint instead.
- No more dangling commas
- Import assertions now use the stage 4 keyword with instead of assert
- Strict equality
- Spacing tweaks
Rather hastily done, and we're not testing the Octokit class just yet, but probably better than nothing
pushed_at doesn't necessarily trigger a change to the repo
If we find a repo entry in the DB, we can just use that data
@domoscargin domoscargin changed the title [SPIKE] Add caching and key data storage [SPIKE] Add caching and key data storage with SQLite Jan 9, 2025
@domoscargin domoscargin force-pushed the bk-repo-data-class branch 21 times, most recently from 81d9fe7 to 93bb0e0 Compare January 16, 2025 17:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant