Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: add historicalEventDataProvider #133

Open
Tracked by #101
ChakshuGautam opened this issue Jun 15, 2023 · 3 comments · May be fixed by #101
Open
Tracked by #101

feat: add historicalEventDataProvider #133

ChakshuGautam opened this issue Jun 15, 2023 · 3 comments · May be fixed by #101
Assignees
@techsavvyash
Labels
enhancement New feature or request pending-review issues which have corresponding PRs which have a pending review/merge from the maintainer. requires-testing feat was implemented by the C4GT contributor but requires testing

Comments

@ChakshuGautam
Copy link
Owner

Currently when the config changes, there is no way to create a new dataset without going through the entire backlog of data. But cQube Ingestion's runner should allow for getting all of the files so that dependency injection can happen seamlessly. As part of this ticket, there should be historicalEventDataProvider that should be created that allows to get all events for a new dataset and then combines them into a series of files to calculate the dataset columns.
@techsavvyash techsavvyash added enhancement New feature or request P1 labels Jun 20, 2023
@techsavvyash
Copy link
Collaborator

break this into a smaller ticket for historicalEventDataProvider. This will be a new interface, what filters to support, where to get the data from.

@techsavvyash
Copy link
Collaborator

techsavvyash commented Jul 13, 2023 •
edited
Loading

write a file name changer util from historicalEventDataProvider

@techsavvyash techsavvyash changed the title Allow for adding a new Dataset feat Jul 13, 2023
@techsavvyash techsavvyash changed the title feat feat: add historical event data provider Jul 13, 2023
@techsavvyash techsavvyash changed the title feat: add historical event data provider feat: add historicalEventDataProvider Jul 13, 2023
@techsavvyash techsavvyash self-assigned this Jul 13, 2023
@techsavvyash techsavvyash added pending-review issues which have corresponding PRs which have a pending review/merge from the maintainer. requires-testing feat was implemented by the C4GT contributor but requires testing and removed P1 labels Oct 7, 2023
@techsavvyash
Copy link
Collaborator

some parts of the issue have been implemented in #101

@techsavvyash techsavvyash linked a pull request Oct 7, 2023 that will close this issue
Open
5 tasks
@techsavvyash techsavvyash linked a pull request Oct 7, 2023 that will close this issue
Update #101
Open
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@techsavvyash techsavvyash

Labels
enhancement New feature or request pending-review issues which have corresponding PRs which have a pending review/merge from the maintainer. requires-testing feat was implemented by the C4GT contributor but requires testing
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Update techsavvyash/cQube-ingestion
2 participants
@ChakshuGautam @techsavvyash