Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Migrate to RabbitMQ #149

Open
AbooMinister25 opened this issue Aug 3, 2023 · 0 comments · May be fixed by #150
Open

Migrate to RabbitMQ #149

AbooMinister25 opened this issue Aug 3, 2023 · 0 comments · May be fixed by #150
Assignees

Comments

@AbooMinister25
Copy link
Contributor

AbooMinister25 commented Aug 3, 2023

This issue details the migration of mainframe over to RabbitMQ, due to the decision to use a message queue over our existing structure of using the database as a queue itself, having mainframe dish out jobs and receive results via an HTTP API.

Changes Involved

  • Mainframe no longer distributes jobs, the loader will push jobs to an "incoming" queue in its place.
  • Results will no longer be received via the HTTP API. Instead, have mainframe pull results from an "outgoing" results queue that the clients will push to every so often, and write those to the database.
  • Rather than having the database store the entirety of our scan data, instead make it so that only the results of a scan are stored.
@AbooMinister25 AbooMinister25 self-assigned this Aug 3, 2023
@AbooMinister25 AbooMinister25 moved this to 🏗 In progress in Dragonfly Roadmap Aug 3, 2023
@AbooMinister25 AbooMinister25 modified the milestone: MVP Aug 3, 2023
@AbooMinister25 AbooMinister25 linked a pull request Aug 3, 2023 that will close this issue
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: 📋 Backlog
Development

Successfully merging a pull request may close this issue.

1 participant