Skip to content

compare consistent hashing implementations to solve distributed continues jobs processing problem

Notifications You must be signed in to change notification settings

dlemel8/consistent_hashing_workers

Repository files navigation

consistent_hashing_workers

Test

This repo contains 3 services:

  • Generator is generating jobs with an id and data
  • Workers are processing the jobs and send their results to reporter
  • Reporter is aggregating jobs results and then saves a report

In steady state, requirements are:

  • Each job id is processed by the same worker
  • Workload is evenly distributed among the workers

Abstract Design

Abstract

Implementations

RabbitMQ (Centralized Message Broker)

RabbitMQ

ZeroMQ (Distributed Messaging Sockets)

ZeroMQ

About

compare consistent hashing implementations to solve distributed continues jobs processing problem

Topics

Resources

Stars

Watchers

Forks