Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ChimeraPy DAG should be dynamic vis-a-viz data sources. #294

Open
umesh-timalsina opened this issue Nov 13, 2023 · 0 comments
Open

ChimeraPy DAG should be dynamic vis-a-viz data sources. #294

umesh-timalsina opened this issue Nov 13, 2023 · 0 comments

Comments

@umesh-timalsina
Copy link
Contributor

Scenario

Let's take a client application. What are the realistic possibilities that a ChimeraPy pipeline is in sync with the operations in the client applications? While this is an ideal scenario for every client application to write ChimeraPy node and orchestrate a pipeline every time a new session happens, we can do one better by going a level lower. This is not a "time-aligned" recording, but rather a dynamic datachunk that can be fed into the processing graph based on some sort of auth mechanism. Such that nodes can process data based on what is fed to them. And with async processing functions, we can definitely do this even if the from different sources arrive at different timepoints in the cluster.

Applications

While we have been delving into what is the best way to integrate ChimeraPy with learning environments, or any other application for that matter? This approach is definitely more flexible; can support language agnostic API/ protocols and I can see the following applications for this:

  • A ChimeraPy client that can connect to the manager based on some sort of ws/rest API.
  • Query the current graph in the pipeline.
  • Intent to add an edge from the current application to specific nodes in the graph/ record data as they come along.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: No status
Development

No branches or pull requests

1 participant