Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Add Contellation::put_many #447

Open
dariusc93 opened this issue Feb 7, 2024 · 0 comments
Open

feat: Add Contellation::put_many #447

dariusc93 opened this issue Feb 7, 2024 · 0 comments
Labels
enhancement New feature or request P-Low Low Priority

Comments

@dariusc93
Copy link
Contributor

dariusc93 commented Feb 7, 2024

The current api does not support multiple uploads so one would have to make multiple Constellation::put calls and poll each stream that is returned to completion. While one could get around this by polling the streams, either individually or collectively (since the progress does return a name that can be tracked), I do believe it might be more optimal to support an api that would do this internally while the end user would only have one stream to poll.

Note:

  • There may be a limit to how many can be uploaded at one given time in warp-ipfs. While this "upload" is nothing more than storing it on the local node, we do not want to have a overwhelming number of files being stored at one given time, especially if a protocol is introduced to broadcast blocks or files out, or if the system storage is not the best. While we could batch these into separate task once it reach a threshold, I do feel that may not be desirable long term. Furthermore, when it comes to pinning these files on shuttle or some other service (if any), we dont want to have a overwhelming amount of data that may take a long time to pin either.
@dariusc93 dariusc93 added enhancement New feature or request P-Low Low Priority labels Feb 7, 2024
@dariusc93 dariusc93 self-assigned this Feb 7, 2024
@dariusc93 dariusc93 removed their assignment Jun 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request P-Low Low Priority
Projects
None yet
Development

No branches or pull requests

1 participant