Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Max upload size #21

Open
srlowe opened this issue Jun 30, 2016 · 3 comments
Open

Max upload size #21

srlowe opened this issue Jun 30, 2016 · 3 comments

Comments

@srlowe
Copy link

srlowe commented Jun 30, 2016

Hi, Could you list the max-upload size somewhere please?

Thanks
@theycallmeswift
Copy link
Owner

Hey @bgSosh. Not sure if I follow? S3 might have some size limitations, but I don't think mongodump does. Are you hitting specific issues with size?

@srlowe
Copy link
Author

srlowe commented Jun 30, 2016

Hi swift, sorry, I wrote this in a hurry (and sounds not like I intended). S3 has a single-put limit of 5GB AFAIK, and over that (up to 5TB I think) you have to use the multipart API. Not sure which this project is using. Cheers

@theycallmeswift
Copy link
Owner

The underlying code uses Knox's putFile, which you can find here: https://github.com/Automattic/knox/blob/088050868e59ec9bf5bc5fc91d606c37ca0c78d5/lib/client.js#L350-384

Looks to me like a normal streaming put operation which would indicate a 5GB limit I think. Honestly unsure though. Do you have a 5gb file you can test it on?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@theycallmeswift @srlowe