Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dataset download error #36

Open
sd0809 opened this issue Jul 21, 2024 · 8 comments
Open

Dataset download error #36

sd0809 opened this issue Jul 21, 2024 · 8 comments

Comments

@sd0809
Copy link

sd0809 commented Jul 21, 2024

Thanks for this impressive work !
I have the problem with download_tool.py while downloading the MVIMGNET.

Traceback (most recent call last):
File "/mnt/workspace/shedong/data/scripts/download_mvimgnet.py", line 312, in
havePwdGetFiles( urls["mvimgnet"], pwd, download_root , force )
File "/mnt/workspace/shedong/data/scripts/download_mvimgnet.py", line 304, in havePwdGetFiles
getFiles(url, download_path, force)
File "/mnt/workspace/shedong/data/scripts/download_mvimgnet.py", line 250, in getFiles
url, name, hash = filemeta["@content.downloadUrl"], filemeta["name"], filemeta["file"]["hashes"]
KeyError: '@content.downloadUrl'

Can somebody help me ? Thank you !

@allenzyd1997
Copy link
Contributor

Hi Shedong,

I really have not met the problem before. I just checked the code, everything goes right, could you please double-check the URL in your script to ensure nothing has changed with the original code(or you can directly clone the code again)? Feel free to let me know if you still have a problem, we will see how to fix it.

Yidan

@sd0809
Copy link
Author

sd0809 commented Jul 21, 2024

Thanks for your prompt reply!
I am sure I didn't change the code in download_tool.py.
I run the code again and print the filemeta when I got this error in line 247 of download_tool.py
url, name, hash = filemeta["@content.downloadUrl"], filemeta["name"], filemeta["file"]["hashes"]
the filemeta is:
{
"error": {
"code": "unauthenticated",
"message": "Unauthenticated"
}
}
So it seems like I am unauthenticated? I have completed the request form and got the password for the download.
484794FD-DD02-4A50-8C8C-E5B1E389F145
It seems I have successfully download mvi_00 ~ 10.zip 、mask/ and MVImgNet_by_categories. However, the remaining .zip files show 'unauthenticated' and cannot be downloaded.

I hope you can help me look into the issue when you have some time. Your assistance would be greatly appreciated.

@allenzyd1997
Copy link
Contributor

OK! I am checking the problem. Sorry for the late reply. if you urgently need to download the data, FYI, the web link we provided in the Google form reply can be accessed directly. You can manually download the rest 32 zips using the One Drive.

@sd0809
Copy link
Author

sd0809 commented Jul 22, 2024

OK, thank you!

@tau-yihouxiang
Copy link

The same error when running download_tool.py

Traceback (most recent call last):
havePwdGetFiles( urls["mvimgnet"], pwd, download_root , force )
getFiles(url, download_path, force)
getFiles(originalPath, os.path.join(download_path, i['FileLeafRef']), force, download_root, req=req, layers=layers+1)
url, name, hash = filemeta["@content.downloadUrl"], filemeta["name"], filemeta["file"]["hashes"]

@allenzyd1997
Copy link
Contributor

I got it, It Looks like, after a few times of requests, the share point of our university needs to re-authentication, I am contacting the IT staff hoping they can solve the problem. FYI, You can still manually use the Share Point website (we provided in the Google form), to download the data file manually.

@MontaEllis
Copy link

same issue!

@2hiTee
Copy link

2hiTee commented Nov 6, 2024

Does anyone here met the issue: pyppeteer.errors.BrowserError: Browser closed unexpectedly: ? I run the code on remote server and get this error. Could somebody help? This is crucial for me. Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants