Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

2_mkgraphs.go causes "out of memory error" #30

Open
Rioghasarig opened this issue Nov 25, 2019 · 2 comments
Open

2_mkgraphs.go causes "out of memory error" #30

Rioghasarig opened this issue Nov 25, 2019 · 2 comments

Comments

@Rioghasarig
Copy link

Rioghasarig commented Nov 25, 2019

I was using an AWS instance with 16 GB of memory to run this. How much memory exactly is necessary to run this command? Is there any way I can make the computation smaller?

@uakfdotb
Copy link
Member

I used machine with 64 GB memory.

One way to reduce the memory usage is to process only a few regions at a time, instead of generating graphs for all the regions at once. To do this, you could edit dataset/lib/regions.go and comment out some of the regions. So e.g. you could leave only 10 regions uncommented at a time. But this would cause the running time to be higher (need to run the script multiple times if you want to use all of the regions).

@Rioghasarig
Copy link
Author

Rioghasarig commented Nov 25, 2019

Awesome! Thank you so much for your help!
[EDIT]
So that didn't seem to work. It looks like the LoadOSMMultiple function loads all the vertices from the pbf. I'm going to try to see if I can run this with a smaller pbf file.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants