-
Notifications
You must be signed in to change notification settings - Fork 123
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BUG] KNN doesn't release memory when close index #1012
Labels
bug
Something isn't working
Comments
@ylwu-amzn Thanks for reporting this. Yes, the problem is that we do watch for the files to be deleted to free memory as opposed to freeing memory when the IndexReader gets closed. I think a fix for this is to implement a DocValuesReader that frees memory when it is closed. |
Addressed in 2.18 with #2182 |
@jmazanec15 After #1946, when close the indices, it would release the memory. |
github-project-automation
bot
moved this from Backlog (Hot)
to ✅ Done
in Vector Search RoadMap
Oct 31, 2024
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Run big KNN indexes, and see memory usage keep high as 95%. Close one big KNN index, but memory usage still keep high.
Have to delete the KNN index to release the memory. After deleting the index, can see memory usage goes down to 75%.
Seems like a bug that when close an index, KNN doesn't release the memory.
The text was updated successfully, but these errors were encountered: