Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improve test perfomance granularity2 #86

Open
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

spetzreborn
Copy link
Contributor

This is a follow-up from #68

We had reperformance issues and decided to install a new server to replace the old one. When testing the new server I wanted hard number to compare between the installations, but the new server was so much better that the testsubmit.py failed in new ways:

  1. It open to many connections so that the testing server OS did not allowed more open sockets.
    The program then misbehaved when trying to close the connections that was not open.

Solution: only close the connection if the there is a connection.

  1. Testing takes a lot of time first double until fail, and then bisect to an exact value. This was not a problem on the old server where the range was not that big, but on the new server the range to backtrack through needs to many step, and there is no need to get that exact number

Solution: Add timeout for the tests, and add how many bisect steps should be tried to get highest good number.

Regards

When doing a performance test more connections may be opened then is
allowed by the OS - and that will make more errors when the program
tries to close the connection that is not open.

This way only close connections that got open.
This limits how many bisect steps the backtrack tries before getting a
result then doing a performance test.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant