Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Time difference for 4 phases of run more than 500ms #320

Closed
arjunsuresh opened this issue Aug 12, 2023 · 4 comments
Closed

Time difference for 4 phases of run more than 500ms #320

arjunsuresh opened this issue Aug 12, 2023 · 4 comments

Comments

@arjunsuresh
Copy link
Contributor

The below error has been seen many times in previous rounds and we are seeing it in about 5-10% of our power runs. In the interest of time we are just doing reruns, but from all our results, increasing the delta from 500ms to 1s should solve the issue. Below is an example log.

[2023-08-12 09:03:56,445 power_checker.py:753 INFO] [x] Check client sources checksum
[2023-08-12 09:03:56,445 power_checker.py:753 INFO] [x] Check server sources checksum
[2023-08-12 09:03:56,445 power_checker.py:753 INFO] [x] Check PTD commands and replies
[2023-08-12 09:03:56,445 power_checker.py:753 INFO] [x] Check UUID
[2023-08-12 09:03:56,445 power_checker.py:753 INFO] [x] Check session name
[2023-08-12 09:03:56,445 power_checker.py:740 ERROR] [ ] Check time difference
[2023-08-12 09:03:56,445 power_checker.py:741 ERROR] 	The time difference for 4 phase of ranging mode is more than 500ms.Observed difference is 593.8124656677246ms
@arjunsuresh
Copy link
Contributor Author 

[2023-08-13 12:36:04,668 power_checker.py:753 INFO] [x] Check client sources checksum
[2023-08-13 12:36:04,668 power_checker.py:753 INFO] [x] Check server sources checksum
[2023-08-13 12:36:04,669 power_checker.py:753 INFO] [x] Check PTD commands and replies
[2023-08-13 12:36:04,669 power_checker.py:753 INFO] [x] Check UUID
[2023-08-13 12:36:04,669 power_checker.py:753 INFO] [x] Check session name
[2023-08-13 12:36:04,669 power_checker.py:740 ERROR] [ ] Check time difference
[2023-08-13 12:36:04,669 power_checker.py:741 ERROR] 	The time difference for 4 phase of ranging mode is more than 500ms.Observed difference is 562.474250793457ms

@arjunsuresh
Copy link
Contributor Author 

[2023-08-13 12:36:04,859 power_checker.py:753 INFO] [x] Check client sources checksum
[2023-08-13 12:36:04,859 power_checker.py:753 INFO] [x] Check server sources checksum
[2023-08-13 12:36:04,859 power_checker.py:753 INFO] [x] Check PTD commands and replies
[2023-08-13 12:36:04,859 power_checker.py:753 INFO] [x] Check UUID
[2023-08-13 12:36:04,859 power_checker.py:753 INFO] [x] Check session name
[2023-08-13 12:36:04,859 power_checker.py:740 ERROR] [ ] Check time difference
[2023-08-13 12:36:04,859 power_checker.py:741 ERROR] 	The time difference for 4 phase of ranging mode is more than 500ms.Observed difference is 533.1976413726807ms

@arjunsuresh
Copy link
Contributor Author

PR to fix this: mlcommons/inference#1496

arjunsuresh added a commit to arjunsuresh/inference that referenced this issue Sep 19, 2023
@arjunsuresh
Update power_checker.py
7d79dc0 
Increases the time delta tolerance from 500ms to 800ms based on empirical results shared in [this issue](mlcommons/power-dev#320)
@arjunsuresh arjunsuresh mentioned this issue Sep 19, 2023
Closed
@arjunsuresh
Copy link
Contributor Author

Hopefully addressed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@arjunsuresh