New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CPU only sample will hang #165

Open

LukeLIN-web opened this issue Sep 11, 2023 · 1 comment

LukeLIN-web commented Sep 11, 2023

When I use this setting,

    exp_id = 'fixed_depatch'
    request_mode = 'Fixed'
    sample_mode = 'CPU' # 'CPU', 'GPU', 'Auto'
    uva_gpu = 'GPU' # 'GPU', 'UVA'

I run python reddit_serving.py

output

LOG>>> P2P Access Initilization
LOG>>> 100% data cached
LOG>>> feature order is loaded
LOG >>> Memory Budge On 0 is 534 MB
LOG >>> Memory Budge On 1 is 534 MB
Data load finished
Enable P2P Access Between 0 <---> 1 
Elapsed time: 0.000009seconds
Elapsed time: 0.000008seconds
CPU Sampler 1 Start
CPU Sampler 0 Start

It cannot have any result_queue.get()

The text was updated successfully, but these errors were encountered:

Author

LukeLIN-web commented Sep 11, 2023

I find in serving.py line 129
result_queue.put((res, time.perf_counter()-start)) will stuck.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment