Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Pascal family cards support. #605

Open
akamaus opened this issue Jul 25, 2024 · 0 comments
Open

Pascal family cards support. #605

akamaus opened this issue Jul 25, 2024 · 0 comments

Comments

@akamaus
Copy link

akamaus commented Jul 25, 2024

It's said in the FAQ that models are served in FP16 to conserve the GPU memory. What's about support for cards like 1080Ti than? AFAIK they have terrible performance for FP16 (something like 150GFLOP/S compared to 10TFLOP/S on FP32)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@akamaus