Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Post your video card FPS here! #168

Open
E3V3A opened this issue May 9, 2020 · 56 comments
Open

Post your video card FPS here! #168

E3V3A opened this issue May 9, 2020 · 56 comments

Comments

@E3V3A
Copy link

E3V3A commented May 9, 2020

It's interesting to see what kind of frame rate (FPS = Frames Per Second) we can expect from our video cards. So if your card is not already listed here, or if your software versions or OS is very different from what's already here, please post a comment with relevant table info, and I'll add it here.

Expected Video Card FPS table

Video Card Name VRAM* FPS OS Py PyTorch Driver**
Nvidia GeForce RTX 3070 8 GB 33 Win10 Pro 3.8.5 1.7.1
Nvidia GeForce RTX 2080 21
Nvidia GeForce RTX 2070 8 GB 23 Win10 3.7.6 1.0.0 441.22
Nvidia GeForce RTX 2060 8 GB 19 Win10 3.7.5 1.0.0
Nvidia GeForce RTX 2060 6 GB 15 Win10 3.7.5 1.0.0
Nvidia GeForce GTX 1650 4 GB 11 Win10 3.7.x 1.0.0
Nvidia GeForce GTX 1650M 4 GB 18 Arch Linux 3.7.7 1.0.0
Nvidia GeForce GTX 1650 Ti 8 GB 21 Linux Mint 20 3.7.9 1.7.1 450.102
Nvidia GeForce GTX 1660 SUPER 6 GB 25 Ubuntu 20.04 3.7.9 1.0.0
Nvidia GeForce GTX 1070 7 GB 15
Nvidia GeForce GTX 1070 8 GB 28 Manjaro 20.0.1 3.7.7 1.0.0
Nvidia GeForce GTX 1060 6 GB
Nvidia GeForce GTX 1050ti 4 GB 7 Win10 3.7.x 1.0.0
Nvidia GeForce GTX 950 2 GB 9 Win10 3.7.7 1.0.0
Nvidia GeForce GTX 860M 4 GB 5+ Ubuntu 20.04 3.7.7 1.0.0
Nvidia GeForce GTX 850M 4 GB 3+ Win8.1 3.8 1.5.0
Nvidia GeForce GTX 850M 4 GB 5+ Win8.1 3.7.7 1.0.0
Nvidia GeForce GTX TITAN 4 GB 7+ Win10 3.7.7 1.0.0
Nvidia Jetson TX2 25

*VRAM is you cards video RAM in GB.
**Driver is your nVidia Driver Version

To get Video card info:

# For Windows Powershell, use: 
(Get-CimInstance -ClassName CIM_VideoController) |Select-Object Name, @{Name="VRAM"; Expression={[math]::round($_.AdapterRAM/1GB, 0)}},DeviceID,AdapterDACType

# For Windows CMD, use:
wmic path win32_VideoController get name

# For Windows/*nix with Nvidia tools in the Path, use: 
nvidia-smi.exe -q
nvidia-smi.exe --format=csv --query-gpu=name,"memory.total",pstate,count,driver_version

# For Linux (general), use:
lspci -v
sudo lshw -numeric -C display
# This require the "mesa-utils" package, but may not be available on headless cloud installs.
glxinfo

You can also search this website for your exact video card, although it may vary sometimes with HW revisions, not easily found.

To get your active Python and PyTorch version, make sure to activate the conda environment as the python version may be different, in different environments.

conda activate avatarify
python -V
pip show torch
@jgomez696
Copy link

Video Card Name (nvidia geforce rtx 2060 )
VRAM (8 GB )
FPS (19)
OS (Win10 home)
Python (3.7.5 )
PyTorch (1.0.0 )

@alievk
Copy link
Owner

alievk commented May 10, 2020

@E3V3A it's impossible for 1060 to run 40+ FPS, that's most probably was "40ms" model inference time. I also doubt 1070 is able to perform at 30 FPS, I have 15 on mine.

@E3V3A
Copy link
Author

E3V3A commented May 10, 2020

@alievk

it's impossible

Good to know. I got all those numbers from random posts in the slack channels...

@MBadberg
Copy link

Video Card Name (nvidia geforce rtx 2060)
VRAM (6 GB )
FPS (15,8)
OS (Win10 Pro)
Python (3.7.5 )
PyTorch (1.0.0 )

@EinderJam
Copy link

Video Card Name (nvidia geforce gtx 1070)
VRAM (8 GB)
FPS/Model/Pre/Post (28/27.5/1.5/5.0) (seems too high for a 1070)
OS (Manjaro 20.0.1)
Python (3.7.7)
PyTorch (1.0.0)

@YosAwed
Copy link

YosAwed commented May 13, 2020

Video Card Name (NVIDIA GeForce GTX TITAN)
VRAM 4GB
FPS 7.8
OS Windows10
Python 3.7.7
Pytorch 1.0.0

@sirdrakeistda
Copy link

sirdrakeistda commented May 14, 2020

Video Card Name: Nvidua geforce GTX 860M
FPS 5.8
OS Ubuntu Budgie 20.04
Python 3.7.7
Pytorch 1.0.0

@clippycoder
Copy link

clippycoder commented May 15, 2020

Video Card Name: None (Processor: i7 5557U)
FPS: 0.3
OS: Macos Catalina 10.15.4
Python 3.7.7
PyTorch 1.5.0

@clippycoder
Copy link

Video Card Name: Nvidia GTX 950
VRAM: 2GB
FPS: 9.1
OS: Windows 10
Python 3.7.7
PyTorch 1.0.0

@clippycoder
Copy link

I'm not sure how much of a difference the video card makes. You can see just in these comments that it varies wildly even amongst similar cards, and while my GTX 950 got ~9 FPS, I noticed it was only under 20% load. Something doesn't seem to be optimized.

@E3V3A
Copy link
Author

E3V3A commented May 15, 2020

@clippycoder

my GTX 950 got ~9 FPS

Actually that sound even too much. For a videocard with only 2GB, that is awesome!
Can you please check again and post the nvidia-smi -q output.

Don't worry about the load. Win10 does super shit confusing job in showing GPU usage in the taskmanager. I believe the 20% you see is an artifact of task manager averaging over a number of CUDA cores or processing units. So to see true usage you need to run the following command:

nvidia-smi --query-gpu=pci.bus_id,pstate,temperature.gpu,utilization.gpu,utilization.memory,memory.free,memory.used --format=csv -l 5

This should keep updating while you're running.

@clippycoder
Copy link

clippycoder commented May 15, 2020

@E3V3A
I'm quite sure it's a GTX 950, having purchased it 'bout a week ago. But, I double checked for you, and yes, it's still a GTX 950, still 2GB, with about 9 FPS. I'd say I'm pretty satisfied. I wouldn't call the output smooth by any measure, but still acceptable for videoconferencing. And thanks for the tip about GPU usage, from the command prompt, it actually appears to be about 70-80%; much more realistic. Task manager reads 15%.

@sovanyio
Copy link

Video Card Name: GeForce GTX 1650 Mobile
VRAM: 4GB
FPS: 18
OS: Arch Linux
Python 3.7.7
PyTorch 1.0.0

@QingpingMeng
Copy link

Video Card Name: Geforce GTX 2070 (Remote GPU in my local network)
VRAM: 8GB
FPS 19 without CUDA, 23 with CUDA
OS: Win10
Python: 3.7.6
PyTorch: 1.0.0

@alievk
Copy link
Owner

alievk commented May 17, 2020

Video Card Name: Geforce GTX 2070 (Remote GPU in my local network)
VRAM: 8GB
FPS 19 without CUDA, 23 with CUDA
OS: Win10
Python: 3.7.6
PyTorch: 1.0.0

Did CUDA installator update the driver? Installing CUDA alone in the system is not supposed to affect the performance..

@E3V3A I think mentioning NVIDIA driver could be informative in these reports.

@QingpingMeng
Copy link

@alievk I believe the CUDA did update the driver, and agreed the Nvidia driver version may be a performance factor.

@E3V3A
Copy link
Author

E3V3A commented May 18, 2020

@alievk When you say:

NVIDIA driver

Do you mean the version or some other part?

@E3V3A
Copy link
Author

E3V3A commented May 18, 2020

@QingpingMeng

Video Card Name: Geforce GTX 2070 (Remote GPU in my local network)
FPS 19 without CUDA, 23 with CUDA

This doesn't quite make sense, please post the output of the command requested.
Especially `nvidia-smi".

@QingpingMeng
Copy link

@E3V3A
name, memory.total [MiB], pstate, count, driver_version
GeForce RTX 2070, 8192 MiB, P8, 1, 441.22

@alievk
Copy link
Owner

alievk commented May 19, 2020

@alievk When you say:

NVIDIA driver

Do you mean the version or some other part?

I mean driver version

@WojciechMigda
Copy link

Is there a control over working resolution of the video stream, e.g. to gain more fps with video lower bitrate?

@alievk
Copy link
Owner

alievk commented May 20, 2020

Is there a control over working resolution of the video stream, e.g. to gain more fps with video lower bitrate?

Right now it requires ~22kbps which is quite democratic. The code in the master branch is not optimal since it communicates messages in a synchronous fashion.

I have an asynchronous solution in feat/colab-mode branch, which doesn't drop FPS for the network lag, i.e. if your server is running 30FPS then your client will update the image 30FPS but with a lag.

I'll merge branch to master lately when it's tested and tuned.

@mymistake
Copy link

Video Card Name: Nvidia Jetson Nano (128 Cuda Cores)
VRAM: 4GB LPDDR4 system total (no dedicated VRAM)
FPS: 0.8
OS: Ubuntu 18.04
Python: 3.6.9
PyTorch: 1.5.0

Makes me wonder if that Jetson TX2 entry is correct.

@homerobono
Copy link

homerobono commented Jun 2, 2020

Video Card Name: GeForce RTX 2070 (driver 440.82, CUDA 10.2)
VRAM: 8GB
FPS: 34 (32-36)
OS: Linux Mint 19.1 Cinnamon (kernel 4.15.0-101-generic)
Python: 3.7.7
PyTorch: 1.0.0

With 68% and 22% GPU utilization and memory, respectively, reading from @E3V3A command suggestion:

nvidia-smi --query-gpu=pci.bus_id,pstate,temperature.gpu,utilization.gpu,utilization.memory,memory.free,memory.used --format=csv -l 5

@Gurriato
Copy link

Gurriato commented Jun 4, 2020

Gigabyte RTX 2070 super
VRAM 8gb
FPS: 32 (but sometimes 20-30)
OS: win10
Python: 3.7.7
Pytorch: 1.0.0

@uklatt
Copy link

uklatt commented Jun 19, 2020

NVIDIA Quadro T1000 (Laptop)
VRAM 4gb
FPS: 10
OS: win10
Python: 3.7.7
Pytorch: 1.0.0

@alievk alievk pinned this issue Oct 11, 2020
@cocodr1lo
Copy link

GeForce GTX 1660 SUPER (1408 cuda cores)
VRAM 6GB
FPS ~25
Ubuntu 20.04
Python 3.7.9
Pytorch 1.0.0

@theCalcaholic
Copy link

GPU: GeForce GTX 970 (OC)
VRAM: 4GB (3.5GB + 0.5GB)
FPS: 20
OS: Ubuntu 20.04
Python (docker): 3.6.9
Pytorch (docker): 1.0.0
Python (host): 3.8.3

@theCalcaholic
Copy link

I'm a bit puzzled as to why I should get better FPS than the 1070... Could the webcam resolution have an effect?

@clippycoder
Copy link

You only got higher than one 1070. The other one was 15

@JohanAR
Copy link
Collaborator

JohanAR commented Dec 13, 2020

GPU: GeForce GTX 1080
Driver: 455.38
Graphics Clock: 1860 Mhz (not max according to NVIDIA X Server Settings for some reason)
Memory Transfer Rate: 10010 Mhz
CUDA Cores: 2560
VRAM: 8 GB
FPS: 31 (31.0 - 31.5)
OS: Ubuntu 20.04.1 LTS
Python (docker): 3.6.9
Pytorch (docker): 1.0.0
OpenCV (docker): 4.2.0.34
Python (host): 3.8.5

@kiawildberger
Copy link

GPU: RTX 3060Ti
VRAM: 4gb
CPU: i7 3930k
OS: Win10 Pro
Python: 3.7.9
Pytorch: 1.7.1
FPS: ~20

@JohanAR
Copy link
Collaborator

JohanAR commented Jan 15, 2021

I'm a bit puzzled as to why I should get better FPS than the 1070... Could the webcam resolution have an effect?

It resizes the input frame to 250*250 so I don't think webcam resolution should have significant impact. The report of 15 fps on a 1070 is quite old though, so it's possible that either Avatarify or some of its dependencies has been optimized since then. 20 still sounds like a lot for a 970 though, based on its relative computing power to other cards.. Maybe I'll try installing Avatarify on my wife's computer, she also has a 970

This was referenced Jan 30, 2021
@erik-404err
Copy link

Video Card Name: NVIDIA GeForce GTX 1650 Ti
VRAM: 8Gb
FPS: ~21
OS: Linux Mint 20
Py: 3.7.9
PyTorch: 1.7.1
Driver: 450.102.04

@comalnik
Copy link

comalnik commented Feb 6, 2021

Video Card Name (nvidia geforce rtx 3070 )
VRAM (8 GB )
FPS (33)
OS (Win10 pro)
Python (3.8.5 )
PyTorch (1.7.1 )

@baltoku
Copy link

baltoku commented Mar 8, 2021

Pretty unusual result for my spec only 2 FPS, did I miss something?

CPU (I9 9900k)
Video Card Name (GTX 1080ti)
Driver (456.55)
VRAM (11 GB )
FPS (2.5)
OS (Win10 pro)
Python (3.7.1)
PyTorch (1.8.0)

@MBadberg
Copy link

MBadberg commented Mar 8, 2021

Pretty unusual result for my spec only 2 FPS, did I miss something?

Yeah, you're doing something wrong there. It's like buying a Ferrari and driving it like a Trabant.

Have a look here. I think, you managed somehow to disable CUDA. Maybe you should try dif driver version for a quick fix:
https://www.techpowerup.com/forums/threads/gtx-1080-ti-no-cuda-detected.275935/

@baltoku
Copy link

baltoku commented Mar 9, 2021

Pretty unusual result for my spec only 2 FPS, did I miss something?

Yeah, you're doing something wrong there. It's like buying a Ferrari and driving it like a Trabant.

Have a look here. I think, you managed somehow to disable CUDA. Maybe you should try dif driver version for a quick fix:
https://www.techpowerup.com/forums/threads/gtx-1080-ti-no-cuda-detected.275935/

Hi MBadberg,
I've tried installed TechPowerup GPU and CUDA is activated already,
I've also reinstalled the latest NVIDIA driver after using DDU to remove completely the driver

any suggestion?
messageImage_1615292888653

UPDATED : using the windows GUI works normal for me, I think I'll use this instead

@EastArctica
Copy link

CPU (Intel Xeon W3580 @ 3.33 GHz)
Video Card Name (NVIDIA GeForce RTX 2070 SUPER)
Driver (27.21.14.6627 aka 466.27)
VRAM (4 GB)
FPS (21-22)
OS (Windows 10 Pro)
Python (3.7.10)
PyTorch (1.7.1)

@jasmine653
Copy link

Nvidia Jetson Nano

FPS: 1.2
OS: Ubuntu 18.04
Python: 3.6.9
PyTorch: 1.8.0

@Allesanddro
Copy link

Allesanddro commented Apr 15, 2022

NVIDIA GeForce RTX 3060 Laptop GPU (145W TDP version there are low power units aswell e.g 80watt-150watt)
image

OS WINDOWS
Python 3.7.13
torch 1.7.1

@Khaleedmain
Copy link

Can This works for avatarify
Gpu: Nvidia GeForce 920m
Vram: 1gb

@Roumputer
Copy link

CPU (Ryzen 5500 6 core 12 thread)
Video Card Name (NVIDIA GeForce RTX 3050)
Driver (512)
VRAM (8 GB)
OS (Windows 10 Pro)
Python (3.7.10)
PyTorch (1.7.2)
FPS 24
FPS when OBS on 21 (obs is eating gpu resource, can i use other apps?)

@foxambition

This comment was marked as off-topic.

@foxambition

This comment was marked as off-topic.

@clippycoder

This comment was marked as off-topic.

@jackefrain01

This comment was marked as off-topic.

@Source61
Copy link

Source61 commented Dec 1, 2022

Video Card Name: Geforce GTX 3080
VRAM: 10GB
FPS: 45 avg, 48 max
OS: Debian 12
Python: 3.7.13.final.0 (conda)
PyTorch: Doesn't seem installed in conda (conda run pydoc[3] torch), version outside conda if it matters is 1.12.1+cu102

By comparison my Geforce GTX 1060 3GB (5 years old card) was doing upwards of 30 fps, same environment.

Update: Installed PyTorch 1.12.1 in conda. FPS improved on GTX 3080 to 49 avg, 51 max

@Kjay712

This comment was marked as off-topic.

@sageyyyy

This comment was marked as off-topic.

@linobrown7

This comment was marked as off-topic.

@Solidpotential147

This comment was marked as off-topic.

@GhostShot3
Copy link

GhostShot3 commented May 20, 2023

Interresing, RTX 4080 should do 60 FPS

@Wiztido

This comment was marked as off-topic.

@Wiztido

This comment was marked as off-topic.

@innodollars
Copy link

why is rtx 40 series fps low?

Repository owner deleted a comment from Nene020 Jun 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests