Phones | Mobile SoCs Deep Learning Ranking Desktop GPUs and CPUs
Model TF Version Cores Frequency, GHz Acceleration Platform RAM, GB Year Inference
Score
Training
Score
AI-Score
Tesla V1001.13.15120 (CUDA)1.23 / 1.38CUDA 10Ubuntu 16.043220181600416770 32774
GeForce RTX 2080 Ti1.14.04352 (CUDA)1.35 / 1.55CUDA 10Windows 101120181464715824 30471
TITAN RTX1.13.14608 (CUDA)1.35 / 1.77CUDA 10Ubuntu 16.042420181503315420 30453
Quadro RTX 60001.14.04608 (CUDA)1.44 / 1.77CUDA 10Debian 9.92420181450415067 29570
GeForce RTX 2080 SUPER1.12.03072 (CUDA)1.65 / 1.82CUDA 10Debian 10820191261712897 25514
GeForce RTX 20802.0.0-beta12944 (CUDA)1.52 / 1.71CUDA 10Ubuntu 18.04820181094111493 22434
GeForce RTX 2070 SUPER1.14.02560 (CUDA)1.61 / 1.77CUDA 10Windows 10820191013711073 21210
TITAN X Pascal1.8.03584 (CUDA)1.42 / 1.53CUDA 9Debian 9.91220161010710437 20544
GeForce GTX 1080 Ti1.13.13584 (CUDA)1.58 / 1.60CUDA 10Debian 9.91120171011310312 20425
TITAN Xp CE1.12.03840 (CUDA)1.41 / 1.58CUDA 9Debian 9.9122017106639440 20103
GeForce RTX 20701.13.12304 (CUDA)1.41 / 1.62CUDA 10Windows 108201888939992 18885
Tesla P401.14.03840 (CUDA)1.30 / 1.53CUDA 10Ubuntu 18.0424201692218785 18006
Quadro RTX 40001.14.02304 (CUDA)1.01 / 1.55CUDA 10Windows 108201881889414 17601
GeForce GTX 10801.14.02560 (CUDA)1.61 / 1.73CUDA 10Ubuntu 18.048201683158455 16770
GeForce RTX 20601.13.11920 (CUDA)1.37 / 1.75CUDA 10Debian 106201971967851 15047
GeForce RTX 2070 Max-Q1.14.02304 (CUDA)0.89 / 1.19CUDA 10Windows 108201970707922 14991
GeForce GTX 10701.14.01920 (CUDA)1.51 / 1.68CUDA 10Debian 108201670977439 14536
GeForce GTX 1660 Ti1.8.01536 (CUDA)1.50 / 1.77CUDA 9Windows 106201959008059 13959
GeForce GTX TITAN X1.12.03072 (CUDA)1.00 / 1.09CUDA 9Debian 9.912201568266892 13718
Tesla T41.14.02560 (CUDA)0.59 / 1.59CUDA 10Ubuntu 18.0416201863687161 13529
GeForce GTX 10601.14.01280 (CUDA)1.51 / 1.71CUDA 10Debian 106201651385642 10780
Tesla K801.14.02496 x 2 (CUDA)0.56 / 0.82CUDA 10Ubuntu 18.0412 x 2201428903458 6348
Tesla K40c1.12.02880 (CUDA)0.75 / 0.88CUDA 9Debian 9.912201327773359 6136
GeForce GTX 9601.14.01024 (CUDA)1.13 / 1.18CUDA 10Ubuntu 18.044201529263203 6129
Quadro P20002.0.0-beta11024 (CUDA)1.08 / 1.48CUDA 10Ubuntu 18.045201728843212 6096
Quadro P4200 Mobile1.14.02304 (CUDA)1.23 / 1.65CUDA 10Debian 108201824732949 5422
Quadro M2000M1.14.0640 (CUDA)1.04 / 1.20CUDA 10Fedora 304201518822211 4093 (1)
Quadro M2000M1.14.0640 (CUDA)1.04 / 1.20CUDA 10Windows 104201518432123 3966 (2)
GeForce GT 10301.12.0384 (CUDA)1.23 / 1.47CUDA 9Debian 9.922017137502750 1
Intel Xeon E5-2620 v4 x 21.14-Conda12 / 24 Threads2.1 / 3.0Intel MKLDebian 9.916201611081461 2569 (1)
Intel Core i7-9700K1.14-Conda8 / 8 Threads3.6 / 4.9Intel MKLDebian 9.932201810381442 2480
AMD Ryzen 9 3900X1.14.012 / 24 Threads3.8 / 4.6Intel MKLDebian 103220191204967 2171
Ryzen Threadripper 2990WX1.14.032 / 64 Threads3.0 / 4.2Intel MKLUbuntu 18.046420181201879 2080
Intel Core i7-87001.14-Conda6 / 12 Threads3.2 / 4.6Intel MKLDebian 9.93220178471178 2025
Intel Core i7-8086K1.14.06 / 12 Threads4.0 / 5.0Intel MKLDebian 9.93220181009992 2001
AMD Ryzen 5 36001.14.06 / 12 Threads3.6 / 4.2Intel MKLUbuntu 16.04162019990915 1905
Intel Xeon E5-2620 v4 x 21.14.012 / 24 Threads2.1 / 3.0Intel MKLDebian 9.9162016968873 1841 (2)
Intel Xeon D-2183IT1.14.012 / 24 Threads2.1 / 3.0Intel MKLCentOS 7.62562018938831 1769
Intel Xeon Gold 62341.14.08 / 16 Threads3.3 / 4.0Intel MKLCentOS 7.53220191010746 1756
Intel Core i7-7700K1.14.04 / 8 Threads4.2 / 4.5Intel MKLDebian 9.9322017759809 1568
Intel Core i9-9880H1.14.08 / 16 Threads2.3 / 4.8Intel MKLDebian 10162019786685 1471
Intel Core i7-9750H1.14.06 / 12 Threads2.5 / 4.5Intel MKLDebian 10642019689773 1462
Intel Core i7-6700K1.14-Conda4 / 8 Threads4.0 / 4.2Intel MKLDebian 9.9322015608840 1448 (1)
AMD Ryzen 7 3700X1.14.08 / 16 Threads3.6 / 4.4Intel MKLWindows 10322019774647 1421 5
Intel Core i7-4790K1.14-Conda4 / 8 Threads4.0 / 4.4Intel MKLDebian 9.9162014582818 1400
Intel Core i7-6700K1.14.04 / 8 Threads4.0 / 4.2Intel MKLDebian 9.9322015655699 1354 (2)
Intel Xeon E5-2603 v4 x 21.14.012 / 12 Threads1.7 / 1.7Intel MKLCentOS 7.51282016695601 1296
Intel Core i7-8850H1.14.06 / 12 Threads2.6 / 4.3Intel MKLUbuntu 18.04322018655639 1294
Intel Xeon E5-2650 v21.14.08 / 16 Threads2.6 / 3.4Intel MKLDebian-stretch1282013653603 1256
Intel Xeon E5-2620 v31.14.06 / 12 Threads2.4 / 3.2Intel MKLDebian 10242014614640 1254 (1)
Intel Core i5-74001.14.04 / 4 Threads3.0 / 3.5Intel MKLUbuntu 18.04162017561613 1174
Intel Core i7-4770K1.14.04 / 8 Threads3.5 / 3.9Intel MKLDebian 9.9162013566587 1152
Intel Xeon E3-1505M v51.14-Conda4 / 8 Threads2.8 / 3.7Intel MKLFedora 30162015449676 1125 (1)
Intel Xeon W-2150B1.14.010 / 20 Threads3.0 / 4.5Intel MKLmacOS Mojave642017526547 1073
Intel Core i5-85001.14.06 / 6 Threads3.0 / 4.1Intel MKLWindows 10162018535420 955 5
Intel Xeon E3-1505M v51.14.04 / 8 Threads2.8 / 3.7Intel MKLFedora 30162015423527 950 (2)
Intel Core i7-3930K1.14.06 / 12 Threads3.2 / 3.8Intel MKLGentoo (4.20)322011390492 882
Intel Core i7-6700K1.12.04 / 8 Threads4.0 / 4.2AVXDebian 9.9322013330460 790 (3)
Intel Core i7-8565U1.14.04 / 8 Threads1.8 / 4.6Intel MKLDebian 1082018335422 757
Intel Core i7-6700K1.13.1-Intel4 / 8 Threads4.0 / 4.2Intel MKLDebian 9.9322013358353 711 (4)
Intel Core i5-65001.14.04 / 4 Threads3.2 / 3.6Intel MKLWindows 10162015365302 667 5
Intel Core i5-44601.14.04 / 4 Threads3.2 / 3.4Intel MKLWindows 10162014371278 649 5
Intel Xeon E3-1505M v51.14.04 / 8 Threads2.8 / 3.7Intel MKLWindows 10162015313299 612 (3) 5
Intel Core i7-3770K1.14-Conda4 / 8 Threads3.5 / 3.9Intel MKLDebian 9.9162012273339 612
Intel Xeon E3-1505M v52.0.0-beta14 / 8 Threads2.8 / 3.7Intel MKLWindows 10162015312295 607 (4) 5
Intel Core i7-8559U1.14.04 / 8 Threads2.7 / 4.5Intel MKLmacOS Mojave162018205400 605
Intel Core i7-2600K1.14.04 / 8 Threads3.4 / 3.8Intel MKLDebian 9.9162011251316 566
Intel Core i7-2700K1.14-Conda4 / 8 Threads3.5 / 3.9Intel MKLDebian 9.9162011259307 566
Intel Xeon E5-2620 v31.14.06 / 12 Threads2.4 / 3.2Intel MKLWindows 7162014292219 511 (2) 5
AMD Ryzen 3 12001.14.04 / 4 Threads3.8Intel MKLWindows 1082017288214 502 5
Intel Core i7-6700K1.5.04 / 8 Threads4.0 / 4.2no AVXDebian 9.9322013186300 486 (5)
GeForce GT 7101.12.096 (CUDA)0.78 / 0.80CUDA 9Debian 9.9220132350470 1
Intel Xeon E3-1505M v51.13.14 / 8 Threads2.8 / 3.7AVXWindows 10162015173205 378 (5) 5
Intel Core i7-9501.14-Conda4 / 8 Threads3.06 / 3.33Intel MKLDebian 9.9162009133195 328 (1)
Intel Core i7-9501.5.04 / 8 Threads3.06 / 3.33no AVXDebian 9.9162009111182 293 (2)
Intel Core i7-9301.5.04 / 8 Threads2.80 / 3.06no AVXDebian 9.9162010110178 288
Zhaoxin KaiXian KX-U6780A1.14.08 / 8 Threads2.7 / 2.7Intel MKLUbuntu 18.0416201893127 220
Intel Core i5-3437U1.14.02 / 4 Threads1.9 / 2.9Intel MKLWindows 101620139298 190 5
Intel Core i3-6006U1.14.02 / 4 Threads2.0 / 2.0Intel MKLWindows 108201611070 180 5

1  -  The final AI Score for this device was estimated based on its inference score

2  -  The final AI Score for this device was estimated based on its training score

3  -  This device might be using unofficial / prototype hardware or drivers

4  -  These are the results of an early prototype. The results of the commercial device might be different

5  -  Due to the issues with multithreading, the performance of TensorFlow Windows builds can degrade by up to 2 times

Copyright © 2019 by A.I.

ETH Zurich, Switzerland