Phones | Mobile SoCs Deep Learning Ranking Desktop GPUs and CPUs
Model TF Version Cores Frequency, GHz Acceleration Platform RAM, GB Year Inference
Score
Training
Score
AI-Score
Tesla V1001.13.15120 (CUDA)1.23 / 1.38CUDA 10Ubuntu 16.043220181600416770 32774
GeForce RTX 2080 Ti (1)1.15.04352 (CUDA)1.35 / 1.55CUDA 10.1Debian 101120181562816439 32067
GeForce RTX 2080 Ti (2)2.0.04352 (CUDA)1.35 / 1.55CUDA 10Ubuntu 18.041120181464715824 30471
TITAN RTX1.13.14608 (CUDA)1.35 / 1.77CUDA 10Ubuntu 16.042420181503315420 30453
Quadro RTX 60001.14.04608 (CUDA)1.44 / 1.77CUDA 10Debian 9.92420181450415067 29570
GeForce RTX 2080 SUPER1.12.03072 (CUDA)1.65 / 1.82CUDA 10Debian 10820191261712897 25514
TITAN Xp1.13.13840 (CUDA)1.41 / 1.58CUDA 10Ubuntu 19.101220171216212813 24975
GeForce RTX 20801.15.02944 (CUDA)1.52 / 1.71CUDA 10Ubuntu 18.04820181154012527 24067
GeForce RTX 2070 SUPER (1)1.15.02560 (CUDA)1.61 / 1.77CUDA 10Ubuntu 18.04820191125512604 23859
GeForce GTX 1080 Ti (1)1.13.13584 (CUDA)1.58 / 1.60CUDA 10.2Debian 101120171141611438 22854
Tesla P1001.15.03584 (CUDA)1.19 / 1.33CUDA 10Ubuntu 18.041620161044611716 22163
GeForce RTX 2070 SUPER (2)1.14.02560 (CUDA)1.61 / 1.77CUDA 10Windows 10820191013711073 21210
GeForce RTX 2060 SUPER1.15.02176 (CUDA)1.47 / 1.65CUDA 10Ubuntu 18.0482019987810890 20768
TITAN X Pascal1.8.03584 (CUDA)1.42 / 1.53CUDA 9Debian 9.91220161010710437 20544
GeForce GTX 1080 Ti (2)2.0.0-beta13584 (CUDA)1.58 / 1.60CUDA 10.2Ubuntu 18.041120171025410207 20460
GeForce GTX 1080 Ti (3)1.13.13584 (CUDA)1.58 / 1.60CUDA 10Debian 9.91120171011310312 20425
TITAN Xp CE1.12.03840 (CUDA)1.41 / 1.58CUDA 9Debian 9.9122017106639440 20103
GeForce RTX 20701.13.12304 (CUDA)1.41 / 1.62CUDA 10Windows 108201888939992 18885
Tesla P401.14.03840 (CUDA)1.30 / 1.53CUDA 10Ubuntu 18.0424201692218785 18006
Quadro RTX 40001.14.02304 (CUDA)1.01 / 1.55CUDA 10Windows 108201881889414 17601
GeForce RTX 20601.14.01920 (CUDA)1.37 / 1.75CUDA 10Ubuntu 18.046201983949046 17440
GeForce GTX 10801.15.02560 (CUDA)1.61 / 1.73CUDA 10Ubuntu 18.048201683918954 17345
GeForce RTX 2070 Max-Q1.14.02304 (CUDA)0.89 / 1.19CUDA 10Windows 108201970707922 14991
GeForce GTX TITAN X1.14.03072 (CUDA)1.00 / 1.09CUDA 10Debian 1012201573777394 14771
GeForce GTX 10701.14.01920 (CUDA)1.51 / 1.68CUDA 10Debian 108201670977439 14536
Tesla T4 (1)1.15.02560 (CUDA)0.59 / 1.59CUDA 10Ubuntu 18.0416201867767539 14315
GeForce GTX 1660 Ti1.8.01536 (CUDA)1.50 / 1.77CUDA 9Windows 106201959008059 13959
Tesla T4 (2)1.14.02560 (CUDA)0.59 / 1.59CUDA 10Ubuntu 18.0416201863687161 13529
Tesla P41.15.02560 (CUDA)0.89 / 1.11CUDA 10Ubuntu 18.048201653445712 11056
GeForce GTX 10601.14.01280 (CUDA)1.51 / 1.71CUDA 10Debian 106201651385642 10780
GeForce GTX 1060 Laptop1.13.11280 (CUDA)1.40 / 1.67CUDA 10Windows 106201650005425 10425
Quadro P20001.14.01024 (CUDA)1.08 / 1.48CUDA 10Ubuntu 18.045201739004379 8280
GeForce GTX 1050 Ti (1)1.15.0768 (CUDA)1.29 / 1.39CUDA 10Ubuntu 18.044201632313780 7010
GeForce GTX 1050 Ti (2)1.14.0768 (CUDA)1.29 / 1.39CUDA 10Ubuntu 18.044201631223583 6704
GeForce GTX 1050 Ti Laptop1.14.0768 (CUDA)1.49 / 1.62CUDA 10Ubuntu 18.044201730763522 6598
Tesla K801.14.02496 x 2 (CUDA)0.56 / 0.82CUDA 10Ubuntu 18.0412 x 2201428903458 6348
Tesla K40c1.12.02880 (CUDA)0.75 / 0.88CUDA 9Debian 9.912201327773359 6136
GeForce GTX 9601.14.01024 (CUDA)1.13 / 1.18CUDA 10Ubuntu 18.044201529263203 6129
Quadro P4200 Mobile1.14.02304 (CUDA)1.23 / 1.65CUDA 10Debian 108201824732949 5422
GeForce GTX 1050 Laptop1.13.2640 (CUDA)1.35 / 1.49CUDA 10Ubuntu 18.044201724292944 5373
Quadro M2000M (1)1.14.0640 (CUDA)1.04 / 1.20CUDA 10Fedora 304201518822211 4093
Quadro M2000M (2)1.15.0640 (CUDA)1.04 / 1.20CUDA 10Windows 104201518372095 3996
Quadro M2000M (3)1.14.0640 (CUDA)1.04 / 1.20CUDA 10Windows 104201518432123 3966
Quadro M2000M (4)2.0.0640 (CUDA)1.04 / 1.20CUDA 10Windows 104201518372095 3932
Intel Core i9-7940X1.14.014 / 28 Threads3.1 / 4.3Intel MKLDebian 1132201719631505 3468
Intel Xeon E5-2699 v41.14.022 / 44 Threads2.2 / 3.6Intel MKLDebian 10.1256201620291294 3323
Intel Xeon Gold 62481.14.020 / 40 Threads2.5 / 3.9Intel MKLUbuntu 16.04192201919511300 3251
Intel Xeon E5-2698 v41.14.020 / 40 Threads2.2 / 3.6Intel MKLUbuntu 18.04512201617641236 3000
Intel Xeon Gold 62521.14.024 / 48 Threads2.1 / 3.7Intel MKLUbuntu 16.04384201918101156 2966
Intel Xeon Gold 62301.14.020 / 40 Threads2.1 / 3.9Intel MKLUbuntu 18.04512201917771065 2842
GeForce GT 10301.12.0384 (CUDA)1.23 / 1.47CUDA 9Debian 9.922017137502750 1
Intel Xeon E5-2620 v4 x 2 (1)1.14-Conda12 / 24 Threads2.1 / 3.0Intel MKLDebian 9.916201611081461 2569
Intel Core i7-9700K1.14-Conda8 / 8 Threads3.6 / 4.9Intel MKLDebian 9.932201810381442 2480
Intel Xeon Gold 61341.15.08 / 16 Threads3.2 / 3.7Intel MKLUbuntu 18.0422201712731204 2477
Intel Core i9-9900K1.14.08 / 16 Threads3.6 / 5.0Intel MKLUbuntu 19.1032201812301172 2402
Intel Core i7-9700KF1.14.08 / 8 Threads3.6 / 4.9Intel MKLUbuntu 18.0464201912041099 2303
AMD Threadripper 2990WX1.15.032 / 64 Threads3.0 / 4.2Intel MKLDebian 106420181251935 2186
AMD Ryzen 9 3900X1.14.012 / 24 Threads3.8 / 4.6Intel MKLDebian 103220191204967 2171
Intel Core i7-87001.14-Conda6 / 12 Threads3.2 / 4.6Intel MKLDebian 9.93220178471178 2025
Intel Core i7-8086K1.14.06 / 12 Threads4.0 / 5.0Intel MKLDebian 9.93220181009992 2001
Intel Core i7-9700F1.15.08 / 8 Threads3.0 / 4.7Intel MKLDebian 10322019952976 1928
AMD Ryzen 5 36001.14.06 / 12 Threads3.6 / 4.2Intel MKLUbuntu 16.04162019990915 1905
Intel Xeon E5-2620 v4 x 2 (2)1.14.012 / 24 Threads2.1 / 3.0Intel MKLDebian 9.9162016968873 1841
Intel Xeon D-2183IT1.14.012 / 24 Threads2.1 / 3.0Intel MKLCentOS 7.62562018938831 1769
Intel Xeon Gold 62341.14.08 / 16 Threads3.3 / 4.0Intel MKLCentOS 7.53220191010746 1756
Intel Xeon Silver 41142.0.0-beta110 / 20 Threads2.2 / 3.0Intel MKLUbuntu 18.042562017925774 1699
Intel Core i7-7700K1.14.04 / 8 Threads4.2 / 4.5Intel MKLDebian 9.9322017759809 1568
Intel Core i5-84002.0.0-alpha06 / 6 Threads2.8 / 4.0Intel MKLUbuntu 16.04162017741742 1483
Intel Core i9-9880H1.14.08 / 16 Threads2.3 / 4.8Intel MKLDebian 10162019786685 1471
Intel Core i7-9750H1.14.06 / 12 Threads2.5 / 4.5Intel MKLDebian 10642019689773 1462
Intel Core i7-6700K (1)1.14-Conda4 / 8 Threads4.0 / 4.2Intel MKLDebian 9.9322015608840 1448
AMD Ryzen 7 3700X1.14.08 / 16 Threads3.6 / 4.4Intel MKLWindows 10322019774647 1421 5
Intel Core i7-6700K (2)2.1.0-rc14 / 8 Threads4.0 / 4.2Intel MKLDebian 9.11322015655699 1413
Intel Core i7-4790K1.14-Conda4 / 8 Threads4.0 / 4.4Intel MKLDebian 9.9162014582818 1400
Intel Xeon Silver 42151.14.08 / 16 Threads2.5 / 3.5Intel MKLUbuntu 18.04322019717657 1374
Intel Core i7-6700K (3)1.14.04 / 8 Threads4.0 / 4.2Intel MKLDebian 9.9322015655699 1354
Intel Xeon E5-2603 v4 x 21.14.012 / 12 Threads1.7 / 1.7Intel MKLCentOS 7.51282016695601 1296
Intel Core i7-8850H1.14.06 / 12 Threads2.6 / 4.3Intel MKLUbuntu 18.04322018655639 1294
Intel Xeon E5-2650 v21.14.08 / 16 Threads2.6 / 3.4Intel MKLDebian-stretch1282013653603 1256
Intel Xeon E5-2620 v31.14.06 / 12 Threads2.4 / 3.2Intel MKLDebian 10242014614640 1254
Intel Core i7-6700K (4)2.0.04 / 8 Threads4.0 / 4.2Intel MKLDebian 9.11322013577664 1241
Intel Core i5-74001.14.04 / 4 Threads3.0 / 3.5Intel MKLUbuntu 18.04322017564625 1189
Intel Core i7-4770K1.14.04 / 8 Threads3.5 / 3.9Intel MKLDebian 9.9162013566587 1152
Intel Core i5-65001.15.04 / 4 Threads3.2 / 3.6Intel MKLDebian 10162015554597 1151
Intel Xeon E3-1505M v5 (1)1.14-Conda4 / 8 Threads2.8 / 3.7Intel MKLFedora 30162015449676 1125
AMD Ryzen 5 26001.14.06 / 12 Threads3.4 / 3.9Intel MKLElementary 5.1322018523585 1108
Intel Core i7-6700K (5)2.0.0-Intel4 / 8 Threads4.0 / 4.2Intel MKLDebian 9.11322013529562 1091
AMD Ryzen 7 17001.14.08 / 16 Threads3.0 / 3.7Intel MKLUbuntu 18.04642017530557 1087
Intel Xeon W-2150B1.14.010 / 20 Threads3.0 / 4.5Intel MKLmacOS Mojave642017526547 1073
Intel Core i3-81001.14.04 / 4 Threads3.6 / 3.6Intel MKLUbuntu 18.04162017539524 1062
Intel Xeon E3-1505M v5 (2)1.14.04 / 8 Threads2.8 / 3.7Intel MKLFedora 30162015423527 950
Intel Core i7-3930K1.14.06 / 12 Threads3.2 / 3.8Intel MKLGentoo (4.20)322011390492 882
Intel Core i7-8550U1.14.04 / 8 Threads1.8 / 4.0Intel MKLUbuntu 18.04162017374460 834
Intel Core i7-6700K (6)1.12.04 / 8 Threads4.0 / 4.2AVXDebian 9.9322013330460 790
Intel Core i7-8565U1.14.04 / 8 Threads1.8 / 4.6Intel MKLDebian 1082018335422 757
Intel Core i7-6700K (7)1.13.1-Intel4 / 8 Threads4.0 / 4.2Intel MKLDebian 9.9322013358353 711
Intel Core i5-44601.14.04 / 4 Threads3.2 / 3.4Intel MKLWindows 10162014371278 649 5
Intel Core i3-71001.14.02 / 4 Threads3.9 / 3.9Intel MKLUbuntu 16.04642017276344 620
Intel Core i7-3770K1.14-Conda4 / 8 Threads3.5 / 3.9Intel MKLDebian 9.9162012273339 612
Intel Xeon E3-1505M v5 (3)1.14.04 / 8 Threads2.8 / 3.7Intel MKLWindows 10162015313299 612 5
Intel Core i7-8559U1.14.04 / 8 Threads2.7 / 4.5Intel MKLmacOS Mojave162018205400 605
Intel Core i7-2600K1.14.04 / 8 Threads3.4 / 3.8Intel MKLDebian 9.9162011251316 566
Intel Core i7-2700K1.14-Conda4 / 8 Threads3.5 / 3.9Intel MKLDebian 9.9162011259307 566
Intel Xeon E3-1505M v5 (4)2.0.0-Conda4 / 8 Threads2.8 / 3.7Intel MKLWindows 10162015197367 564 5
Intel Xeon E3-1505M v5 (5)2.0.04 / 8 Threads2.8 / 3.7Intel MKLWindows 10162015240278 518 5
AMD Ryzen 3 12001.14.04 / 4 Threads3.8Intel MKLWindows 1082017288214 502 5
Intel Core i7-6700K (8)1.5.04 / 8 Threads4.0 / 4.2no AVXDebian 9.9322013186300 486
GeForce GT 7101.12.096 (CUDA)0.78 / 0.80CUDA 9Debian 9.9220132350470 1
Intel Xeon E3-1505M v5 (6)1.13.14 / 8 Threads2.8 / 3.7AVXWindows 10162015173205 378 5
Intel Core i7-9501.14-Conda4 / 8 Threads3.06 / 3.33Intel MKLDebian 9.9162009133195 328
Intel Core i7-9501.5.04 / 8 Threads3.06 / 3.33no AVXDebian 9.9162009111182 293
Intel Core i7-9301.5.04 / 8 Threads2.80 / 3.06no AVXDebian 9.9162010110178 288
Zhaoxin KaiXian KX-U6780A1.14.08 / 8 Threads2.7 / 2.7Intel MKLUbuntu 18.0416201893127 220
Intel Core i5-3437U1.14.02 / 4 Threads1.9 / 2.9Intel MKLWindows 101620139298 190 5
Intel Core i3-6006U1.14.02 / 4 Threads2.0 / 2.0Intel MKLWindows 108201611070 180 5

1  -  The final AI Score for this device was estimated based on its inference score

2  -  The final AI Score for this device was estimated based on its training score

3  -  This device might be using unofficial / prototype hardware or drivers

4  -  These are the results of an early prototype. The results of the commercial device might be different

5  -  Due to the issues with multithreading, the performance of TensorFlow Windows builds can degrade by up to 2 times

Copyright © 2020 by A.I.

ETH Zurich, Switzerland