You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
c071271
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Reactant.jl Benchmarks
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :after_enzyme)
1346072366
ns1326790352
ns1.01
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant
1329447509
ns1363362852
ns0.98
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :before_enzyme)
1307398450
ns1264158724
ns1.03
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :only_enzyme)
2616692459
ns2512944686
ns1.04
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Lux
220907885
ns208866219
ns1.06
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :after_enzyme)
7159620815
ns6203466975
ns1.15
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant
5148165106
ns5277032832
ns0.98
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :before_enzyme)
5116900190
ns5437726666
ns0.94
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :only_enzyme)
6688643556
ns7202793079
ns0.93
ViT base (256 x 256 x 3 x 32)/forward/CPU/Lux
33451876662
ns30686367467
ns1.09
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :after_enzyme)
1543361668
ns1548259631
ns1.00
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant
1296707129.5
ns1293145577
ns1.00
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :before_enzyme)
1314183460.5
ns1337591055.5
ns0.98
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :only_enzyme)
2540794836
ns2595368361
ns0.98
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Lux
8640674
ns8732091
ns0.99
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :after_enzyme)
1570842065
ns1617855952
ns0.97
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant
1571704575
ns1614775455
ns0.97
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :before_enzyme)
1566452731
ns1588884622
ns0.99
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :only_enzyme)
2748308764
ns2866251207
ns0.96
ViT small (256 x 256 x 3 x 4)/forward/CPU/Lux
2904831857
ns2293819764
ns1.27
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :after_enzyme)
1271376697.5
ns1300327322
ns0.98
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant
1292114763
ns1315833068.5
ns0.98
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :before_enzyme)
1287030291.5
ns1292237616
ns1.00
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :only_enzyme)
2688383854
ns2562151867
ns1.05
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Lux
22713679.5
ns22724451
ns1.00
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :after_enzyme)
2126498296
ns2206811606
ns0.96
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant
2152227554
ns2274548394
ns0.95
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :before_enzyme)
2115369108
ns2223046136
ns0.95
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :only_enzyme)
3347806867
ns3510804330
ns0.95
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Lux
6364245448
ns5720188106.5
ns1.11
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :after_enzyme)
1325175460
ns1256821950.5
ns1.05
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant
1300015882.5
ns1288170988
ns1.01
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :before_enzyme)
1305493220
ns1367705731.5
ns0.95
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :only_enzyme)
2607501634
ns2729390029
ns0.96
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Lux
7033888
ns7144976
ns0.98
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :after_enzyme)
1463105950
ns1457145407
ns1.00
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant
1451403205
ns1449213894
ns1.00
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :before_enzyme)
1425460590
ns1453063995
ns0.98
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :only_enzyme)
2668761981
ns2689643346
ns0.99
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Lux
1096721461
ns1312702814
ns0.84
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :after_enzyme)
1311636450
ns1311294949.5
ns1.00
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant
1337267407
ns1329881753
ns1.01
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :before_enzyme)
1347845402.5
ns1290636649
ns1.04
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :only_enzyme)
2884646614
ns2612367052
ns1.10
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Lux
12312923
ns12328771
ns1.00
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :after_enzyme)
1729459837
ns1758712756
ns0.98
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant
1726720273
ns1757425385
ns0.98
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :before_enzyme)
1727102285
ns1735235563
ns1.00
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :only_enzyme)
2966098081
ns3025181128
ns0.98
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Lux
3508350121
ns2744388846
ns1.28
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :after_enzyme)
1322022902
ns1329494416
ns0.99
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant
1285772923
ns1315875781
ns0.98
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :before_enzyme)
1305829828.5
ns1273853570
ns1.03
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :only_enzyme)
2620764003
ns2397785960
ns1.09
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Lux
27355686
ns27299308
ns1.00
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :after_enzyme)
2213433122
ns2231661762
ns0.99
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant
2197052471
ns2228700161
ns0.99
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :before_enzyme)
2180243964
ns2215196278
ns0.98
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :only_enzyme)
3427813806
ns3518199375
ns0.97
ViT small (256 x 256 x 3 x 16)/forward/CPU/Lux
5437385449.5
ns6951126916
ns0.78
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :after_enzyme)
1271922231
ns1313658125
ns0.97
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant
1265911189
ns1209300000
ns1.05
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :before_enzyme)
1321677112.5
ns1289065003
ns1.03
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :only_enzyme)
2573788194
ns2580296701
ns1.00
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Lux
52828053.5
ns52804211
ns1.00
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :after_enzyme)
2988327264
ns3039672304
ns0.98
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant
2979341995
ns3081374573
ns0.97
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :before_enzyme)
2989964585
ns3055647227
ns0.98
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :only_enzyme)
4306275320
ns4441886641
ns0.97
ViT small (256 x 256 x 3 x 32)/forward/CPU/Lux
11352990940
ns9554521564
ns1.19
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :after_enzyme)
1263156495
ns1220435809
ns1.04
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant
1245875427
ns1258545982
ns0.99
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :before_enzyme)
1262324857.5
ns1279515211
ns0.99
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :only_enzyme)
2528756885
ns2543547035
ns0.99
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Lux
70902097.5
ns71048313
ns1.00
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :after_enzyme)
3144430262
ns3328025653
ns0.94
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant
3135646302
ns3733324934
ns0.84
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :before_enzyme)
3120408939
ns3424995362
ns0.91
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :only_enzyme)
4465736172
ns4557583299
ns0.98
ViT base (256 x 256 x 3 x 16)/forward/CPU/Lux
12927829683
ns14822133310
ns0.87
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :after_enzyme)
1251790538
ns1217458774
ns1.03
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant
1229488589
ns1284792522.5
ns0.96
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :before_enzyme)
1247143102
ns1286126304
ns0.97
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :only_enzyme)
2564237277
ns2557926161
ns1.00
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Lux
20781327
ns20801582.5
ns1.00
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :after_enzyme)
1852976170
ns1859646875
ns1.00
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant
1867441413
ns1856108900
ns1.01
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :before_enzyme)
1854228561
ns1847421552
ns1.00
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :only_enzyme)
3063066781
ns3058721860
ns1.00
ViT base (256 x 256 x 3 x 4)/forward/CPU/Lux
3181672566
ns3441868405
ns0.92
This comment was automatically generated by workflow using github-action-benchmark.