Skip to content

Commit

Permalink
Update MLIR bindings regeneration workflow to include package update …
Browse files Browse the repository at this point in the history
…and precompile step
mofeing committed Oct 27, 2024
1 parent b614a45 commit e084f9e
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion .github/workflows/regenerate-mlir-bindings.yml
Original file line number Diff line number Diff line change
@@ -22,7 +22,7 @@ jobs:
run: |
import Pkg
Pkg.add("JuliaFormatter")
- run: julia --project=. -e 'using Pkg; pkg"instantiate"'
- run: julia --project=. -e 'using Pkg; pkg"instantiate"; pkg"update"; pkg"precompile"'
working-directory: ./deps/ReactantExtra
env:
JULIA_DEPOT_PATH: ${{ runner.temp }}/julia_depot

1 comment on commit e084f9e

@github-actions
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Reactant.jl Benchmarks

Benchmark suite Current: e084f9e Previous: b614a45 Ratio
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :after_enzyme) 1350735972 ns 1351952654 ns 1.00
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant 1204673780 ns 1329740254 ns 0.91
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :before_enzyme) 1222340041 ns 1313154586 ns 0.93
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :only_enzyme) 2330048189 ns 2566992420 ns 0.91
ViT base (256 x 256 x 3 x 32)/forward/CUDA/Lux 219309808 ns 221738431 ns 0.99
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :after_enzyme) 5215948763 ns 5795183922 ns 0.90
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant 6254101434 ns 5365250430 ns 1.17
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :before_enzyme) 5201734622 ns 5580309503 ns 0.93
ViT base (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :only_enzyme) 7460701472 ns 7018981334 ns 1.06
ViT base (256 x 256 x 3 x 32)/forward/CPU/Lux 30735680811 ns 32330341377 ns 0.95
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :after_enzyme) 1332885325 ns 1295393361 ns 1.03
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant 1298553637 ns 1391655239.5 ns 0.93
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :before_enzyme) 1340798546.5 ns 1288112883.5 ns 1.04
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :only_enzyme) 2364390446 ns 2580913506 ns 0.92
ViT small (256 x 256 x 3 x 4)/forward/CUDA/Lux 8812264.5 ns 8622025 ns 1.02
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :after_enzyme) 1635773422 ns 1638985456 ns 1.00
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant 1621494476 ns 1598870688 ns 1.01
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :before_enzyme) 1609772124 ns 1604887372 ns 1.00
ViT small (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :only_enzyme) 2830061683 ns 2845843527 ns 0.99
ViT small (256 x 256 x 3 x 4)/forward/CPU/Lux 2877521675 ns 3290222049 ns 0.87
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :after_enzyme) 1310197829 ns 1337995509 ns 0.98
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant 1304840979.5 ns 1266589678.5 ns 1.03
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :before_enzyme) 1238123602.5 ns 1304533265 ns 0.95
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :only_enzyme) 2594487217 ns 2619821981 ns 0.99
ViT tiny (256 x 256 x 3 x 32)/forward/CUDA/Lux 22665498 ns 22673367 ns 1.00
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :after_enzyme) 2163350638 ns 2164741585 ns 1.00
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant 2227062239 ns 2187101004 ns 1.02
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :before_enzyme) 2171553343 ns 2222453725 ns 0.98
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :only_enzyme) 3558585268 ns 3473087162 ns 1.02
ViT tiny (256 x 256 x 3 x 32)/forward/CPU/Lux 7747467151.5 ns 5922666949.5 ns 1.31
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :after_enzyme) 1283318913 ns 1409824378 ns 0.91
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant 1216591656.5 ns 1274413695 ns 0.95
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :before_enzyme) 1370999738 ns 1229630167.5 ns 1.11
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :only_enzyme) 2428504820 ns 2435178422 ns 1.00
ViT tiny (256 x 256 x 3 x 4)/forward/CUDA/Lux 7186419 ns 6720828 ns 1.07
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :after_enzyme) 1467788340 ns 1443071529 ns 1.02
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant 1449340906 ns 1455478624 ns 1.00
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :before_enzyme) 1443567043 ns 1436315353 ns 1.01
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :only_enzyme) 2702131547 ns 2698020568 ns 1.00
ViT tiny (256 x 256 x 3 x 4)/forward/CPU/Lux 1095865115 ns 1179865891 ns 0.93
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :after_enzyme) 1210758212 ns 1311903715.5 ns 0.92
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant 1233393897 ns 1208899239.5 ns 1.02
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :before_enzyme) 1225142106.5 ns 1315408397 ns 0.93
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :only_enzyme) 2374047383 ns 2622407972 ns 0.91
ViT tiny (256 x 256 x 3 x 16)/forward/CUDA/Lux 12131784 ns 12273085 ns 0.99
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :after_enzyme) 1757223123 ns 1747750553 ns 1.01
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant 1753678153 ns 1759657061 ns 1.00
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :before_enzyme) 1747793752 ns 1730465781 ns 1.01
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :only_enzyme) 3015378976 ns 2979617791 ns 1.01
ViT tiny (256 x 256 x 3 x 16)/forward/CPU/Lux 2910278832 ns 2985205457 ns 0.97
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :after_enzyme) 1322233467 ns 1205936693 ns 1.10
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant 1322254383 ns 1289931712 ns 1.03
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :before_enzyme) 1199964457 ns 1274603974.5 ns 0.94
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :only_enzyme) 2400347071 ns 2353800786 ns 1.02
ViT small (256 x 256 x 3 x 16)/forward/CUDA/Lux 27163900 ns 27361038 ns 0.99
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :after_enzyme) 2214089958 ns 2245983275 ns 0.99
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant 2239028395 ns 2235719581 ns 1.00
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :before_enzyme) 2212157343 ns 2225764215 ns 0.99
ViT small (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :only_enzyme) 3527800382 ns 3488656246 ns 1.01
ViT small (256 x 256 x 3 x 16)/forward/CPU/Lux 5811115543.5 ns 6519742812.5 ns 0.89
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :after_enzyme) 1226440738 ns 1273072927 ns 0.96
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant 1160529232.5 ns 1275903559 ns 0.91
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :before_enzyme) 1284160996.5 ns 1306679492 ns 0.98
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Reactant (optimize = :only_enzyme) 2249108448 ns 2418323014 ns 0.93
ViT small (256 x 256 x 3 x 32)/forward/CUDA/Lux 52687663 ns 52729682 ns 1.00
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :after_enzyme) 3019468880 ns 3106843960 ns 0.97
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant 3069044359 ns 3110765368 ns 0.99
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :before_enzyme) 3044926123 ns 3067530015 ns 0.99
ViT small (256 x 256 x 3 x 32)/forward/CPU/Reactant (optimize = :only_enzyme) 4458047333 ns 4512690716 ns 0.99
ViT small (256 x 256 x 3 x 32)/forward/CPU/Lux 8346217965 ns 23082341445 ns 0.36
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :after_enzyme) 1248064916 ns 1244033717 ns 1.00
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant 1265067809.5 ns 1220583584 ns 1.04
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :before_enzyme) 1274798656.5 ns 1241043964.5 ns 1.03
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Reactant (optimize = :only_enzyme) 2435701548 ns 2534565534 ns 0.96
ViT base (256 x 256 x 3 x 16)/forward/CUDA/Lux 70937902 ns 71029594 ns 1.00
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :after_enzyme) 3268589369 ns 3308971321 ns 0.99
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant 3233353228 ns 3272699344 ns 0.99
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :before_enzyme) 3264816245 ns 3281133548 ns 1.00
ViT base (256 x 256 x 3 x 16)/forward/CPU/Reactant (optimize = :only_enzyme) 4685900819 ns 4663116034 ns 1.00
ViT base (256 x 256 x 3 x 16)/forward/CPU/Lux 15059348114 ns 13237204037 ns 1.14
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :after_enzyme) 1293711217 ns 1206105557 ns 1.07
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant 1320275711 ns 1205282113 ns 1.10
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :before_enzyme) 1275143769 ns 1254093260 ns 1.02
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Reactant (optimize = :only_enzyme) 2411331594 ns 2518219292 ns 0.96
ViT base (256 x 256 x 3 x 4)/forward/CUDA/Lux 20583569 ns 20789324 ns 0.99
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :after_enzyme) 2119165721 ns 1913409296 ns 1.11
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant 2218102344 ns 1887591901 ns 1.18
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :before_enzyme) 2186413098 ns 1917404653 ns 1.14
ViT base (256 x 256 x 3 x 4)/forward/CPU/Reactant (optimize = :only_enzyme) 3188249362 ns 3181159514 ns 1.00
ViT base (256 x 256 x 3 x 4)/forward/CPU/Lux 3741883940 ns 3522016222.5 ns 1.06

This comment was automatically generated by workflow using github-action-benchmark.

Please sign in to comment.