What is Gemini? Generic Model Parallel Instrumentation
What way to work we proposed a IMPACT method, named Instrumenting Model Parallel with Automated Code Transformations. Play with python AST modules.
Generic AST transformer for Enflame Model Parallel Runner source code --> AST --> MLIR --> Transform for MP --> Round-trip back to AST --> native path to the SW stack