Skip to content

Commit

Permalink
Update doc from commit d205f9d
Browse files Browse the repository at this point in the history
  • Loading branch information
torchxlabot2 committed Mar 18, 2024
1 parent 04de226 commit d649d38
Show file tree
Hide file tree
Showing 14 changed files with 13 additions and 23 deletions.
2 changes: 1 addition & 1 deletion master/_modules/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,7 @@


<div class="version">
master (2.3.0+gitf04870e )
master (2.3.0+gitd205f9d )
</div>


Expand Down
2 changes: 1 addition & 1 deletion master/_modules/torch_xla/core/functions.html
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,7 @@


<div class="version">
master (2.3.0+gitf04870e )
master (2.3.0+gitd205f9d )
</div>


Expand Down
2 changes: 1 addition & 1 deletion master/_modules/torch_xla/core/xla_model.html
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,7 @@


<div class="version">
master (2.3.0+gitf04870e )
master (2.3.0+gitd205f9d )
</div>


Expand Down
2 changes: 1 addition & 1 deletion master/_modules/torch_xla/distributed/parallel_loader.html
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,7 @@


<div class="version">
master (2.3.0+gitf04870e )
master (2.3.0+gitd205f9d )
</div>


Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,7 @@


<div class="version">
master (2.3.0+gitf04870e )
master (2.3.0+gitd205f9d )
</div>


Expand Down
2 changes: 1 addition & 1 deletion master/_modules/torch_xla/utils/serialization.html
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,7 @@


<div class="version">
master (2.3.0+gitf04870e )
master (2.3.0+gitd205f9d )
</div>


Expand Down
2 changes: 1 addition & 1 deletion master/_modules/torch_xla/utils/utils.html
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,7 @@


<div class="version">
master (2.3.0+gitf04870e )
master (2.3.0+gitd205f9d )
</div>


Expand Down
2 changes: 1 addition & 1 deletion master/genindex.html
Original file line number Diff line number Diff line change
Expand Up @@ -226,7 +226,7 @@


<div class="version">
master (2.3.0+gitf04870e )
master (2.3.0+gitd205f9d )
</div>


Expand Down
12 changes: 1 addition & 11 deletions master/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,7 @@


<div class="version">
master (2.3.0+gitf04870e )
master (2.3.0+gitd205f9d )
</div>


Expand Down Expand Up @@ -2659,11 +2659,6 @@ <h3>Integration<a class="headerlink" href="#integration" title="Permalink to thi
<span class="nb">print</span><span class="p">(</span><span class="n">compiled_code</span><span class="p">(</span><span class="n">torch</span><span class="o">.</span><span class="n">randn</span><span class="p">(</span><span class="mi">10</span><span class="p">),</span> <span class="n">torch</span><span class="o">.</span><span class="n">randn</span><span class="p">(</span><span class="mi">10</span><span class="p">)))</span>
</pre></div>
</div>
<p>Currently there are two different backends, that eventually will be merged into a single ‘openxla’ backend:</p>
<ul class="simple">
<li><p><code class="docutils literal notranslate"><span class="pre">backend='openxla'</span></code> - Useful for training.</p></li>
<li><p><code class="docutils literal notranslate"><span class="pre">backend='openxla_eval'</span></code> - Useful for inference.</p></li>
</ul>
</div>
<div class="section" id="inference">
<h3>Inference<a class="headerlink" href="#inference" title="Permalink to this headline"></a></h3>
Expand Down Expand Up @@ -2695,11 +2690,6 @@ <h3>Inference<a class="headerlink" href="#inference" title="Permalink to this he
squeezenet1_1 | 2.29
timm_vision_transformer | 3.52
geomean | 3.04</p>
<p>Note</p>
<ol class="arabic simple">
<li><p>User will likely see better inference performance by putting the inference execution in a <code class="docutils literal notranslate"><span class="pre">torch.no_grad</span></code> context. <code class="docutils literal notranslate"><span class="pre">openxla</span></code> is an <code class="docutils literal notranslate"><span class="pre">aot-autograd</span></code> backend of <code class="docutils literal notranslate"><span class="pre">torch.compile</span></code>; <code class="docutils literal notranslate"><span class="pre">aot-autograd</span></code> attempts to save some state for a potential backward pass. Setting <code class="docutils literal notranslate"><span class="pre">torch.no_grad</span></code> helps <code class="docutils literal notranslate"><span class="pre">aot-autograd</span></code> understand that it is being executed in an inference context.</p></li>
<li><p>User can also use the <code class="docutils literal notranslate"><span class="pre">openxla_eval</span></code> backend directly without <code class="docutils literal notranslate"><span class="pre">torch.no_grad</span></code>, since <code class="docutils literal notranslate"><span class="pre">openxla_eval</span></code> is not an <code class="docutils literal notranslate"><span class="pre">aot-autograd</span></code> backend and only works for inference.</p></li>
</ol>
</div>
<div class="section" id="training">
<h3>Training<a class="headerlink" href="#training" title="Permalink to this headline"></a></h3>
Expand Down
2 changes: 1 addition & 1 deletion master/notes/source_of_recompilation.html
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,7 @@


<div class="version">
master (2.3.0+gitf04870e )
master (2.3.0+gitd205f9d )
</div>


Expand Down
Binary file modified master/objects.inv
Binary file not shown.
2 changes: 1 addition & 1 deletion master/py-modindex.html
Original file line number Diff line number Diff line change
Expand Up @@ -228,7 +228,7 @@


<div class="version">
master (2.3.0+gitf04870e )
master (2.3.0+gitd205f9d )
</div>


Expand Down
2 changes: 1 addition & 1 deletion master/search.html
Original file line number Diff line number Diff line change
Expand Up @@ -225,7 +225,7 @@


<div class="version">
master (2.3.0+gitf04870e )
master (2.3.0+gitd205f9d )
</div>


Expand Down
2 changes: 1 addition & 1 deletion master/searchindex.js

Large diffs are not rendered by default.

0 comments on commit d649d38

Please sign in to comment.