Skip to content

Commit

Permalink
Fixed problem apriori
Browse files Browse the repository at this point in the history
  • Loading branch information
piconti committed May 30, 2024
1 parent edf7769 commit 523f52c
Show file tree
Hide file tree
Showing 5 changed files with 14 additions and 6 deletions.
Binary file modified docs/_build/doctrees/environment.pickle
Binary file not shown.
Binary file modified docs/_build/doctrees/versioning.doctree
Binary file not shown.
16 changes: 12 additions & 4 deletions docs/_build/html/versioning.html
Original file line number Diff line number Diff line change
Expand Up @@ -1667,11 +1667,19 @@ <h1>Data Versioning<a class="headerlink" href="#data-versioning" title="Link to
<dt><kbd><span class="option">--config-file=<var>&lt;cf&gt;</var></span></kbd></dt>
<dd><p>Path to configuration json file containing all necessary arguments for the computation of the manifest.</p>
</dd>
<dt><kbd><span class="option">--log-file=<var>&lt;lf&gt;</var></span></kbd></dt>
<dd><p>Path to log file to use.</p>
</dd>
<dt><kbd><span class="option">--scheduler=<var>&lt;sch&gt;</var></span></kbd></dt>
<dd><p>Tell dask to use an existing scheduler (otherwise it’ll create one)</p>
</dd>
<dt><kbd><span class="option">--nworkers=<var>&lt;nw&gt;</var></span></kbd></dt>
<dd><p>number of workers for (local) Dask client.</p>
</dd>
<dt><kbd><span class="option">--verbose</span></kbd></dt>
<dd><p>Set logging level to DEBUG (by default is INFO).</p>
</dd>
</dl>
<p>–log-file=&lt;lf&gt; Path to log file to use.
–scheduler=&lt;sch&gt; Tell dask to use an existing scheduler (otherwise it’ll create one)
–nworkers=&lt;nw&gt; number of workers for (local) Dask client.
–verbose Set logging level to DEBUG (by default is INFO).</p>
<dl class="py function">
<dt class="sig sig-object py" id="impresso_commons.versioning.compute_manifest.compute_stats_for_stage">
<span class="sig-prename descclassname"><span class="pre">impresso_commons.versioning.compute_manifest.</span></span><span class="sig-name descname"><span class="pre">compute_stats_for_stage</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">files_bag</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">Bag</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">stage</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><a class="reference internal" href="#impresso_commons.versioning.helpers.DataStage" title="impresso_commons.versioning.helpers.DataStage"><span class="pre">DataStage</span></a></span></em>, <em class="sig-param"><span class="n"><span class="pre">client</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">Client</span><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </span><span class="pre">None</span></span><span class="w"> </span><span class="o"><span class="pre">=</span></span><span class="w"> </span><span class="default_value"><span class="pre">None</span></span></em><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">&#x2192;</span> <span class="sig-return-typehint"><span class="pre">list</span><span class="p"><span class="pre">[</span></span><span class="pre">dict</span><span class="p"><span class="pre">]</span></span><span class="w"> </span><span class="p"><span class="pre">|</span></span><span class="w"> </span><span class="pre">None</span></span></span><a class="headerlink" href="#impresso_commons.versioning.compute_manifest.compute_stats_for_stage" title="Link to this definition"></a></dt>
Expand Down
2 changes: 1 addition & 1 deletion impresso_commons/versioning/compute_manifest.py
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@
Options:
--config-file=<cf> Path to configuration json file containing all necessary arguments for the computation of the manifest.
--log-file=<lf> Path to log file to use.
--log-file=<lf> Path to log file to use.
--scheduler=<sch> Tell dask to use an existing scheduler (otherwise it'll create one)
--nworkers=<nw> number of workers for (local) Dask client.
--verbose Set logging level to DEBUG (by default is INFO).
Expand Down
2 changes: 1 addition & 1 deletion impresso_commons/versioning/data_manifest.py
Original file line number Diff line number Diff line change
Expand Up @@ -995,7 +995,7 @@ def compute(
- Compute the new version based on the performed updates.
- Define the `manifest_data` attribute corresponding to the final manifest.
- Optionally, dump it to JSON, export it to S3 and Git.
Args:
export_to_git_and_s3 (bool, optional): Whether to export the final
`manifest_data` as JSON to S3 and GitHub. Defaults to True. If False,
Expand Down

0 comments on commit 523f52c

Please sign in to comment.