Skip to content

v0.13.0-alpha.7

Pre-release
Pre-release
Compare
Choose a tag to compare
@elephantum elephantum released this 30 Jul 17:19
· 382 commits to master since this release
c085abd
  • Try to setup logging in RayExecutor (fails so far)

  • Lazy initialisation of Ray to speedup things in CLI

  • Add ExecutorConfig.parallelism parameter

  • Add name parameter to executor.run_process_batch to customize task name in ray dashboard

  • Migrate run_changelist to executor, possible parallelisation

  • Limit number of in-flight Ray tasks in one run_process_batch to 100

  • Fix batch count in tqdm in run_changelist

  • Add --start-step parameter to step run-changelist CLI

  • Move --executor parameter from datapipe step to datapipe command