[BUG] Getting started: pyflyte writes temporary folders to wrong path

[mmathys]

I ran the getting started guide step by step. When running this step, I got the following error:

$ pyflyte run example.py training_workflow --hyperparameters '{"C": 0.1}'

2023-11-13 13:51:35,577395 ERROR    {"asctime": "2023-11-13 13:51:35,577", "name": "flytekit", "levelname": "ERROR", "message": "Failed to convert outputs of task 'example.get_data' at position 0:\n  [Errno 2] Failed to open local file                                                  base_task.py:552
                                    '/var/folders/7s/8m2jxgtx3qjfd2rd7hgkt22w0000gn/T/flyte-lga24ee9/raw/96539807f90c950386133827f5e44658/00000'. Detail: [errno 2] No such file or directory"}                                                                                                              
Failed with Unknown Exception <class 'TypeError'> Reason: Encountered error while executing workflow 'example.training_workflow':
  Error encountered while executing 'training_workflow':
  Failed to convert outputs of task 'example.get_data' at position 0:
  [Errno 2] Failed to open local file '/var/folders/7s/8m2jxgtx3qjfd2rd7hgkt22w0000gn/T/flyte-lga24ee9/raw/96539807f90c950386133827f5e44658/00000'. Detail: [errno 2] No such file or directory
Encountered error while executing workflow 'example.training_workflow':
  Error encountered while executing 'training_workflow':
  Failed to convert outputs of task 'example.get_data' at position 0:
  [Errno 2] Failed to open local file '/var/folders/7s/8m2jxgtx3qjfd2rd7hgkt22w0000gn/T/flyte-lga24ee9/raw/96539807f90c950386133827f5e44658/00000'. Detail: [errno 2] No such file or directory

The folders were not found, because flytectl writes the folders to the local directory with an incorrect file: prefix:

Is this issue known? Thanks! The same happens when I make the necessary configurations and run the file without pyflyte (like python example.py)

I am using zsh with macOS Somona 14.1, Python 3.11

[welcome]

Thank you for opening your first issue here! 🛠

[samhita-alla]

hi @mmathys! Could you downgrade your fsspec to < 2023.10.0?

[cristiprg]

@samhita-alla I had the same issue, tried with downgraded fsspec but don't think it worked because I cannot see my execution in the UI.

❯ pip3 install fsspec==2023.9.2
Collecting fsspec==2023.9.2
  Downloading fsspec-2023.9.2-py3-none-any.whl (173 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 173.4/173.4 kB 6.0 MB/s eta 0:00:00
Installing collected packages: fsspec
  Attempting uninstall: fsspec
    Found existing installation: fsspec 2023.10.0
    Uninstalling fsspec-2023.10.0:
      Successfully uninstalled fsspec-2023.10.0
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
gcsfs 2023.10.0 requires fsspec==2023.10.0, but you have fsspec 2023.9.2 which is incompatible.
s3fs 2023.10.0 requires fsspec==2023.10.0, but you have fsspec 2023.9.2 which is incompatible.
Successfully installed fsspec-2023.9.2

[notice] A new release of pip is available: 23.0.1 -> 23.3.1
[notice] To update, run: python3.11 -m pip install --upgrade pip

~/Work/flyte via  v3.11.4 took 2s
❯ pip3 show fsspec
Name: fsspec
Version: 2023.9.2
Summary: File-system specification
Home-page: https://github.com/fsspec/filesystem_spec
Author:
Author-email:
License: BSD
Location: /opt/homebrew/lib/python3.11/site-packages
Requires:
Required-by: adlfs, flytekit, gcsfs, s3fs

~/Work/flyte via  v3.11.4
❯ pyflyte run example_fyte.py training_workflow --hyperparameters '{"C": 0.1}'
Running Execution on local.
LogisticRegression(C=0.1, max_iter=3000)

~/Work/flyte via  v3.11.4 took 18s
❯

Opening the web UI Console shows no workflow/task/execution so I suspect something failed silently 🤔