Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SFTP error #61

Open
dantodor opened this issue Jul 10, 2023 · 0 comments
Open

SFTP error #61

dantodor opened this issue Jul 10, 2023 · 0 comments

Comments

@dantodor
Copy link

Hello!

I'm trying to use the tap within meltano to get a csv file from an sftp server.
I set up one locally with docker compose.

Config is what I understood from your examples:

      - path: sftp://testuser:testpwd@localhost//data
        name: orgs
        pattern: "organizations-100.csv"
        start_date: '2010-01-01T00:00:00Z'
        key_properties: []
        format: csv
        delimiter: ","

However, when I run meltano elt ... output is something like this

2023-07-10T08:28:43.707800Z [info     ] INFO Processing 0 selected streams from Catalog cmd_type=extractor name=tap-spreadsheets-anywhere run_id=a74db321-0bd1-443d-acf9-795731dc0543 state_id=2023-07-10T082839--tap-spreadsheets-anywhere--target-duckdb stdio=stderr

For further testing, I ran meltano invoke -d, and the result is:

meltano invoke tap-spreadsheets-anywhere -d
2023-07-10T08:37:04.440135Z [info     ] Environment 'dev' is active
ERROR Unable to write Catalog entry for 'orgs' - it will be skipped due to error 500 Unknown command.
ERROR Unable to write Catalog entry for 'orgs' - it will be skipped due to error module 'smart_open.ssh' has no attribute '_connect'
{
  "streams": []
}

NB, by using the sftp command line I have no issues on connecting and downloading the file.

What am I doing wrong?

Also, syntax for getting from ftp instead of sftp is the same, except for the name of the protocol?

Thank you!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant