Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

did not generate excel file #21

Open
munishase opened this issue Jul 10, 2019 · 2 comments
Open

did not generate excel file #21

munishase opened this issue Jul 10, 2019 · 2 comments

Comments

@munishase
Copy link

after setting up all as per instructions, it seems ran well, but did not generate the excel. because it remain schema & state. I tried to change state to record by manually but then it gives error. below is the response when I ran the provided code, I just print additional logger.info(message_type)

INFO Replicating exchange rate data from exchangeratesapi.io starting from 2019-07-10
INFO SCHEMA
INFO {'start_date': '2019-07-10'}
INFO STATE
{"start_date": "2019-07-10"}

@joaopcoelho
Copy link

I have the same issue. Setting both tap and target as explained in this repo's readme and running ~/.virtualenvs/tap-exchangeratesapi/bin/tap-exchangeratesapi | ~/.virtualenvs/target-csv/bin/target-csv results in:

INFO Sending version information to singer.io. To disable sending anonymous usage data, set the config parameter "disable_collection" to true
INFO Replicating exchange rate data from exchangeratesapi.io starting from 2019-08-07
INFO Tap exiting normally
{"start_date": "2019-08-07"}

Looking a the target-csv code, it seems the expected CSV file is created when a message of type "RECORD" is passed. But when running the tap only (without piping to the target-csv), there doesn't seem to be any "RECORD" message present. This is the output when running ~/.virtualenvs/tap-exchangeratesapi/bin/tap-exchangeratesapi:

INFO Replicating exchange rate data from exchangeratesapi.io starting from 2019-08-07
{"type": "SCHEMA", "stream": "exchange_rate", "schema": {"type": "object", "properties": {"date": {"type": "string", "format": "date-time"}}, "additionalProperties": true}, "key_properties": ["date"]}
{"type": "STATE", "value": {"start_date": "2019-08-07"}}
INFO Tap exiting normally

So maybe this is an issue with the tap rather than the target. In any case, sharing here since the problem had been brought up already. Any thoughts on how to get this to work are appreciated :)

@joaopcoelho
Copy link

joaopcoelho commented Aug 7, 2019

So the problem here was that a configuration file is required for the tap. Doing

.virtualenvs/tap-exchangeratesapi/bin/tap-exchangeratesapi -c config.json | .virtualenvs/target-csv/bin/target-csv

worked, where config.json is a copy of the sample in the tap-exchangeratesapi repo.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants