Skip to content

Commit

Permalink
Disable flattening of the objects, as it will create unknown column n…
Browse files Browse the repository at this point in the history
…ames with '__' separator. HotGlue is written to use fixed_header causing all the new columns to be ignored from final CSV.
  • Loading branch information
irfan-zulfiqar committed Feb 3, 2021
1 parent c5ac655 commit 2ff517d
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion target_csv.py
Original file line number Diff line number Diff line change
Expand Up @@ -65,7 +65,8 @@ def persist_messages(delimiter, quotechar, messages, destination_path, fixed_hea
filename = os.path.expanduser(os.path.join(destination_path, filename))
file_is_empty = (not os.path.isfile(filename)) or os.stat(filename).st_size == 0

flattened_record = flatten(o['record'])
# flattened_record = flatten(o['record'])
flattened_record = o['record']

if fixed_headers is not None:
if o['stream'] not in headers:
Expand Down

0 comments on commit 2ff517d

Please sign in to comment.