72 read write to collate json (#75)

* first go (and clean-up of old debugging comments)

* CLI updates

* do not broadcast with client.scatter

* .

* re-save collate list after (partial) upload

* try to skip folder scanning if a collate file exists

* test json

* breaks for debugging

* .

* .

* removed success while loop

* .

* switching from json to dask.dataframe.read_json

* .

* to_collate

* .

* .

* to_collate as dict

* use pandas

* quick debug

* use csv

* .

* .

* .

* .

* changing list to pandas ops

* append dict

* .

* indent issue

* .

* .

* .

* cast as list

* debug

* .

* direct to pandas

* debug

* .

* .

* check data types

* .

* .

* transpose

* .

* .

* .

* transpose

* .

* use list of dicts

* .

* test write to_collate

* .

* check exisiting

* debug

* literal_eval - need to test file names with commas

* debug

* .

* .

* .

* .

* adjusting cmp for existing objects

* .

* debugging - expect fail at pop

* .

* .

* nightly - continuation needs to be fixed.

* change pop to drop as using pandas not list

* compile droplist