New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Enhance RunResults #83

Open

artgoldberg opened this issue Apr 9, 2020 · 0 comments

Assignees

Labels

Contributor

artgoldberg commented Apr 9, 2020

(Includes unfinished parts of #70.)

Investigate warning generated by random_states_s.to_hdf(self._hdf_file(), 'random_states') in __init__():

The warning is:

/usr/local/lib/python3.6/site-packages/pandas/core/generic.py:1996 PerformanceWarning:
your performance may suffer as PyTables will pickle object types that it cannot
map directly to c-types [inferred_type->mixed,key->values] [items->None]

Speed up convert_checkpoints by using MakeDataFrame to build aggregate_states_df.
Have hdf use disk more efficiently; for unknown reasons, in one example hdf uses 4.4M to store the data in 52 pickle files of 8K each, more than 10x less efficient than pickle.

The text was updated successfully, but these errors were encountered:

artgoldberg added the enhancement label

artgoldberg self-assigned this

artgoldberg mentioned this issue

Enhance RunResults #70

Closed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment