Error Using Custom Env + GaussianGRU + VPG

[chelseas]

I get the following error:
Error while instantiating <class 'sandbox.rocky.tf.algos.vpg.VPG'>
Traceback (most recent call last):
File "/home/chelseas/anaconda3/envs/rllab3/lib/python3.5/site-packages/tensorflow/python/framework/tensor_util.py", line 521, in make_tensor_proto
str_values = [compat.as_bytes(x) for x in proto_values]
File "/home/chelseas/anaconda3/envs/rllab3/lib/python3.5/site-packages/tensorflow/python/framework/tensor_util.py", line 521, in
str_values = [compat.as_bytes(x) for x in proto_values]
File "/home/chelseas/anaconda3/envs/rllab3/lib/python3.5/site-packages/tensorflow/python/util/compat.py", line 61, in as_bytes
(bytes_or_text,))
TypeError: Expected binary or unicode string, got obs

Any suggestions? It's a rather opaque error message.