bug

[wangjianqiao111]

程序运行报错.

System information

• OS Platform and Distribution (e.g., CentOS 7.6):linux
• Python version:3.7
• HyperGBM version:0.3.0
• Other Python packages(run pip list):
• Package Version

---

backcall 0.2.0
bcrypt 4.0.1
catboost 1.2.2
certifi 2023.7.22
cffi 1.15.1
charset-normalizer 3.3.0
click 8.1.7
cloudpickle 2.2.1
cryptography 41.0.4
cycler 0.11.0
dask 2022.2.0
dask-glm 0.3.0
dask-ml 2022.5.27
decorator 5.1.1
distributed 2022.2.0
fonttools 4.38.0
fsspec 2023.1.0
graphviz 0.20.1
HeapDict 1.0.1
hypergbm 0.3.0
hypernets 0.3.0
idna 3.4
imbalanced-learn 0.11.0
importlib-metadata 6.7.0
ipython 7.34.0
jedi 0.19.1
Jinja2 3.1.2
joblib 1.3.2
kiwisolver 1.4.5
lightgbm 4.1.0
llvmlite 0.39.1
locket 1.0.0
MarkupSafe 2.1.3
matplotlib 3.5.3
matplotlib-inline 0.1.6
msgpack 1.0.5
multipledispatch 1.0.0
numba 0.56.4
numpy 1.21.6
packaging 23.2
pandas 1.3.5
paramiko 3.3.1
parso 0.8.3
partd 1.4.1
pexpect 4.8.0
pickleshare 0.7.5
Pillow 9.5.0
pip 23.0.1
plotly 5.17.0
prettytable 3.7.0
prompt-toolkit 3.0.39
psutil 5.8.0
ptyprocess 0.7.0
pyarrow 12.0.1
pycparser 2.21
Pygments 2.16.1
PyNaCl 1.5.0
pyparsing 3.1.1
python-dateutil 2.8.2
pytz 2023.3.post1
PyYAML 6.0.1
requests 2.31.0
scikit-learn 1.0.2
scipy 1.7.3
setuptools 58.1.0
six 1.16.0
sortedcontainers 2.4.0
sparse 0.13.0
tblib 2.0.0
tenacity 8.2.3
threadpoolctl 3.1.0
toolz 0.12.0
tornado 6.2
tqdm 4.66.1
traitlets 5.9.0
typing_extensions 4.7.1
urllib3 2.0.7
wcwidth 0.2.8
xgboost 1.6.2
XlsxWriter 3.1.8
zict 2.2.0
zipp 3.15.0

**distributed.worker - WARNING - Compute Failed
Function: execute_task
args: ((<function pipe at 0x7f54ae8260e0>, [0 1
1 0
Name: Class, dtype: int64], <Serialize: functools.partial(<function _concat at 0x7f54916d0cb0>, ignore_index=False)>, <Serialize: functools.partial(<function unique at 0x7f54916c97a0>, series_name='Class')>))
kwargs: {}
Exception: 'TypeError("'Serialize' object is not callable")'

Traceback (most recent call last):
File "", line 2, in
File "", line 5, in train
File "/usr/local/python3.7.17/lib/python3.7/site-packages/hypergbm/experiment.py", line 246, in make_experiment
**kwargs
File "/usr/local/python3.7.17/lib/python3.7/site-packages/hypernets/experiment/_maker.py", line 312, in make_experiment
task, _ = tb.infer_task_type(y_train, excludes=dc_nan_chars if dc_nan_chars is not None else None)
File "/usr/local/python3.7.17/lib/python3.7/site-packages/hypernets/tabular/toolbox.py", line 320, in infer_task_type
uniques = cls.unique(y)
File "/usr/local/python3.7.17/lib/python3.7/site-packages/hypernets/tabular/dask_ex/_toolbox.py", line 230, in unique
uniques = y.unique().compute()
File "/usr/local/python3.7.17/lib/python3.7/site-packages/dask/base.py", line 290, in compute
(result,) = compute(self, traverse=False, **kwargs)
File "/usr/local/python3.7.17/lib/python3.7/site-packages/dask/base.py", line 573, in compute
results = schedule(dsk, keys, **kwargs)
File "/usr/local/python3.7.17/lib/python3.7/site-packages/distributed/client.py", line 2994, in get
results = self.gather(packed, asynchronous=asynchronous, direct=direct)
File "/usr/local/python3.7.17/lib/python3.7/site-packages/distributed/client.py", line 2152, in gather
asynchronous=asynchronous,
File "/usr/local/python3.7.17/lib/python3.7/site-packages/distributed/utils.py", line 310, in sync
self.loop, func, *args, callback_timeout=callback_timeout, kwargs
File "/usr/local/python3.7.17/lib/python3.7/site-packages/distributed/utils.py", line 376, in sync
raise exc.with_traceback(tb)
File "/usr/local/python3.7.17/lib/python3.7/site-packages/distributed/utils.py", line 349, in f
result = yield future
File "/usr/local/python3.7.17/lib/python3.7/site-packages/tornado/gen.py", line 769, in run
value = future.result()
File "/usr/local/python3.7.17/lib/python3.7/site-packages/distributed/client.py", line 2009, in _gather
raise exception.with_traceback(traceback)
File "/usr/local/python3.7.17/lib/python3.7/site-packages/toolz/functoolz.py", line 628, in pipe
data = func(data)
TypeError: 'Serialize' object is not callable

Describe the expected behavior

Standalone code to reproduce the issue
Provide a reproducible test case that is the bare minimum necessary to generate
the problem. If possible, please share a link to Jupyter notebook.

Are you willing to submit PR?(Yes/No)

Other info / logs
Include any logs or source code that would be helpful to diagnose the problem.
If including tracebacks, please include the full traceback. Large logs and files
should be attached.

[oaksharks]

Try changing:

...
cluster = LocalCluster(processes=False)
...

to:

cluster = LocalCluster(processes=True)