Error on stopping Pool: TypeError #81
Description
From the kibana log:
{"asctime": "2019-01-14T22:56:40.536Z", "levelname": "ERROR", "processName": "MainProcess", "message": "Error on stopping Pool: TypeError("can't pickle thread.lock objects",)", "exc_info": "Traceback (most recent call last):\n File "/usr/local/lib/python2.7/dist-packages/celery/bootsteps.py", line 151, in send_all\n fun(parent, *args)\n File "/usr/local/lib/python2.7/dist-packages/celery/bootsteps.py", line 374, in stop\n return self.obj.stop()\n File "/usr/local/lib/python2.7/dist-packages/celery/concurrency/base.py", line 122, in stop\n self.on_stop()\n File "/usr/local/lib/python2.7/dist-packages/celery/concurrency/prefork.py", line 140, in on_stop\n self._pool.join()\n File "/usr/local/lib/python2.7/dist-packages/billiard/pool.py", line 1578, in join\n stop_if_not_current(self._result_handler)\n File "/usr/local/lib/python2.7/dist-packages/billiard/pool.py", line 143, in stop_if_not_current\n thread.stop(timeout)\n File "/usr/local/lib/python2.7/dist-packages/billiard/pool.py", line 500, in stop\n self.on_stop_not_started()\n File "/usr/local/lib/python2.7/dist-packages/celery/concurrency/asynpool.py", line 321, in on_stop_not_started\n check_timeouts()\n File "/usr/local/lib/python2.7/dist-packages/billiard/pool.py", line 744, in handle_event\n next(self._it)\n File "/usr/local/lib/python2.7/dist-packages/billiard/pool.py", line 697, in handle_timeouts\n cache = copy.deepcopy(self.cache)\n File "/usr/lib/python2.7/copy.py", line 163, in deepcopy\n y = copier(x, memo)\n File "/usr/lib/python2.7/copy.py", line 257, in _deepcopy_dict\n y[deepcopy(key, memo)] = deepcopy(value, memo)\n File "/usr/lib/python2.7/copy.py", line 190, in deepcopy\n y = _reconstruct(x, rv, 1, memo)\n File "/usr/lib/python2.7/copy.py", line 334, in _reconstruct\n state = deepcopy(state, memo)\n File "/usr/lib/python2.7/copy.py", line 163, in deepcopy\n y = copier(x, memo)\n File "/usr/lib/python2.7/copy.py", line 257, in _deepcopy_dict\n y[deepcopy(key, memo)] = deepcopy(value, memo)\n File "/usr/lib/python2.7/copy.py", line 163, in deepcopy\n y = copier(x, memo)\n File "/usr/lib/python2.7/copy.py", line 264, in _deepcopy_method\n return type(x)(x.im_func, deepcopy(x.im_self, memo), x.im_class)\n File "/usr/lib/python2.7/copy.py", line 190, in deepcopy\n y = _reconstruct(x, rv, 1, memo)\n File "/usr/lib/python2.7/copy.py", line 334, in _reconstruct\n state = deepcopy(state, memo)\n File "/usr/lib/python2.7/copy.py", line 163, in deepcopy\n y = copier(x, memo)\n File "/usr/lib/python2.7/copy.py", line 237, in _deepcopy_tuple\n y.append(deepcopy(a, memo))\n File "/usr/lib/python2.7/copy.py", line 163, in deepcopy\n y = copier(x, memo)\n File "/usr/lib/python2.7/copy.py", line 257, in _deepcopy_dict\n y[deepcopy(key, memo)] = deepcopy(value, memo)\n File "/usr/lib/python2.7/copy.py", line 190, in deepcopy\n y = _reconstruct(x, rv, 1, memo)\n File "/usr/lib/python2.7/copy.py", line 334, in _reconstruct\n state = deepcopy(state, memo)\n File "/usr/lib/python2.7/copy.py", line 163, in deepcopy\n y = copier(x, memo)\n File "/usr/lib/python2.7/copy.py", line 237, in _deepcopy_tuple\n y.append(deepcopy(a, memo))\n File "/usr/lib/python2.7/copy.py", line 163, in deepcopy\n y = copier(x, memo)\n File "/usr/lib/python2.7/copy.py", line 257, in _deepcopy_dict\n y[deepcopy(key, memo)] = deepcopy(value, memo)\n File "/usr/lib/python2.7/copy.py", line 190, in deepcopy\n y = _reconstruct(x, rv, 1, memo)\n File "/usr/lib/python2.7/copy.py", line 334, in _reconstruct\n state = deepcopy(state, memo)\n File "/usr/lib/python2.7/copy.py", line 163, in deepcopy\n y = copier(x, memo)\n File "/usr/lib/python2.7/copy.py", line 257, in _deepcopy_dict\n y[deepcopy(key, memo)] = deepcopy(value, memo)\n File "/usr/lib/python2.7/copy.py", line 163, in deepcopy\n y = copier(x, memo)\n File "/usr/lib/python2.7/copy.py", line 298, in _deepcopy_inst\n state = deepcopy(state, memo)\n File "/usr/lib/python2.7/copy.py", line 163, in deepcopy\n y = copier(x, memo)\n File "/usr/lib/python2.7/copy.py", line 257, in _deepcopy_dict\n y[deepcopy(key, memo)] = deepcopy(value, memo)\n File "/usr/lib/python2.7/copy.py", line 190, in deepcopy\n y = _reconstruct(x, rv, 1, memo)\n File "/usr/lib/python2.7/copy.py", line 334, in _reconstruct\n state = deepcopy(state, memo)\n File "/usr/lib/python2.7/copy.py", line 163, in deepcopy\n y = copier(x, memo)\n File "/usr/lib/python2.7/copy.py", line 257, in _deepcopy_dict\n y[deepcopy(key, memo)] = deepcopy(value, memo)\n File "/usr/lib/python2.7/copy.py", line 182, in deepcopy\n rv = reductor(2)\nTypeError: can't pickle thread.lock objects", "timestamp": "2019-01-14T22:56:40.536Z", "hostname": "adsvm05"}