Celery on Windows: OSError: [WinError 6] The handle is invalid

Need help with Celery. I have been using Celery 4.3.0 with python 3.7.4 on windows server 2012, using AWS Redis queue. I have only one machine running the workers with concurrency of 5. Each of the tasks is for loading a site in Selenium and parsing the page. After few hours of running the tasks successfully I get this error,

[2020-01-05 02:01:27,634: INFO/MainProcess] Traceback (most recent call last):
  File "C:\dev\bigoofn_spider\spider\site_navigation\selenium_utils.py", line 75
, in _GetChromeInstance
    driver = webdriver.Chrome(chrome_options=chrome_options)
  File "c:\dev\tools\python\python37-32\lib\site-packages\selenium\webdriver\chr
ome\webdriver.py", line 73, in __init__
    self.service.start()
  File "c:\dev\tools\python\python37-32\lib\site-packages\selenium\webdriver\com
mon\service.py", line 76, in start
    stdin=PIPE)
  File "c:\dev\tools\python\python37-32\lib\subprocess.py", line 664, in __init_
_
    _cleanup()
  File "c:\dev\tools\python\python37-32\lib\subprocess.py", line 228, in _cleanu
p
    res = inst._internal_poll(_deadstate=sys.maxsize)
  File "c:\dev\tools\python\python37-32\lib\subprocess.py", line 1216, in _inter
nal_poll
    if _WaitForSingleObject(self._handle, 0) == _WAIT_OBJECT_0:
OSError: [WinError 6] The handle is invalid

Would really appreciate any suggestions.