Skip to content

runpod self.current_concurrency turned into None in some cases. #458

@waganawa

Description

@waganawa

Describe the bug

20j67gt48z9xxe[error]Uncaught exception | ['Traceback (most recent call last):\n', '  
File "/app/runpod_concurrent_handler_launch.py", line 14, in <module>\n    runpod.serverless.start(\n', '  
File "/venv/lib/python3.12/site-packages/runpod/serverless/__init__.py", line 178, in start\n    worker.main(config)\n', '  
File "/venv/lib/python3.12/site-packages/runpod/serverless/worker.py", line 56, in main\n    run_worker(config)\n', '  
File "/venv/lib/python3.12/site-packages/runpod/serverless/worker.py", line 43, in run_worker\n    job_scaler.start()\n', '  
File "/venv/lib/python3.12/site-packages/runpod/serverless/modules/rp_scale.py", line 108, in start\n    asyncio.run(self.run())\n', '  
File "/usr/lib/python3.12/asyncio/runners.py", line 194, in run\n    return runner.run(main)\n           ^^^^^^^^^^^^^^^^\n', '  
File "/usr/lib/python3.12/asyncio/runners.py", line 118, in run\n    return self._loop.run_until_complete(task)\n           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', '  
File "/usr/lib/python3.12/asyncio/base_events.py", line 687, in run_until_complete\n    return future.result()\n           ^^^^^^^^^^^^^^^\n', '  
File "/venv/lib/python3.12/site-packages/runpod/serverless/modules/rp_scale.py", line 135, in run\n    await asyncio.gather(*tasks)\n', '  
File "/venv/lib/python3.12/site-packages/runpod/serverless/modules/rp_scale.py", line 226, in run_jobs\n    while len(tasks) < self.current_concurrency and not self.jobs_queue.empty():\n          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^\n', 
"TypeError: '<' not supported between instances of 'int' and 'NoneType'\n"]

To Reproduce
UnKown....

Expected behavior
running other jobs.

Screenshots

Image

Additional context
I Don't Know why is this happend. but when it cased in my concurrent worker, it Just Stop 2~3 minnute and then just restart the docker.

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions