Skip to content

Commit

Permalink
test is creating pool before iteration solves ci test problems
Browse files Browse the repository at this point in the history
  • Loading branch information
sh-rp committed Jan 24, 2024
1 parent a151428 commit 0211d3d
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions dlt/extract/pipe.py
Original file line number Diff line number Diff line change
Expand Up @@ -589,6 +589,7 @@ def _fork_pipeline(pipe: Pipe) -> None:
return cls(max_parallel_items, workers, futures_poll_interval, sources, next_item_mode)

def __next__(self) -> PipeItem:
self._ensure_async_pool()
pipe_item: Union[ResolvablePipeItem, SourcePipeItem] = None
# __next__ should call itself to remove the `while` loop and continue clauses but that may lead to stack overflows: there's no tail recursion opt in python
# https://stackoverflow.com/questions/13591970/does-python-optimize-tail-recursion (see Y combinator on how it could be emulated)
Expand Down

0 comments on commit 0211d3d

Please sign in to comment.