is there any plan to support multithreading?

[ari-stern]

it would be nice to be able to refresh multiple tables at once

[flarco]

Hi, actually this was a thought earlier but was put off because of the potential stress that it can cause on the source database system. You can bring a system down if you select multiple sizable, whole tables at once. I believe ELT platforms today (such as Stitch, and Fivetran) do one table at a time as well, probably for that same reason.

But, with that fact that Sling is built in Go, multi threading can be added with relative ease. So I think that this could be a configurable parameter with replications mode. Let me think a little more about this. We could have some top level parameter like threads, with the default number being 1 if not specified.

[ari-stern]

cool thank you!

[jmesterh]

I agree with the potential stress issue, but it would be very nice to have the option to multithread at the table level, given appropriate warning in the documentation.

[flarco]

Will revisit this soon.

[flarco]

Opened #117.