What is the best way to run multiple dataproc templates in parallel? #279
-
|
If you have, for example, 100 JDBC tables and need to copy them to GCS. Can I assign multiple batches to a single DataProc Serverless cluster? |
Beta Was this translation helpful? Give feedback.
Answered by
NiloFreitas
Mar 24, 2023
Replies: 1 comment
-
|
You can submit dataproc serverless batches in parallel, as shown here: https://github.com/GoogleCloudPlatform/dataproc-templates/tree/main/notebooks |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
shashank-google
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
You can submit dataproc serverless batches in parallel, as shown here: https://github.com/GoogleCloudPlatform/dataproc-templates/tree/main/notebooks