Skip to content

Commit

Permalink
docs(troubleshooting): Add spark task execution troubleshooting (#4974)
Browse files Browse the repository at this point in the history
When executing spark test, if the spark plugin enabled in the config
file, then it will show 'JavaPackage' object is not callable error.
Which is difficult to know from this error message, so add it to the
troubleshooting guide.

Resolves: #4826

Signed-off-by: Chi-Sheng Liu <[email protected]>
  • Loading branch information
MortalHappiness authored Feb 29, 2024
1 parent e1d5a7a commit 2cc9169
Showing 1 changed file with 18 additions and 0 deletions.
18 changes: 18 additions & 0 deletions docs/community/troubleshoot.rst
Original file line number Diff line number Diff line change
Expand Up @@ -133,3 +133,21 @@ Example output:
$ kubectl annotate serviceaccount -n <flyte-namespace> <http://eks.amazonaws.com/role-arn=arn:aws:iam::xxxx:role/<flyte-iam-role>eks.amazonaws.com/role-arn=arn:aws:iam::xxxx:role/<flyte-iam-role>
- Refer to this community-maintained `guides <https://github.com/davidmirror-ops/flyte-the-hard-way/blob/main/docs/03-roles-service-accounts.md>`_ for further information about Flyte deployment on EKS
``FlyteScopedUserException: 'JavaPackage' object is not callable`` when running a Spark task
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Please add ``spark`` to the list of `enabled-plugins` in the config yaml file. For example,
.. code-block:: yaml
tasks:
task-plugins:
enabled-plugins:
- container
- sidecar
- K8S-ARRAY
- spark
default-for-task-types:
- container: container
- container_array: K8S-ARRAY

0 comments on commit 2cc9169

Please sign in to comment.