You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
### What changes were proposed in this pull request?
This PR aims to documents the missed `spark.connect.*` configurations by syncing.
- sql/connect/server/src/main/scala/org/apache/spark/sql/connect/config/Connect.scala
- docs/configuration.md
### Why are the changes needed?
**Apache Spark 3.5.0**
- spark.connect.jvmStacktrace.maxSize
- spark.sql.connect.ui.retainedSessions
- spark.sql.connect.ui.retainedStatements
**Apache Spark 4.0.0**
- spark.connect.grpc.binding.address
- spark.connect.grpc.port.maxRetries
- spark.connect.ml.backend.classes
- spark.sql.connect.enrichError.enabled
- spark.sql.connect.serverStacktrace.enabled
- spark.connect.grpc.maxMetadataSize
- spark.connect.progress.reportInterval
### Does this PR introduce _any_ user-facing change?
This updates only a config documentation and `configuration` HTML page.
### How was this patch tested?
Manual review.
### Was this patch authored or co-authored using generative AI tooling?
No.
Closesapache#50171 from dongjoon-hyun/SPARK-51407.
Authored-by: Dongjoon Hyun <[email protected]>
Signed-off-by: Dongjoon Hyun <[email protected]>
Copy file name to clipboardexpand all lines: docs/configuration.md
+80
Original file line number
Diff line number
Diff line change
@@ -3398,6 +3398,14 @@ They are typically set via the config file and command-line options with `--conf
3398
3398
<td>For Spark Classic applications, specify whether to automatically use Spark Connect by running a local Spark Connect server. The value can be <code>classic</code> or <code>connect</code>.</td>
Comma separated list of classes that implement the trait org.apache.spark.sql.connect.plugin.MLBackendPlugin to replace the specified Spark ML operators with a backend-specific implementation.
3482
+
</td>
3483
+
<td>Comma separated list of class names that must implement the <code>io.grpc.ServerInterceptor</code> interface</td>
<td>The interval at which the progress of a query is reported to the client. If the value is set to a negative value the progress reports will be disabled.</td>
0 commit comments