Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add 4.0.0-preview2 news #561

Merged
merged 1 commit into from
Sep 26, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions documentation.md
Original file line number Diff line number Diff line change
Expand Up @@ -85,6 +85,7 @@ navigation:
<p>Documentation for preview releases:</p>

<ul>
<li><a href="{{site.baseurl}}/docs/4.0.0-preview2/">Spark 4.0.0 preview2</a></li>
<li><a href="{{site.baseurl}}/docs/4.0.0-preview1/">Spark 4.0.0 preview1</a></li>
<li><a href="{{site.baseurl}}/docs/3.0.0-preview2/">Spark 3.0.0 preview2</a></li>
<li><a href="{{site.baseurl}}/docs/3.0.0-preview/">Spark 3.0.0 preview</a></li>
Expand Down
28 changes: 28 additions & 0 deletions news/_posts/2024-09-26-spark-4.0.0-preview2.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
---
layout: post
title: Preview release of Spark 4.0
categories:
- News
tags: []
status: publish
type: post
published: true
meta:
_edit_last: '4'
_wpas_done_all: '1'
---
To enable wide-scale community testing of the upcoming Spark 4.0 release, the Apache Spark community has posted a
<a href="https://archive.apache.org/dist/spark/spark-4.0.0-preview2/">Spark 4.0.0 preview2 release</a>.
This preview is not a stable release in terms of either API or functionality, but it is meant to give the community early
access to try the code that will become Spark 4.0. If you would like to test the release,
please <a href="https://archive.apache.org/dist/spark/spark-4.0.0-preview2">download</a> it, and send feedback using either
<a href="https://spark.apache.org/community.html">mailing lists</a> or
<a href="https://issues.apache.org/jira/browse/SPARK/?selectedTab=com.atlassian.jira.jira-projects-plugin:summary-panel">JIRA</a>.
The documentation is available at the <a href="https://spark.apache.org/docs/4.0.0-preview2/">link</a>.

There are a lot of exciting new features added to Spark 4.0, including ANSI mode by default, Python data source, polymorphic
Python UDTF, string collation support, new VARIANT data type, streaming state store data source, structured logging, Java 21 support, Java 17 by default
and many more.

We'd like to thank our contributors and users for their contributions and early feedback to this release. This release would not have
been possible without you.
6 changes: 3 additions & 3 deletions site/404.html
Original file line number Diff line number Diff line change
Expand Up @@ -179,6 +179,9 @@ <h2 id="oops">Oops!</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The link is correct but the link text "Preview release of Spark 4.0" is the same as preview 1. Do you think we can make them different?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ya, I also felt in that way, but simply followed our convention at 3.0.0-preview2 here.
Screenshot 2024-09-26 at 09 23 48

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It seems that we kept New title itself in the same way.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay.

<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -188,9 +191,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/committers.html
Original file line number Diff line number Diff line change
Expand Up @@ -714,6 +714,9 @@ <h3>Policy on backporting bug fixes</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -723,9 +726,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/community.html
Original file line number Diff line number Diff line change
Expand Up @@ -379,6 +379,9 @@ <h3>Powered by</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -388,9 +391,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/contributing.html
Original file line number Diff line number Diff line change
Expand Up @@ -722,6 +722,9 @@ <h2>Code of conduct</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -731,9 +734,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/developer-tools.html
Original file line number Diff line number Diff line change
Expand Up @@ -723,6 +723,9 @@ <h2>Generative tooling usage</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -732,9 +735,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
2 changes: 1 addition & 1 deletion site/docs/preview
7 changes: 4 additions & 3 deletions site/documentation.html
Original file line number Diff line number Diff line change
Expand Up @@ -231,6 +231,7 @@ <h2><span class="text-capitalize">Apache Spark<span class="tm">&trade;</span></s
<p>Documentation for preview releases:</p>

<ul>
<li><a href="/docs/4.0.0-preview2/">Spark 4.0.0 preview2</a></li>
<li><a href="/docs/4.0.0-preview1/">Spark 4.0.0 preview1</a></li>
<li><a href="/docs/3.0.0-preview2/">Spark 3.0.0 preview2</a></li>
<li><a href="/docs/3.0.0-preview/">Spark 3.0.0 preview</a></li>
Expand Down Expand Up @@ -379,6 +380,9 @@ <h3>Research Papers</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -388,9 +392,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/downloads.html
Original file line number Diff line number Diff line change
Expand Up @@ -219,6 +219,9 @@ <h3 id="archived-releases">Archived releases</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -228,9 +231,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/error-message-guidelines.html
Original file line number Diff line number Diff line change
Expand Up @@ -556,6 +556,9 @@ <h4 id="wording-guide">Wording guide</h4>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -565,9 +568,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/examples.html
Original file line number Diff line number Diff line change
Expand Up @@ -504,6 +504,9 @@ <h2>Additional examples</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -513,9 +516,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/faq.html
Original file line number Diff line number Diff line change
Expand Up @@ -226,6 +226,9 @@ <h2><span class="text-capitalize">Apache Spark<span class="tm">&trade;</span></s
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -235,9 +238,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/graphx/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -271,6 +271,9 @@ <h3>Getting started</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -280,9 +283,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/history.html
Original file line number Diff line number Diff line change
Expand Up @@ -180,6 +180,9 @@ <h2><span class="text-capitalize">Apache Spark<span class="tm">&trade;</span></s
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -189,9 +192,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/improvement-proposals.html
Original file line number Diff line number Diff line change
Expand Up @@ -252,6 +252,9 @@ <h4>Implementing an SPIP</h4>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -261,9 +264,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/mailing-lists.html
Original file line number Diff line number Diff line change
Expand Up @@ -164,6 +164,9 @@
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -173,9 +176,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/mllib/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -317,6 +317,9 @@ <h3>Getting started</h3>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -326,9 +329,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/news/3-1-3-released.html
Original file line number Diff line number Diff line change
Expand Up @@ -170,6 +170,9 @@ <h2>Spark 3.1.3 released</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -179,9 +182,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
6 changes: 3 additions & 3 deletions site/news/amp-camp-2013-registration-ope.html
Original file line number Diff line number Diff line change
Expand Up @@ -170,6 +170,9 @@ <h2>Registration open for AMP Camp training camp in Berkeley</h2>
<h5>Latest News</h5>
<ul class="list-unstyled">

<li><a href="/news/spark-4.0.0-preview2.html">Preview release of Spark 4.0</a>
<span class="small">(Sep 26, 2024)</span></li>

<li><a href="/news/spark-3-5-3-released.html">Spark 3.5.3 released</a>
<span class="small">(Sep 24, 2024)</span></li>

Expand All @@ -179,9 +182,6 @@ <h5>Latest News</h5>
<li><a href="/news/spark-4.0.0-preview1.html">Preview release of Spark 4.0</a>
<span class="small">(Jun 03, 2024)</span></li>

<li><a href="/news/spark-3-4-3-released.html">Spark 3.4.3 released</a>
<span class="small">(Apr 18, 2024)</span></li>

</ul>
<p class="small" style="text-align: right;"><a href="/news/index.html">Archive</a></p>
</div>
Expand Down
Loading
Loading