You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
test-data/before_1582_date_v2_4_5.snappy.parquet cannot be located.
for fix this UT case, we need to modify the code
def failInRead(path: String): Unit = {
println(path)
val e = intercept[SparkException](spark.read.parquet(testFile(path)).collect())
assert(e.getCause.isInstanceOf[SparkUpgradeException])
}
Feng-Jiang28
changed the title
SPARK-31159, SPARK-37705: compatibility with Spark 2.4/3.2 in reading dates/timestamps
[BUG] Spark UT framework: SPARK-31159, SPARK-37705: compatibility with Spark 2.4/3.2 in reading dates/timestamps
Oct 12, 2024
This UT cases have 2 problems:
for fix this UT case, we need to modify the code
The issue is caused by unsupported kernel, feature has been requested here [FEA] Implement kernel to support non-UTC time zone for LEGACY mode. #11562
java.lang.UnsupportedOperationException: LEGACY datetime rebase mode is only supported for files written in UTC timezone. Actual file timezone: America/Los_Angeles
The text was updated successfully, but these errors were encountered: