Skip to content

Commit

Permalink
Merge pull request #154 from alfonsorr/fix/avoid-executing-spark-task…
Browse files Browse the repository at this point in the history
…s-if-result-is-not-evaluated

Avoid making an execution not used later.
  • Loading branch information
SemyonSinchenko authored Sep 7, 2024
2 parents 584bc1e + 9a6b51c commit 0db536a
Showing 1 changed file with 1 addition and 2 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -139,7 +139,6 @@ Expected DataFrame Row Count: '$expectedCount'
unequalRDDMessage(unequalRDD, maxUnequalRowsToShow)
)
}
unequalRDD.take(maxUnequalRowsToShow)

} finally {
ds1.rdd.unpersist()
Expand Down Expand Up @@ -173,4 +172,4 @@ Expected DataFrame Row Count: '$expectedCount'

object DatasetComparer {
val maxUnequalRowsToShow = 10
}
}

0 comments on commit 0db536a

Please sign in to comment.