Skip to content

Conversation

@neyama
Copy link

@neyama neyama commented Nov 15, 2024

Which issue does this PR close?

Closes #18 .

Rationale for this change

  • Calling spark.catalog.clearCache() clears the cached tables.
  • We can execute each query without side effect.

What changes are included in this PR?

  • Call spark.catalog.clearCache() when executing each query beforehand.

How are these changes tested?

  • By running tpcbench.py

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Avoid side effects by cached state

1 participant