Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support powersync-sqlite-core 0.3.0 #334

Merged
merged 9 commits into from
Oct 14, 2024
Merged

Conversation

rkistner
Copy link
Contributor

@rkistner rkistner commented Oct 8, 2024

Release notes: https://github.com/powersync-ja/powersync-sqlite-core/releases/tag/v0.3.0

This release removes major performance bottlenecks during incremental sync. Previously, incremental sync would have overhead proportional to the number of synced rows, which typically caused noticeable latency when syncing around 10-100k+ rows. Now, the overhead is only proportional to the number of buckets synced.

The performance improvements required a restructure in the data storage format. Data is migrated automatically, and an app can downgrade back to v0.2.0 or v0.2.1 of powersync-sqlite-core.

Changes:

  • Persist checksums to improve incremental sync performance.
  • Restructure persistence of REMOVE operations to further improve incremental sync performance.
  • Create internal views on powersync_init() instead of extension init, to support SQLCipher.

See the SQLite build updates:

The diagnostics app depends on the internal table structure, so the queries there are updated. Other apps should not need any changes.

Fixes #339.

Copy link

changeset-bot bot commented Oct 8, 2024

🦋 Changeset detected

Latest commit: 5c840c2

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 6 packages
Name Type
@powersync/react-native Minor
@powersync/diagnostics-app Minor
@powersync/common Minor
@powersync/web Minor
@powersync/op-sqlite Patch
@powersync/tanstack-react-query Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@rkistner rkistner changed the title [WIP] Support powersync-sqlite-core 0.3.0 Support powersync-sqlite-core 0.3.0 Oct 14, 2024
@rkistner rkistner marked this pull request as ready for review October 14, 2024 07:32
Chriztiaan
Chriztiaan previously approved these changes Oct 14, 2024
@rkistner rkistner merged commit 5591b9a into main Oct 14, 2024
5 checks passed
@rkistner rkistner deleted the powersync-sqlite-core-030 branch October 14, 2024 07:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Unsupported powersync extension version. Need ^0.2.0, got: 0.3.0/053f7fca]
2 participants