New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Faster GPKG checkout: Use spatial index bulk loading #946

Open

craigds opened this issue Nov 20, 2023 · 0 comments

Labels

Member

craigds commented Nov 20, 2023

Checkout of a full GPKG working copy is quite slow. On my MBP (M1/2021):

$ time kart checkout
Creating GPKG working copy at nz-primary-land-parcels.gpkg ...
Writing features for dataset 1 of 1: nz_primary_land_parcels
nz_primary_land_parcels: 100%|███████████████████████████████████████████████████████████████████| 2375572/2375572 [04:40<00:00, 8476.60F/s]
kart checkout  0.01s user 0.02s system 0% cpu 4:51.30 total

https://github.com/rouault/sqlite_rtree_bulk_load looks useful for reducing rtree creation time for bulk loads by >50%. So that 5 minutes would probably drop to 2 minutes.

Other idea: Could we start writing a WC before we've finished cloning? I don't know if that's a good idea or not; it sounds messy.

The text was updated successfully, but these errors were encountered:

craigds added the enhancement label

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment