Documentation and tools for converting LevelDB files into JSON files. (eg. for reading Google Firestore and Datastore backups)
For Firestore, instructions for creating these backups can be seen here.
- Make sure Python 2.7 is installed, and present in your
Pathenvironment variable. (or just supply the absolute path to itspythonexecutable in usage step 1) - Clone/download this repo to disk.
- Run
python ToJSON.py PATH_TO_FIRESTORE_BACKUP_FOLDER(pass the direct parent folder of the "output-0", etc. files) - A
Data.jsonfile will be created in the backup folder, with the original database structure. (collections as json objects, their documents as keyed entries underneath)
The ToJSON.py script relies on some modules within the google-cloud-sdk and appengine-sdk (older versions, since the newest ones are missing some modules we need). Stripped-down versions of these sdks are included in this repo for convenience; however, if you need to use different versions for some reason, you can find them here:
- Google Cloud SDK archive (included:
google-cloud-sdk-180.0.1-windows-x86_64.zip): https://console.cloud.google.com/storage/browser/cloud-sdk-release - AppEngine SDK archive (included:
180/google_appengine_1.8.0.zip): https://console.cloud.google.com/storage/browser/appengine-sdks/deprecated
To use the alternate version downloaded, extract the archives, then replace the corresponding contents within the SDKs folder.
- firestore-export-json: Similar, but using some pip-installed dependencies. (and in Python 3)