Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement checkpoint Sync & Indexing #9

Merged
merged 11 commits into from
Dec 13, 2024
Merged

Conversation

sergiupopescu199
Copy link
Contributor

@sergiupopescu199 sergiupopescu199 commented Dec 10, 2024

Description

Implement the checkpoint sync and indexing into SQLite using the iota-data-ingestion-core crate.

Links to any relevant issues

Fixes #2

How the change has been tested

Start a local network which contains a stardust migration

cd iota/docker/pg-services-local
docker compose up -d local-network

Start the indexer

cargo r -- --remote-store-url http://localhost:9000/api/v1

check SQLite tables if any records are stored

$ sqlite3 stardust.db "select count(id) from objects;" ".exit"
384
$ sqlite3 stardust.db "select count(owner) from expiration_unlock_conditions;" ".exit"
384

# Conflicts:
#	Cargo.lock
#	Cargo.toml
#	src/main.rs
#	src/models.rs
#	src/schema.rs
Copy link

@tomxey tomxey left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me 👾

Copy link
Collaborator

@kodemartin kodemartin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @sergiupopescu199 looks good in general. Left a few suggestions/comments, nothing critical though.

Copy link
Collaborator

@kodemartin kodemartin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hey @sergiupopescu199 thanks for the changes. Left a few more minor suggestions, plus another idea for a follow-up issue regarding atomic insertion of objects and their unlock conditions.

Copy link
Collaborator

@kodemartin kodemartin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good @sergiupopescu199! Haven't tested it though.

Left a last minor suggestion.

@sergiupopescu199 sergiupopescu199 merged commit 64b918c into main Dec 13, 2024
@sergiupopescu199 sergiupopescu199 deleted the infra/issue-2 branch December 13, 2024 09:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Implement synchronization and indexing
3 participants