Skip to content

[WIP] Start processing results from getLedgers #196

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 27 commits into
base: main
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
4d5212b
Implement AcquireAdvisoryLock and ReleaseAdvisoryLock.
marcelosalloum Jun 12, 2025
715e8dc
Enforce advisory lock on the ingest service
marcelosalloum Jun 12, 2025
d91fe9f
Create a Model object to execute queries pertaining to the ingest_sto…
marcelosalloum Jun 12, 2025
affdfd2
Stop using `models.Payment.DB` and use `models.DB` instead.
marcelosalloum Jun 12, 2025
18ba6d3
Create helper method to calculate the range of ledgers to fetch.
marcelosalloum Jun 12, 2025
eced2d1
[WIP] implement getLedgers.
marcelosalloum Jun 12, 2025
1416bad
[WIP] start fetching ledgers.
marcelosalloum Jun 14, 2025
408e252
Start fetching ledger batches.
marcelosalloum Jun 16, 2025
8d0acbe
Add parallelization when processing ledgers
marcelosalloum Jun 16, 2025
02367a3
Fix tests
marcelosalloum Jun 16, 2025
aa1af4d
Fix tests by making them point to the RunOld method.
marcelosalloum Jun 16, 2025
d3ff615
Remove advisory lock from the deprecated function.
marcelosalloum Jun 16, 2025
06cc5de
Add tests for rpcService.getLedgers()
marcelosalloum Jun 16, 2025
c172ade
[WIP] start tx and ops processors
marcelosalloum Jun 17, 2025
29e83b2
Start tracking participants of a ledger transaction
marcelosalloum Jun 17, 2025
69b1e0b
move new files to a different folder, to avoid dependency cycle.
marcelosalloum Jun 17, 2025
824dc64
Create data bundles that include transactions and operations.
marcelosalloum Jun 17, 2025
6e2b719
Make sure unsuccessful transactions are still processed, but their op…
marcelosalloum Jun 17, 2025
fd83a4a
Implement AccountModel.GetExisting
marcelosalloum Jun 17, 2025
844530e
Change Select to SELECT FOR UPDATE
marcelosalloum Jun 17, 2025
392b96e
Implement TransactionModel.BatchInsert
marcelosalloum Jun 17, 2025
922020f
Remove the Participants type and use strings directly. Also, use a mu…
marcelosalloum Jun 17, 2025
673fa6e
Start storing the transactions in the DB
marcelosalloum Jun 17, 2025
868b0a5
Fix the data bundle.
marcelosalloum Jun 18, 2025
114f2da
Allow channel account unlock to receive a DB Tx as an input arg
marcelosalloum Jun 18, 2025
7edd410
Start unlocking channel accounts in the new ingestService.Run code
marcelosalloum Jun 18, 2025
43899de
Fix transaction ledger sequence and stop sending redundant `sequence`…
marcelosalloum Jun 18, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
56 changes: 55 additions & 1 deletion go.mod
Original file line number Diff line number Diff line change
Expand Up @@ -20,37 +20,70 @@ require (
github.com/sirupsen/logrus v1.9.3
github.com/spf13/cobra v1.9.1
github.com/spf13/viper v1.20.1
github.com/stellar/go v0.0.0-20250417130535-10df2019148f
github.com/stellar/go v0.0.0-20250613214159-65b2d613a208
github.com/stellar/go-xdr v0.0.0-20231122183749-b53fb00bcac2
github.com/stellar/stellar-rpc v0.9.6-0.20250523162628-6bb9d7a387d5
github.com/stretchr/testify v1.10.0
golang.org/x/term v0.31.0
golang.org/x/text v0.24.0
)

require (
cel.dev/expr v0.16.1 // indirect
cloud.google.com/go v0.116.0 // indirect
cloud.google.com/go/auth v0.13.0 // indirect
cloud.google.com/go/auth/oauth2adapt v0.2.6 // indirect
cloud.google.com/go/compute/metadata v0.6.0 // indirect
cloud.google.com/go/iam v1.2.2 // indirect
cloud.google.com/go/monitoring v1.21.2 // indirect
cloud.google.com/go/storage v1.49.0 // indirect
github.com/BurntSushi/toml v1.3.2 // indirect
github.com/GoogleCloudPlatform/opentelemetry-operations-go/detectors/gcp v1.25.0 // indirect
github.com/GoogleCloudPlatform/opentelemetry-operations-go/exporter/metric v0.48.1 // indirect
github.com/GoogleCloudPlatform/opentelemetry-operations-go/internal/resourcemapping v0.48.1 // indirect
github.com/Masterminds/squirrel v1.5.4 // indirect
github.com/Microsoft/go-winio v0.6.1 // indirect
github.com/asaskevich/govalidator v0.0.0-20230301143203-a9d515a09cc2 // indirect
github.com/beorn7/perks v1.0.1 // indirect
github.com/cenkalti/backoff/v4 v4.3.0 // indirect
github.com/census-instrumentation/opencensus-proto v0.4.1 // indirect
github.com/cespare/xxhash/v2 v2.3.0 // indirect
github.com/cncf/xds/go v0.0.0-20240905190251-b4127c9b8d78 // indirect
github.com/creachadair/jrpc2 v1.2.0 // indirect
github.com/creachadair/mds v0.13.4 // indirect
github.com/davecgh/go-spew v1.1.2-0.20180830191138-d8f796af33cc // indirect
github.com/dgryski/go-farm v0.0.0-20240924180020-3414d57e47da // indirect
github.com/djherbis/fscache v0.10.1 // indirect
github.com/envoyproxy/go-control-plane v0.13.1 // indirect
github.com/envoyproxy/protoc-gen-validate v1.1.0 // indirect
github.com/felixge/httpsnoop v1.0.4 // indirect
github.com/fsnotify/fsnotify v1.8.0 // indirect
github.com/gabriel-vasile/mimetype v1.4.8 // indirect
github.com/go-errors/errors v1.5.1 // indirect
github.com/go-gorp/gorp/v3 v3.1.0 // indirect
github.com/go-logr/logr v1.4.2 // indirect
github.com/go-logr/stdr v1.2.2 // indirect
github.com/go-playground/locales v0.14.1 // indirect
github.com/go-playground/universal-translator v0.18.1 // indirect
github.com/go-viper/mapstructure/v2 v2.2.1 // indirect
github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da // indirect
github.com/google/s2a-go v0.1.8 // indirect
github.com/googleapis/enterprise-certificate-proxy v0.3.4 // indirect
github.com/googleapis/gax-go/v2 v2.14.1 // indirect
github.com/gorilla/schema v1.4.1 // indirect
github.com/guregu/null v4.0.0+incompatible // indirect
github.com/hashicorp/golang-lru v1.0.2 // indirect
github.com/inconshreveable/mousetrap v1.1.0 // indirect
github.com/jmespath/go-jmespath v0.4.0 // indirect
github.com/klauspost/compress v1.18.0 // indirect
github.com/lann/builder v0.0.0-20180802200727-47ae307949d0 // indirect
github.com/lann/ps v0.0.0-20150810152359-62de8c46ede0 // indirect
github.com/leodido/go-urn v1.4.0 // indirect
github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 // indirect
github.com/pelletier/go-toml v1.9.5 // indirect
github.com/pelletier/go-toml/v2 v2.2.3 // indirect
github.com/pkg/errors v0.9.1 // indirect
github.com/planetscale/vtprotobuf v0.6.1-0.20240319094008-0393e58bdf10 // indirect
github.com/pmezard/go-difflib v1.0.1-0.20181226105442-5d4384ee4fb2 // indirect
github.com/prometheus/client_model v0.6.1 // indirect
github.com/prometheus/common v0.62.0 // indirect
Expand All @@ -64,12 +97,33 @@ require (
github.com/spf13/pflag v1.0.6 // indirect
github.com/stretchr/objx v0.5.2 // indirect
github.com/subosito/gotenv v1.6.0 // indirect
go.opencensus.io v0.24.0 // indirect
go.opentelemetry.io/contrib/detectors/gcp v1.29.0 // indirect
go.opentelemetry.io/contrib/instrumentation/google.golang.org/grpc/otelgrpc v0.54.0 // indirect
go.opentelemetry.io/contrib/instrumentation/net/http/otelhttp v0.54.0 // indirect
go.opentelemetry.io/otel v1.29.0 // indirect
go.opentelemetry.io/otel/metric v1.29.0 // indirect
go.opentelemetry.io/otel/sdk v1.29.0 // indirect
go.opentelemetry.io/otel/sdk/metric v1.29.0 // indirect
go.opentelemetry.io/otel/trace v1.29.0 // indirect
go.uber.org/multierr v1.11.0 // indirect
golang.org/x/crypto v0.37.0 // indirect
golang.org/x/exp v0.0.0-20231006140011-7918f672742d // indirect
golang.org/x/mod v0.17.0 // indirect
golang.org/x/net v0.38.0 // indirect
golang.org/x/oauth2 v0.25.0 // indirect
golang.org/x/sync v0.13.0 // indirect
golang.org/x/sys v0.32.0 // indirect
golang.org/x/time v0.8.0 // indirect
golang.org/x/tools v0.21.1-0.20240508182429-e35e4ccd0d2d // indirect
google.golang.org/api v0.215.0 // indirect
google.golang.org/genproto v0.0.0-20241118233622-e639e219e697 // indirect
google.golang.org/genproto/googleapis/api v0.0.0-20241209162323-e6fa225c2576 // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20241223144023-3abc09e42ca8 // indirect
google.golang.org/grpc v1.67.3 // indirect
google.golang.org/protobuf v1.36.5 // indirect
gopkg.in/djherbis/atime.v1 v1.0.0 // indirect
gopkg.in/djherbis/stream.v1 v1.3.1 // indirect
gopkg.in/tylerb/graceful.v1 v1.2.15 // indirect
gopkg.in/yaml.v3 v3.0.1 // indirect
)
Loading
Loading