Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Indexer Services #160

Merged
merged 7 commits into from
Jan 24, 2025
Merged
Changes from 1 commit
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Update docekr services
marcus-snx committed Jan 24, 2025
commit b51726d3fb2628fea3832891514be306b36c8f48
15 changes: 10 additions & 5 deletions Makefile
Original file line number Diff line number Diff line change
@@ -13,12 +13,17 @@ extract:
docker compose run extractors uv run python main.py configs/arbitrum_mainnet.yaml
docker compose run extractors uv run python main.py configs/arbitrum_sepolia.yaml

indexer-listener:
docker compose -f docker-compose.indexers.yml up -d indexer-listener
listener-start:
docker compose up -d indexer-listener

index:
docker compose -f docker-compose.indexers.yml up -d indexer-arbitrum-mainnet-synthetix
docker compose -f docker-compose.indexers.yml up -d indexer-base-mainnet-synthetix
listener-stop:
docker compose down indexer-listener

index-start:
docker compose -f docker-compose.indexers.yml up -d

index-stop:
docker compose -f docker-compose.indexers.yml down

synths:
docker compose run transformer python scripts/get_synths.py
marcus-snx marked this conversation as resolved.
Show resolved Hide resolved
17 changes: 2 additions & 15 deletions docker-compose.indexers.yml
Original file line number Diff line number Diff line change
@@ -31,20 +31,7 @@ services:
- ./parquet-data:/parquet-data
- ./indexers/logs/indexer-gen/base-mainnet/synthetix:/app/logs

indexer-listener:
build:
context: ./indexers
dockerfile: Dockerfile.listener
networks:
- data
restart: always
environment:
PYTHONUNBUFFERED: 1
volumes:
- ./parquet-data:/parquet-data
- ./indexers/logs/indexer-listener:/app/logs

networks:
data:
external:
name: data_data
name: data_data
external: true
14 changes: 14 additions & 0 deletions docker-compose.yml
Original file line number Diff line number Diff line change
@@ -20,6 +20,7 @@ services:
limits:
cpus: "4.0"
memory: 8192M

db:
image: ghcr.io/synthetixio/data/postgres:${VERSION}
restart: always
@@ -42,6 +43,19 @@ services:
cpus: "4.0"
memory: 8192M

indexer-listener:
build:
context: ./indexers
dockerfile: Dockerfile.listener
networks:
- data
restart: always
environment:
PYTHONUNBUFFERED: 1
volumes:
- ./parquet-data:/parquet-data
- ./indexers/logs/indexer-listener:/app/logs

transformer:
image: ghcr.io/synthetixio/data/transformer:${VERSION}
build: