Multi node setup for multiple Powerloom Snapshotter Lite: Protocol V2 slot holders on Linux VPS

Note

This setup is for Lite nodes participating in the latest V2 of Powerloom Protocol. Protocol V1 setup is deprecated and its data markets are archived. Your submission data, rewards on it are finalized and recorded as announced on Discord.

0. Preparation.

Clone this repository. And change into the repository's directory. All commands will be run within there henceforth.

git clone https://github.com/PowerLoom/snapshotter-lite-multi-setup.git
cd snapshotter-lite-multi-setup

1. Setup Python environment

This is of utmost importance. We want to setup an isolated virtual environment with the right Python version and modules without affecting any global Python installations on the VPS or your local machine.

1.1 Install pyenv

Detailed instructions and troubleshotting can be found on the pyenv Github repo README. In general, the following should take care of the installation on an Ubuntu VPS.

sudo apt install build-essential libssl-dev zlib1g-dev libbz2-dev libreadline-dev libsqlite3-dev curl libncursesw5-dev xz-utils tk-dev libxml2-dev libxmlsec1-dev libffi-dev liblzma-dev
curl https://pyenv.run | bash
pyenv install 3.11.5
source ~/.bashrc

1.2 Install pyenv-virtualenv

Detailed instructions can be found here.

git clone https://github.com/pyenv/pyenv-virtualenv.git $(pyenv root)/plugins/pyenv-virtualenv
echo 'eval "$(pyenv virtualenv-init -)"' >> ~/.bashrc
pyenv virtualenv 3.11.5 ss_lite_multi_311
pyenv local ss_lite_multi_311

2. Run the setup

# prepare the .env file
./init.sh
# install all python requirements
pip install -r requirements.txt
# run the setup
python multi_clone.py

Note

Follow our walkthrough tutorial video posted on Youtube or click on the preview below!

If you encounter any issues, please contact us on discord.

[OPTIONAL] Dev mode setup

Warning

This section is not required if you are not planning on running a customized setup. For any related assistance, contact us on discord.

If you wish to customize the docker containers being launched by not using the published images from Powerloom, and instead clone the underlying snapshotter components locally and building their images, we support that as well now.

Ref: Step 2, after running ./init.sh , you can edit the generated .env file for the following fields

DEV_MODE=False  # you can set this to True
# subseqeuently you can specify the branch of https://github.com/PowerLoom/snapshotter-lite-v2 that you wish to run
LITE_NODE_BRANCH=main