This project was created to simplify the setting up of beowulf cluster computing systems. This setup tool will reduce the time needed to go from computing hardware to a fully-functional cluster that can run C, C++ and Fortran programs on the collective computing power of your cluster using MPICH.
For this project's hardware, you will need a computer dedicated for use as a master compute node, at least one slave node, a gateway (router), and an ethernet switch if you have enough nodes to fill up your router's ports and then some. For software, all nodes should be running linux, and more specifically, a debian-based OS like Trisquel, Ubuntu, or Debian. For use with other distros, you may need to modify the script for the distro-specific commands. Finally, you will need a flash drive with the contents of this repository downloaded on it and temporary internet access at the beginning of the setup process for each node.
To start it off, download or clone this repo and move/extract the contents of this repo to a flash drive. Then, disconnect the node from ethernet/internet and proceed to run the setup_part_1.sh script on all cluster nodes using:
$ cd *path_to_the_repository_folder_on_usb_drive*
$ bash setup_part_1.sh
When prompted to connect the node to internet, connect it to a network with internet access, which dosen't have to be your cluster's network. Now, follow the on-screen instructions. When you see that you should connect the node to the cluster network, the ip is ready to be set static; connect the node to the cluster switch/router setup that will pass commands between the nodes so it can set up its static config. When prompted, enter the router's (gateway) ip and subnet mask. Once the setup is done, it will output the static settings. Check the settings are correct. Next, the script will create a user, mpiuser for the ssh connection between machines. If the cluster is offline and security isn't a concern, leave the default settings and don't add a password, but, if you do add a password, use the same one on all nodes. To finish part one, make sure the setup has been run on all nodes.
For part two, run the setup part two on all nodes as mpiuser, but do it on the master node last. To start it, login as mpiuser and run the program with:
$ sudo mpiuser
$ bash setup_part_2.sh
Now, follow the on-screen instructions and once at the master node, make sure to enter the same gateway ip as before for your cluster's router when prompted and make a passwordless ssh key (unless security is a concern). Finally, add a password to the cluster and make sure you write it down as it will be needed to run jobs on the cluster later.
These setup scripts were tested on the following debian based systems: Trisquel 7.0, Raspbian, and Xubuntu.
For reference in this project, I used material and examples from others during setup. For troubleshooting or research please visit the best setup guide I found online.
This setup guide is open and is licensed under GNU GPLv3 for your use, modification, and distribution.