BiBiGrid is a tool for an easy cluster setup inside a cloud environment. It is written in Java and run on any OS a Java runtime is provided - any Java 8 is supported. BiBiGrid and its Cmdline UI based on a general cloud provider api. Currently there exists implementations for Google (Compute Engine using the official Google Cloud SDK), Amazon (AWS EC2 using the official AWS SDK), Microsoft (Azure using the official Azure SDK) (WIP) and OpenStack (Openstack4j). BiBiGrid offers an easy configuration and maintenance of a started cluster via command-line.
BiBiGrid uses Ansible to configure standard Ubuntu 16.04 LTS cloud images. Depending on your configuration BiBiGrid can set up an HCP cluster for grid computing (Open Grid Engine, Mesos), distributed databases (Casandra) , a shared filesystem (on local discs and attached volumes), a cloud IDE for writing, running and debugging (Cloud9) and many more.
During resource instantiation BiBiGrid configures the network, local and network volumes, (network) file systems and also the software for an immediately usage of the started cluster.
When using preinstalled images a full configured and ready to use cluster is available within a few minutes.
Requirements: Java >= 8, Maven >= 3.3.9
Each cloud provider SDK comes with an set of dependencies which often conflicts with dependencies of other SDK (same libary, different major version) when building a shaded (fat) jar. The BiBiGrid POM supports Maven profiles to avoid such dependency conflicts.
> git clone https://github.com/BiBiServ/bibigrid.git
> cd bibigridAttention: Building a package supporting all cloud provider is possible but not recommend. The Maven package action put the first occurance of a library/class into the builded shaded jar. This could lead to an unpredictable behaviour when running BiBiGrid. The default profile is mainly used by IDEs with Maven support.
> mvn clean package> mvn -P aws clean package> mvn -P azure clean package> mvn -P googlecloud clean package> mvn -P openstack clean packageUsing BiBiGrid requires a valid cluster configuration and credentials for your cloud provider. The setup can differ a bit depending on the used cloud backend. See BiBiGrid documentation for detailed configuration and usage information.