CloudyCluster Quick Start

AWS Prerequisites:

Launching CloudyCluster in the AWS Marketplace uses a built-in Cloud Formation Template.  This process will create a new IAM Role and Policy and Launch the Initial Control Instance.

If you wish to use the EC2 Console to launch the Marketplace AMI, follow these DIY IAM instructions and skip the Cloud Formation Steps.

Follow the instructions as outlined.  Additional Documentation can be found at

To begin:

RHEL:  navigate and enable CloudyCluster 1.2 for RHEL in the AWS Marketplace here
CentOS: enable the free CentOS base AMI here then navigate and enable CloudyCluster 1.2 for CentOS in the AWS Marketplace here.

To enable CloudyCluster in the AWS Marketplace, select your preferred region and the "Control Instance topology for CloudyCluster" radio button, and then select the "Continue" button. You will not be charged until the instance is launched in later steps. 

Select a CloudyCluster version (the newest version is recommended), a region, and ensure the "Control Instance topology for CloudyCluster" radio button is selected before launching with the CloudFormation console.

Assign a name to your stack and fill in the parameters.

Assign Key/Value pairs if desired.


Review your settings and select the "Create" button to create your stack. This will launch the CloudyCluster Control Instance and authorize your AWS account to be charged for the single control instance. You will be able to review additional charge estimates before you launch additional cluster instances.

To access the CloudyCluster instance that was launched select the "Output" tab in the CloudFormation Console and copy the InstanceIP.


Paste the InstanceIP into a web browser, and wait about 5 min for the instance to fully launch.

Quickstart Setup

After you have launched the AMI, complete the following initial setup tasks:

It takes about 5 minutes for the instance to come up and self configure fully. Once it does, you will see the following:

Once DNS propagates, you will be taken to the following page to upload the AWS .pem keyfile you referenced when you launched the instance.

Next, provide the following information to complete the initial setup:
(All information you provide is used only in CloudyCluster and never leaves your Amazon Web Services account.)

If you select the federated Twitter, Facebook, Google or InCommon login methods, the CloudyCluster user will also be saved to your AWS account.  The federated login methods are valid for web login, but ssh and webDAV still require a CloudyCluster username and password.

Now you have successfully completed the initial setup. 

Spinning up a Cluster

Select the "Overview" menu item.

Click the "+" button to add a new cluster.

Select your cluster details and enter a name for your cluster, then select the "Quick Start Clusters" option:

Select your preferred preconfigured Cluster option, and complete the other options:

Carefully review the information provided in the Final Review, as you will begin to incur charges when you click the "Create Cluster" button:

Now your initial cluster is spinning up. When the outline highlight color is all green, you can begin to use your cluster.

When the environment is ready to use it will have green boarders around every component.

Now your HPC Environment is ready, the options shown here had the scheduler configured for autoscaling through CCQ, to learn more about the CCQ meta-scheduler see the CloudyCluster documentation at 

To uninstall CloudyCluster you will need to take the following steps

Delete or terminate any hPC Environments you have running, by selecting the trash can icon, in the upper right corner, for the whole cluster to be deleted.

All data associated with this cluster will be removed including any EFS, S3, or Working Storage, make sure you back up any needed data to a different location.

Now proceed to the Administration tab and select Delete CloudyCluster Instance and Database, this will remove all users, collaborations and anything associated with CloudCluster, you will not be able to recover from this.

Select Delete and the database will be removed and instance shut down and terminated.  The web UI will become unavailable.

Go to the Cloud Formation console to remove the Stack associated with this CloudyCluster instance.

Select the Stack and choose Delete Stack, this will remove the IAM role and Policy initially created.

Screen Shot 2015-09-25 at 3.06.20 PM.png
Screen Shot 2015-09-25 at 3.09.19 PM.png

View the complete CloudyCluster documentation.