Quick setup of NetflixOSS services and examples as AMIs

[Adrian Cockcroft]

A missing link that we hoped to have a while ago is a base AMI. With that we could have AMInator jobs to build AMIs for each of the standalone services.

The holdup is that Netflix is stuck on an internal transition from an old version of CentOS to a new Ubuntu base AMI, and the new one isn't ready and we don't want to waste time working on the old one. We are also short of an Engineer in this group. Internal migration to Ubuntu is higher priority than the NetflixOSS base AMI for now.

If anyone has figured out how to fire up NetflixOSS services on various Linux versions (don't really care which) then I'd like to hear about them and see if we can build an AMI library for as many Linux variants as people find interesting, for services like Asgard, Edda, Eureka, etc.

Let me know

Cheers Adrian

[ralph tice]

This is the minimal quickstart for Edda on an Amazon Linux AMI: https://gist.github.com/ralph-tice/4253069

Are you talking about an AMI of a base install, or an AMI to use as a base to execute some orchestration services against to bootstrap the services?

[Adrian Cockcroft]

Hi Ralph,

I'm talking about a set of pre-baked AMIs that Netflix could register as public AMIs for people to use directly from Asgard without having to do a build/install step.

This looks useful, thanks!

Cheers Adrian

[Nicholas Whittier]

This is a great idea. I'm cross-posting these (they are in https://groups.google.com/forum/?fromgroups#!forum/asgardusers) in case others find this thread:

Ubuntu 12.04LTS with Asgard:

  http://imperialwicket.com/netflix-asgard-ubuntu-1204-lts-ami-release-11101

Amazon Linux 201303 with Asgard: 

  http://imperialwicket.com/netflix-asgard-amazon-linux-201303-11101


I'm focusing on pre-built AMIs supporting the tools (using puppet), then I'm planning to circle back to aminator. Hopefully the first technique will reduce obstacles in bringing new users to these projects. The aminator process will be great from a dog-fooding perspective, but would appeal more readily to the users already committed to the platform (imo).

I'd love any feedback!

-- Nicholas

[Peter Sankauskas]

Hi Adrian,

I have public AMIs for Aminator, Asgard, Edda and Eureka available here:

https://github.com/Answers4AWS/netflixoss-ansible/wiki/AMIs-for-NetflixOSS

I'll be adding more over the next month. You can use these directly from Asgard as long as you include public images. This project also includes all of the source to create those AMIs.

For Aminator, there is a CloudFormation script to do the tedious stuff for you (security group, IAM role with correct policy, ASG, etc). More details and instructions can be found on my blog post:

http://answersforaws.com/blog/2013/08/ansible-provisioner-for-aminator/

I hope this helps drive adoption of some of the NetflixOSS projects.

--

Kind regards,

Peter Sankauskas

Answers for AWS

On Tuesday, May 7, 2013 10:07:03 AM UTC-7, Adrian Cockcroft wrote:

[Adrian Cockcroft]

Thanks Peter, this is very helpful.

Cheers Adrian

[Peter Sankauskas]

Not to stop there, I have also added a playbook for Ice and the Simian Army, as well as an AMI for the Simian Army.

On the AWS Marketplace, you will also find Asgard and Edda:

https://aws.amazon.com/marketplace/seller-profile/?id=35bf36f1-7d03-4257-b273-8c97b3a5a48c

As well as a screencast video of how to launch Asgard:

http://youtu.be/q2XZ-O_C0HY

Enjoy!