Recommended AWS instances for NATS streaming

[Timothy Van Heest]

I know the answer is probably "it depends" but does any anyone have a recommended AWS instance for running NATS streaming?

I figured starting with the same instance types and configurations kafka recommends would probably make sense since the servers are doing very similar things:
http://www.confluent.io/blog/design-and-deployment-considerations-for-deploying-apache-kafka-on-aws/

Thanks! 

[Danko Miocevic]

Timothy,

It depends! LOL No, to be serious... I think you can use all the instances from AWS, I even tried with a T1.micro and it worked on a small environment. Of course it will depend on the load and other details and nobody will tell you a "recommended" instance here. 

But I can tell you that you can have 2 things in mind when you choose:

1- You can create a cluster, so if you use small instances it gets more granular.

2- Remember that instances and network performance are tied in AWS so that is another thing to take into account. Smaller instances have poor network performance.

I think the answer here is that you can try it. I've been working on a CloudFormation template you can use from here github.com/dankomiocevic/aws-nats , you can use that as a starting point and play with the configuration and upgrade the instances.

[Timothy Van Heest]

Thanks Danko!

So basically looking out for limits on disk and network performance is what I need to do.  That makes sense.

The autoscaling work in the Cloud Formation template looks pretty cool too.  Thanks for that!

[Snigdha Sambit Aryakumar]

Hello Danko!! 

I tried to use your cloudformation for setting up a small cluster in AWS. Looking like if we use any of the latest generation of instances ( c4, c5 etc ) It does not supports. It fails with the below errors.

Virtualization type 'hvm' is required for instances of type 'c4.2xlarge' etc. 

Using M3 or older instances worked. But after that I ran into another issue.

18:23:43 UTC+0550

CREATE_FAILED

AWS::CloudFormation::WaitCondition

WaitCondition

WaitCondition received failed message: 'Failed to install packages from pip repository' for uniqueId: i-0d056dd833cc60292

Is the template still in use or is it outdated?

Thx,

Sambit

[Danko Miocevic]

Sambit,

Unfortunately, it's been a while since the last time I used that CF. It is probably outdated.

If you get to fix the issues, please send me the code change and I will update it!

Regards,

Danko