SNS notification + SQS build trigger

[Kalyan Akella]

Hello.

I was wondering if there's a way to trigger builds as soon as one or more messages arrive on an SQS queue.

Currently, we have a Jenkins instance running in AWS with a Github build trigger. This build runs what we call, a 'main' build (services, common components, etc.). Upon successful completion, we want it to trigger another build which generates certain Apple IOS artefacts. However, since AWS currently has no support for building any Apple stuff, we setup another Jenkins instance (on an MBP) in our company's internal network (behind firewall, etc) which has a build that does the IOS artefacts.

Now, we've setup an SNS topic and an SQS queue subscriber. The idea is to have the main build post a message, with the main build number and git SHA in the body, which then is published into the SQS queue. Then the IOS Jenkins instance receives this SQS queue message (through polling) and triggers the IOS builds. Also we plan to archive the artefacts with the main build number.

For posting build notifications to an SNS topic, there's the snsnotify-plugin which might be helpful. However, I've looked at the github-sqs-plugin but its tied up to Github queue messages and it doesn't trigger the build if the message doesn't appear to be a Github message.

Any thoughts on how we can achieve this ?

Moreover, I've also considered using a VPN connection between the AWS VPC and our company network and setup the IOS machine as a slave to the AWS Jenkins. However, this is ruled out due to certain time and security constraints.