[JIRA] (JENKINS-62212) EC2 Connection checks request all instances in AWS account

7 views
Skip to first unread message

jackie@jamur2.net (JIRA)

unread,
May 7, 2020, 4:15:03 PM5/7/20
to jenkinsc...@googlegroups.com
John Murphy created an issue
 
Jenkins / Improvement JENKINS-62212
EC2 Connection checks request all instances in AWS account
Issue Type: Improvement Improvement
Assignee: FABRIZIO MANFREDI
Components: ec2-plugin
Created: 2020-05-07 20:14
Priority: Minor Minor
Reporter: John Murphy

We maintain what might be considered a degenerate (but hopefully not unreasonable) setup with ~50 Jenkins masters deployed to a single AWS account, all of which use the ec2 plugin.

 

We've been contacted by AWS and our DescribeInstances requests are getting throttled, with a plurality of our quota being used by the ec2 plugin.  The limit appears to be 3000 resources requested per second, which seems reasonable.

It looks like every minute, all masters make a DescribeInstances request to verify the ec2 connection is still valid.  However, this request does not provide a filter, so returns all EC2 instances in the AWS account.  Since this check appears to just be a keepalive poll, I don't think it's necessary to request all instances, and a filter returning zero instances would suffice, and protect our API quota, since the quota goes by resources requested, not raw request counts.

We've been running one master with a patched ec2 plugin with such a change, and haven't noticed any ill effects, but this is just the result of a days worth of hunch-following.  I'll file a PR for it shortly for feedback.

Add Comment Add Comment
 
This message was sent by Atlassian Jira (v7.13.12#713012-sha1:6e07c38)
Atlassian logo

jackie@jamur2.net (JIRA)

unread,
May 7, 2020, 4:19:03 PM5/7/20
to jenkinsc...@googlegroups.com
Reply all
Reply to author
Forward
0 new messages