Jira (PUP-10370) Compress reports sent using "http" report processor

[Josh Cooper (Jira)]

Josh Cooper created an issue

Puppet / PUP-10370 Compress reports sent using "http" report processor Issue Type: Improvement Assignee: Unassigned Created: 2020/03/13 6:23 PM Priority: Normal Reporter: Josh Cooper The "http" report processor does not specify the "compress" option when posting the report, so puppetserver does not compress it. The processor should specify that option (maybe conditional based on an http_compression property), so that reports are compressed between puppetserver and the HTTP(S) server. The puppetdb terminus already does this when submitting reports/catalogs/facts/etc to puppetdb. See https://github.com/puppetlabs/puppetdb/blob/1262e5f1165c00cb22b51ab5fab5649bda759a64/puppet/lib/puppet/util/puppetdb/command.rb#L68 For this ticket, just add :compress => :gzip to the options passed to client.post in lib/puppet/reports/http.rb. Add Comment

This message was sent by Atlassian Jira (v8.5.2#805002-sha1:a66f935)

[Josh Cooper (Jira)]

Josh Cooper updated an issue

Puppet / PUP-10370 Compress reports sent using "http" report processor

Change By: Josh Cooper Team: Coremunity

Add Comment

[Josh Cooper (Jira)]

Josh Cooper updated an issue

Puppet / PUP-10370 Compress reports sent using "http" report processor Change By: Josh Cooper

The "http" report processor does not specify the "compress" option when posting the report, so puppetserver does not compress it. The processor should specify that option (maybe conditional based on an http_compression property), so that reports are compressed between puppetserver and the HTTP(S) server. The puppetdb terminus already does this when submitting reports/catalogs/facts/etc to puppetdb. See https://github.com/puppetlabs/puppetdb/blob/1262e5f1165c00cb22b51ab5fab5649bda759a64/puppet/lib/puppet/util/puppetdb/command.rb#L68

For this ticket, just add {{:compress => :gzip}} to the options passed to {{client.post}} in {{lib/puppet/reports/http.rb}}. Reports are highly compressible. An empty catalog compresses from 6512 bytes to 1119 bytes, about 1/6th the size. A more typical catalog compresses from 66021785 bytes to 4721897, which is about 1/13th the size.

Add Comment