[JIRA] (JENKINS-58866) Splunk plugin not sending json files

sophie_lan@intuit.com (JIRA)

unread,

Aug 8, 2019, 2:43:02 PM8/8/19

to jenkinsc...@googlegroups.com

Sophie Lan created an issue

Jenkins /

JENKINS-58866

Splunk plugin not sending json files

Issue Type:	Bug
Assignee:	Ted
Components:	splunk-devops-plugin
Created:	2019-08-08 18:42
Environment:	splunk-devops-plugin (version 1.7.4)
Priority:	Minor
Reporter:	Sophie Lan

There is a bug where splunk-devops-plugin doesn't send json files to Splunk.

In pipeline mode, I send a json file to splunk:
step([$class: 'SplunkArtifactNotifier', excludeFiles: '', includeFiles: 'data/jkmaster_installs.json', publishFromSlave: true, sizeLimit: '100MB', skipGlobalSplunkArchive: true])
The console output looks like this when I run the job:
11:41:35 sending files at job level, includes:data/jkmaster_installs.json excludes:11:41:36 sent [/home/jenkins/workspace/slan/plugin-recon/data/jkmaster_installs.json] to splunk in 1 events
However when I try to find my json file in Splunk it is not there.

This bug is present in splunk-devops-plugin version 1.7.2 and higher. I am able to send my json file to Splunk with version 1.7.1. I believe that this commit causes the issue: https://github.com/splunk/splunkforjenkins/commit/10227252b7bed9576995ea0df63b395060773031. When I take out the code from just this commit sending my json file works fine.

Add Comment

This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)

sophie_lan@intuit.com (JIRA)

unread,

Aug 8, 2019, 2:47:02 PM8/8/19

to jenkinsc...@googlegroups.com

Sophie Lan updated an issue

Jenkins /

JENKINS-58866

Splunk plugin not sending json files

Change By:	Sophie Lan

There is a bug where splunk-devops-plugin doesn't send json files to Splunk.

In pipeline mode, I send a json file to splunk:
{{step([$class: 'SplunkArtifactNotifier', excludeFiles: '', includeFiles: 'data/jkmaster_installs.json', publishFromSlave: true, sizeLimit: '100MB', skipGlobalSplunkArchive: true])}}

The console output looks like this when I run the job:

*11:41:35* sending files at job level, includes:data/jkmaster_installs.json excludes:*11:41:36* sent [/home/jenkins/workspace/slan/plugin-recon/data/jkmaster_installs.json] to splunk in 1 events

However when I try to find my json file in Splunk it is not there.

This bug is present in splunk-devops-plugin version 1.7.2 and higher. I am able to send my json file to Splunk with version 1.7.1. I believe that this commit causes the issue: [https://github.com/splunk/splunkforjenkins/commit/10227252b7bed9576995ea0df63b395060773031]. When I take out the code from just this commit sending my json file works fine.

Add Comment

xiao.xj@outlook.com (JIRA)

unread,

Aug 9, 2019, 10:54:01 AM8/9/19

to jenkinsc...@googlegroups.com

Ted commented on

JENKINS-58866

Re: Splunk plugin not sending json files

could you please add below conf to $SPLUNK_HOME/etc/system/local/limits.conf

 
                                                                [http_input]
# max request content length, bytes
max_content_length = 10000000

1.7.2 will send json file in single request instead of line by line so it can be parsed correctly, I guess your splunk http event collector discarded the input for length limit

Add Comment

sophie_lan@intuit.com (JIRA)

unread,

Aug 12, 2019, 6:38:02 PM8/12/19

to jenkinsc...@googlegroups.com

Sophie Lan commented on

JENKINS-58866

Re: Splunk plugin not sending json files

I just tested that but it didn't work. I also tried sending a very small json file (~200 bytes) with the latest splunk version but that also didn't work. The file I am attempting to send varies around 5mb-8mb.