Sonar Analysis Failing due to 550MB issues file in scanner-report

82 views
Skip to first unread message

sand...@amobee.com

unread,
Mar 6, 2018, 3:15:31 PM3/6/18
to SonarQube
Hi, 
After upgrading from 5.6.7 to 6.7.1 I started getting 500 errors when the sonar scanner tried to upload analysis to our sonarqube server. 
I worked through a couple server / mysql configuration tweaks based on exceptions found in web.log.  
- Increased max_allowed_packet to 1GB
- increased the innodb redo log size 
- increased the RAM of the system 
- increased the java heap size allocated to the compute engine

Nothing seemed to help. 

Watching the scanner run, I noticed that one of our files took at least 10 minutes to analyze.  
So I went and looked into the scanner-report directory while the scanner was running. 

The corresponding "issues pb" files was over 550MB - after adding the file to the scanner exclusions list, the analysis started to work again. 
Not sure what's wrong with that file - its just some java code. 

I'm hoping to save someone else similar problems in the future, so I'm attaching a sample gradle project based on that file.  

The 75 lines of code in the sample project take about 6 minutes to analyze and create a large report which makes the CE process on our server crash out.
Crash reports and server config details are enclosed. 

Thanks in advance for taking a look.

Sandy 
Message has been deleted

sand...@amobee.com

unread,
Mar 6, 2018, 3:18:43 PM3/6/18
to SonarQube
Hi Again, 

So I guess Google groups won't let me post the tarball I'd created.  I'm attaching a few of the files (fingers crossed). 

I guess contact me directly if you want my test case. 

Sandy
errorDetails.txt
sonarqube_ce.log
sonarqube_system_info.json
build.gradle
ReportStoreManager.java

Nicolas Peru

unread,
Apr 27, 2018, 9:21:11 AM4/27/18
to sand...@amobee.com, SonarQube
Hi, 

Your case seems interesting and there seems to be something fishy with the number of issues created on that single file. 
Could you share the quality profile of your project as well ? Can you also share the logs of the analysis ? 

Note that the file without its dependency cannot be used to reproduce the issue. Would it be possible to create a reproducer to share on github for instance ? that would help a lot.

Cheers, 


--
You received this message because you are subscribed to the Google Groups "SonarQube" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sonarqube+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/sonarqube/63215547-de74-46e5-9ba7-96f22f2e480f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
Nicolas Peru | SonarSource

sand...@amobee.com

unread,
May 1, 2018, 1:14:59 PM5/1/18
to SonarQube
Hi Nicholas, 

Thanks for getting back to me. 
I pushed my gradle project to reproduce the problem to git hub here: https://github.com/simsandyca/sqtest
I exported the profile we use to java-turn-02128.xml which you will find in the repo. 

Sandy
Reply all
Reply to author
Forward
0 new messages