Unable to complete background tasks to upload project evaluations

[tylers...@gmail.com]

I am running SonarQube 6.0 with a PostgreSQL backend and I have a few projects failing with errors like the one below.  How do I get passed this error to let the project update?

2017.12.15 20:10:59 ERROR [o.s.s.c.t.CeWorkerCallableImpl] Failed to execute task AWBbzP2CqXxW3WfdjReQ

org.sonar.server.computation.component.VisitException: Visit failed for Component {key=my.company.division:division-project-name-web:src/main/java/com/path/to/code/Form.java,type=FILE}  located my.company.division:division-project-name-web:src/main/java/com/path/to/code/package(type=DIRECTORY)->my.company.division:division-project-name-web(type=MODULE)->my.company.division:division-project-name-parent(type=PROJECT)

at org.sonar.server.computation.component.VisitException.rethrowOrWrap(VisitException.java:44) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.component.PathAwareCrawler.visit(PathAwareCrawler.java:52) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.component.PathAwareCrawler.visitChildren(PathAwareCrawler.java:87) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.component.PathAwareCrawler.visitImpl(PathAwareCrawler.java:70) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.component.PathAwareCrawler.visit(PathAwareCrawler.java:50) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.component.PathAwareCrawler.visitChildren(PathAwareCrawler.java:87) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.component.PathAwareCrawler.visitImpl(PathAwareCrawler.java:70) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.component.PathAwareCrawler.visit(PathAwareCrawler.java:50) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.component.PathAwareCrawler.visitChildren(PathAwareCrawler.java:87) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.component.PathAwareCrawler.visitImpl(PathAwareCrawler.java:70) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.component.PathAwareCrawler.visit(PathAwareCrawler.java:50) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.step.NewCoverageMeasuresStep.execute(NewCoverageMeasuresStep.java:122) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.step.ComputationStepExecutor.executeSteps(ComputationStepExecutor.java:64) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.step.ComputationStepExecutor.execute(ComputationStepExecutor.java:52) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.taskprocessor.report.ReportTaskProcessor.process(ReportTaskProcessor.java:75) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.taskprocessor.CeWorkerCallableImpl.executeTask(CeWorkerCallableImpl.java:81) [sonar-server-6.0.jar:na]

at org.sonar.server.computation.taskprocessor.CeWorkerCallableImpl.call(CeWorkerCallableImpl.java:56) [sonar-server-6.0.jar:na]

at org.sonar.server.computation.taskprocessor.CeWorkerCallableImpl.call(CeWorkerCallableImpl.java:35) [sonar-server-6.0.jar:na]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_74]

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [na:1.8.0_74]

at java.util.concurrent.FutureTask.run(FutureTask.java:266) [na:1.8.0_74]

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [na:1.8.0_74]

at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.8.0_74]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_74]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_74]

at java.lang.Thread.run(Thread.java:745) [na:1.8.0_74]

Caused by: java.lang.IllegalStateException: Fail to decompress and deserialize source data [id=667,fileUuid=eee462e8-cb07-4a0a-8c87-b39fb7fe276c,projectUuid=85548569-75b5-442c-a6ac-a7af2951b79b]

at org.sonar.db.source.FileSourceDto.decodeSourceData(FileSourceDto.java:101) ~[sonar-db-6.0.jar:na]

at org.sonar.db.source.FileSourceDto.getSourceData(FileSourceDto.java:212) ~[sonar-db-6.0.jar:na]

at org.sonar.server.computation.scm.ScmInfoRepositoryImpl.getScmInfoFromDb(ScmInfoRepositoryImpl.java:107) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.scm.ScmInfoRepositoryImpl.getScmInfoForComponent(ScmInfoRepositoryImpl.java:90) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.scm.ScmInfoRepositoryImpl.initializeScmInfoForComponent(ScmInfoRepositoryImpl.java:71) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.scm.ScmInfoRepositoryImpl.getScmInfo(ScmInfoRepositoryImpl.java:59) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.step.NewCoverageMeasuresStep$NewCoverageCounter.initialize(NewCoverageMeasuresStep.java:371) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.formula.FormulaExecutorComponentVisitor.processLeaf(FormulaExecutorComponentVisitor.java:165) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.formula.FormulaExecutorComponentVisitor.process(FormulaExecutorComponentVisitor.java:142) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.formula.FormulaExecutorComponentVisitor.visitFile(FormulaExecutorComponentVisitor.java:122) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.component.PathAwareCrawler.visitNode(PathAwareCrawler.java:105) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.component.PathAwareCrawler.visitImpl(PathAwareCrawler.java:73) ~[sonar-server-6.0.jar:na]

at org.sonar.server.computation.component.PathAwareCrawler.visit(PathAwareCrawler.java:50) ~[sonar-server-6.0.jar:na]

... 24 common frames omitted

Caused by: com.google.protobuf.InvalidProtocolBufferException: Stream ended prematurely

at org.sonar.db.protobuf.DbFileSources$Line.<init>(DbFileSources.java:404) ~[sonar-db-6.0.jar:na]

at org.sonar.db.protobuf.DbFileSources$Line.<init>(DbFileSources.java:236) ~[sonar-db-6.0.jar:na]

at org.sonar.db.protobuf.DbFileSources$Line$1.parsePartialFrom(DbFileSources.java:2250) ~[sonar-db-6.0.jar:na]

at org.sonar.db.protobuf.DbFileSources$Line$1.parsePartialFrom(DbFileSources.java:2244) ~[sonar-db-6.0.jar:na]

at com.google.protobuf.CodedInputStream.readMessage(CodedInputStream.java:495) ~[protobuf-java-3.0.0-beta-2.jar:na]

at org.sonar.db.protobuf.DbFileSources$Data.<init>(DbFileSources.java:2356) ~[sonar-db-6.0.jar:na]

at org.sonar.db.protobuf.DbFileSources$Data.<init>(DbFileSources.java:2312) ~[sonar-db-6.0.jar:na]

at org.sonar.db.protobuf.DbFileSources$Data$1.parsePartialFrom(DbFileSources.java:2933) ~[sonar-db-6.0.jar:na]

at org.sonar.db.protobuf.DbFileSources$Data$1.parsePartialFrom(DbFileSources.java:2927) ~[sonar-db-6.0.jar:na]

at com.google.protobuf.AbstractParser.parsePartialFrom(AbstractParser.java:192) ~[protobuf-java-3.0.0-beta-2.jar:na]

at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:210) ~[protobuf-java-3.0.0-beta-2.jar:na]

at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:215) ~[protobuf-java-3.0.0-beta-2.jar:na]

at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49) ~[protobuf-java-3.0.0-beta-2.jar:na]

at org.sonar.db.protobuf.DbFileSources$Data.parseFrom(DbFileSources.java:2478) ~[sonar-db-6.0.jar:na]

at org.sonar.db.source.FileSourceDto.decodeRegularSourceData(FileSourceDto.java:108) ~[sonar-db-6.0.jar:na]

at org.sonar.db.source.FileSourceDto.decodeSourceData(FileSourceDto.java:98) ~[sonar-db-6.0.jar:na]

... 36 common frames omitted

2017.12.15 20:10:59 ERROR [o.s.s.c.t.CeWorkerCallableImpl] Executed task | project=my.company.division:division-project-name-parent | type=REPORT | id=AWBbzP2CqXxW3WfdjReQ | time=9623ms

[Julien Lancelot]

Hi,

Would you mind upgrading to latest LTS of SonarQube (6.7) and try again ?

Regards, 

[Tyler J. Smith]

Hi Julien,

I just upgraded to 6.7.1 LTS today and I am still getting this error when the project evaluates.  Other projects get the error too.  Any idea what is going on?  These projects have over a year of history so I don't want to delete the projects and collect from scratch.

Tyler

--
You received this message because you are subscribed to a topic in the Google Groups "SonarQube" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/sonarqube/_ABNeSrItdc/unsubscribe.
To unsubscribe from this group and all its topics, send an email to sonarqube+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/sonarqube/02b43348-a3c3-4cc0-b6d3-1e16a81bc37b%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Tyler

[Simon Brandhof]

Hi Tyler,

Could you please share the new error logs of version 6.7.1 ?

Thanks

To unsubscribe from this group and all its topics, send an email to sonarqube+...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/sonarqube/02b43348-a3c3-4cc0-b6d3-1e16a81bc37b%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Tyler

--
You received this message because you are subscribed to the Google Groups "SonarQube" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sonarqube+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/sonarqube/CAD88g%2BVqyNQLJMx22Xr7oqBgtbxoa8yssvns46r7w07QJT7PtQ%40mail.gmail.com.

For more options, visit https://groups.google.com/d/optout.

--

Simon Brandhof | SonarSource

Co-Founder & Tech Lead

@SimonBrandhof

http://sonarsource.com

[Tyler J. Smith]

Hi Simon,

Here is the log provided by the background task.  I scrubbed company information from the log so it might look different than the one I provided earlier.  Might this be a problem with not enough memory?  After I saw this I increased RAM by another 1GB.  This is running as a Docker image at AWS ECS Fargate so I can bump up memory pretty easily if needed.


org.sonar.server.computation.task.projectanalysis.component.VisitException: Visit failed for Component {key=com.company.division:project-name-ejb:src/main/java/com/company/jdc/ccd/app/common/SimpleStaticDataMgmtService.java,type=FILE}  located com.company.division:project-name-ejb:src/main/java/com/company/jdc/ccd/app/common(type=DIRECTORY)->com.company.division:project-name-ejb(type=MODULE)->com.company.division:project-name-parent(type=PROJECT)
    at org.sonar.server.computation.task.projectanalysis.component.VisitException.rethrowOrWrap(VisitException.java:44)
    at org.sonar.server.computation.task.projectanalysis.component.PathAwareCrawler.visit(PathAwareCrawler.java:52)
    at org.sonar.server.computation.task.projectanalysis.component.PathAwareCrawler.visitChildren(PathAwareCrawler.java:87)
    at org.sonar.server.computation.task.projectanalysis.component.PathAwareCrawler.visitImpl(PathAwareCrawler.java:70)
    at org.sonar.server.computation.task.projectanalysis.component.PathAwareCrawler.visit(PathAwareCrawler.java:50)
    at org.sonar.server.computation.task.projectanalysis.component.PathAwareCrawler.visitChildren(PathAwareCrawler.java:87)
    at org.sonar.server.computation.task.projectanalysis.component.PathAwareCrawler.visitImpl(PathAwareCrawler.java:70)
    at org.sonar.server.computation.task.projectanalysis.component.PathAwareCrawler.visit(PathAwareCrawler.java:50)
    at org.sonar.server.computation.task.projectanalysis.component.PathAwareCrawler.visitChildren(PathAwareCrawler.java:87)
    at org.sonar.server.computation.task.projectanalysis.component.PathAwareCrawler.visitImpl(PathAwareCrawler.java:70)
    at org.sonar.server.computation.task.projectanalysis.component.PathAwareCrawler.visit(PathAwareCrawler.java:50)
    at org.sonar.server.computation.task.projectanalysis.step.NewCoverageMeasuresStep.execute(NewCoverageMeasuresStep.java:109)
    at org.sonar.server.computation.task.step.ComputationStepExecutor.executeSteps(ComputationStepExecutor.java:64)
    at org.sonar.server.computation.task.step.ComputationStepExecutor.execute(ComputationStepExecutor.java:52)
    at org.sonar.server.computation.task.projectanalysis.taskprocessor.ReportTaskProcessor.process(ReportTaskProcessor.java:73)
    at org.sonar.ce.taskprocessor.CeWorkerImpl.executeTask(CeWorkerImpl.java:134)
    at org.sonar.ce.taskprocessor.CeWorkerImpl.findAndProcessTask(CeWorkerImpl.java:97)
    at org.sonar.ce.taskprocessor.CeWorkerImpl.withCustomizedThreadName(CeWorkerImpl.java:81)
    at org.sonar.ce.taskprocessor.CeWorkerImpl.call(CeWorkerImpl.java:73)
    at org.sonar.ce.taskprocessor.CeWorkerImpl.call(CeWorkerImpl.java:43)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
    at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalStateException: Fail to decompress and deserialize source data [id=4215,fileUuid=85538b17-d0d8-4a68-9fb0-ef0fcdcb77d8,projectUuid=3c834bdf-d78e-49d5-bfb3-088de02f86d6]
    at org.sonar.db.source.FileSourceDto.decodeSourceData(FileSourceDto.java:101)
    at org.sonar.db.source.FileSourceDto.getSourceData(FileSourceDto.java:212)
    at org.sonar.server.computation.task.projectanalysis.scm.ScmInfoDbLoader.getScmInfoFromDb(ScmInfoDbLoader.java:65)
    at org.sonar.server.computation.task.projectanalysis.scm.ScmInfoRepositoryImpl.getScmInfoForComponent(ScmInfoRepositoryImpl.java:80)
    at org.sonar.server.computation.task.projectanalysis.scm.ScmInfoRepositoryImpl.initializeScmInfoForComponent(ScmInfoRepositoryImpl.java:61)
    at org.sonar.server.computation.task.projectanalysis.scm.ScmInfoRepositoryImpl.getScmInfo(ScmInfoRepositoryImpl.java:49)
    at org.sonar.server.computation.task.projectanalysis.step.NewCoverageMeasuresStep$NewCoverageCounter.initialize(NewCoverageMeasuresStep.java:253)
    at org.sonar.server.computation.task.projectanalysis.formula.FormulaExecutorComponentVisitor.processLeaf(FormulaExecutorComponentVisitor.java:165)
    at org.sonar.server.computation.task.projectanalysis.formula.FormulaExecutorComponentVisitor.process(FormulaExecutorComponentVisitor.java:142)
    at org.sonar.server.computation.task.projectanalysis.formula.FormulaExecutorComponentVisitor.visitFile(FormulaExecutorComponentVisitor.java:122)
    at org.sonar.server.computation.task.projectanalysis.component.PathAwareCrawler.visitNode(PathAwareCrawler.java:105)
    at org.sonar.server.computation.task.projectanalysis.component.PathAwareCrawler.visitImpl(PathAwareCrawler.java:73)
    at org.sonar.server.computation.task.projectanalysis.component.PathAwareCrawler.visit(PathAwareCrawler.java:50)
    ... 26 more

Caused by: com.google.protobuf.InvalidProtocolBufferException: Stream ended prematurely

    at org.sonar.db.protobuf.DbFileSources$Line.<init>(DbFileSources.java:443)
    at org.sonar.db.protobuf.DbFileSources$Line.<init>(DbFileSources.java:257)
    at org.sonar.db.protobuf.DbFileSources$Line$1.parsePartialFrom(DbFileSources.java:2460)
    at org.sonar.db.protobuf.DbFileSources$Line$1.parsePartialFrom(DbFileSources.java:2454)
    at com.google.protobuf.CodedInputStream.readMessage(CodedInputStream.java:495)
    at org.sonar.db.protobuf.DbFileSources$Data.<init>(DbFileSources.java:2566)
    at org.sonar.db.protobuf.DbFileSources$Data.<init>(DbFileSources.java:2522)
    at org.sonar.db.protobuf.DbFileSources$Data$1.parsePartialFrom(DbFileSources.java:3143)
    at org.sonar.db.protobuf.DbFileSources$Data$1.parsePartialFrom(DbFileSources.java:3137)
    at com.google.protobuf.AbstractParser.parsePartialFrom(AbstractParser.java:192)
    at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:210)
    at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:215)
    at com.google.protobuf.AbstractParser.parseFrom(AbstractParser.java:49)
    at org.sonar.db.protobuf.DbFileSources$Data.parseFrom(DbFileSources.java:2688)
    at org.sonar.db.source.FileSourceDto.decodeRegularSourceData(FileSourceDto.java:108)
    at org.sonar.db.source.FileSourceDto.decodeSourceData(FileSourceDto.java:98)
    ... 38 more

On Thu, Feb 8, 2018 at 2:45 AM, Simon Brandhof <simon.b...@sonarsource.com> wrote:

Hi Tyler,

Could you please share the new error logs of version 6.7.1 ?

Thanks

On Thu, 8 Feb 2018 at 04:04 Tyler J. Smith <tylers...@gmail.com> wrote:

Hi Julien,

I just upgraded to 6.7.1 LTS today and I am still getting this error when the project evaluates.  Other projects get the error too.  Any idea what is going on?  These projects have over a year of history so I don't want to delete the projects and collect from scratch.

Tyler

To unsubscribe from this group and all its topics, send an email to sonarqube+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/sonarqube/02b43348-a3c3-4cc0-b6d3-1e16a81bc37b%40googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

--

Tyler

--

You received this message because you are subscribed to the Google Groups "SonarQube" group.

To unsubscribe from this group and stop receiving emails from it, send an email to sonarqube+unsubscribe@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/sonarqube/CAD88g%2BVqyNQLJMx22Xr7oqBgtbxoa8yssvns46r7w07QJT7PtQ%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

--

Simon Brandhof | SonarSource

Co-Founder & Tech Lead

@SimonBrandhof

http://sonarsource.com

--

Tyler

[Sebastien Lesaint]

Hello Tyler,

The sources stored in database for a file appear to be corrupted.

You have the name and module of the faulty file in the stacktrace.

Add this file to the exclusions of the project. Run an analysis, it should then successful.

You should then be able to remove the file from exclusions and resume analyzing it.

Cheers,

Sébastien LESAINT | SonarSource
Platform Developer

https://sonarsource.com

To view this discussion on the web visit https://groups.google.com/d/msgid/sonarqube/CAD88g%2BURH8jS_F%3DA8iqn%3Ddhvd_mkKZOi326xUEgaga5gzA9SPA%40mail.gmail.com.