Travis, Maven & Flaky Tests

[Sam Berlin]

Hi All,

We've setup Travis for continuous integration for Guice.  There were a few flaky tests (that for some reason weren't flaking for us internally), but I've cut those down to now just a single flake that I need to spend some more time with.

One remaining issue is that Maven on Travis seems to occasionally stall while downloading dependencies, and Travis times out after 10 minutes of "no output".  Here's some examples: link1, link2.  

Is anyone familiar with this?  Any idea if we can do anything to fix it?

I think we're just about set on GitHub now.  I've cleaned up all the various links to codesite so everything points to GitHub now, and redirected the codesite page as much as possible to GitHub.  (I don't want to use the "move project" admin settings, because we still need it alive to link back to binary issue attachments that GitHub can't host.)

Thanks!

sam

[Stuart McCulloch]

On 11 Jul 2014, at 14:24, Sam Berlin <sbe...@gmail.com> wrote:

Hi All,

We've setup Travis for continuous integration for Guice.  There were a few flaky tests (that for some reason weren't flaking for us internally), but I've cut those down to now just a single flake that I need to spend some more time with.

One remaining issue is that Maven on Travis seems to occasionally stall while downloading dependencies, and Travis times out after 10 minutes of "no output".  Here's some examples: link1, link2.  

Is anyone familiar with this?  Any idea if we can do anything to fix it?

It looks odd that it’s querying https://repository.apache.org when Guice should be able to build against just Central (which is backed by a CDN) - does the travis configuration use a different profile or maven settings file?

I think we're just about set on GitHub now.  I've cleaned up all the various links to codesite so everything points to GitHub now, and redirected the codesite page as much as possible to GitHub.  (I don't want to use the "move project" admin settings, because we still need it alive to link back to binary issue attachments that GitHub can't host.)

Thanks!

sam

--
You received this message because you are subscribed to the Google Groups "google-guice" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-guice...@googlegroups.com.
To post to this group, send email to google...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-guice.
To view this discussion on the web visit https://groups.google.com/d/msgid/google-guice/CAJEBNUeQi9cV7JpN3NrOMmyBTf54%2B4nZwb0xAeA6qo0%3D-dRHvA%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[Sam Berlin]

We're using:  mvn dependency:go-offline test clean --fail-never -DskipTests=true

... but, I experienced the same thing when testing with just 'mvn install' on Travis.

There's nothing else special that I know of.  Maybe the $HOME on Travis jobs has some special configuration parameters that tell it to not use central?  Googling doesn't turn up anything that seems related, short of an issue to cache maven artifacts to avoid the download time.

When I try to do an mvn install or dependency:go-offline locally, it downloads from repo.maven.apache.org.

sam

To view this discussion on the web visit https://groups.google.com/d/msgid/google-guice/BF11198C-AA05-4A3C-AD47-4ECE2994F091%40gmail.com.

[Stuart McCulloch]

Note that https://repository.apache.org is the Apache Foundation staging repository for Apache projects, not Central (http://repo.maven.apache.org) and is on a single box without a CDN.

It’s odd to see it in the logs because Maven is not configured to use that repository by default, which makes me think that the Travis config is using a custom settings.xml with additional repositories - and that custom settings.xml has an non-optimal ordering of the repositories in that it’s querying https://repository.apache.org before querying Central. Is there a way we can find out what settings.xml Travis uses and if there’s a way to choose a different one?

PS. I just tried "mvn dependency:go-offline test clean --fail-never -DskipTests=true" locally with an empty repository and the default settings.xml that ships with Maven and it never queries https://repository.apache.org

To view this discussion on the web visit https://groups.google.com/d/msgid/google-guice/CAJEBNUf12p5J0x1Wn0YFuVgcMPcrP0HcQ6Uevo3ZPTMY9TjdAQ%40mail.gmail.com.

[Sam Berlin]

I could write a custom script that runs during install to print out various stuff about the environment.  See https://github.com/google/guice/blob/master/generate-latest-docs.sh for an example script that runs after successful builds.  Where would the settings.xml live?

sam

To view this discussion on the web visit https://groups.google.com/d/msgid/google-guice/AC6EA1B2-A7C5-4348-9492-8EABD627EEBC%40gmail.com.

[Stuart McCulloch]

You can use “mvn -V -X” to enable debug logging which will print the location of the settings.xml at the start

To view this discussion on the web visit https://groups.google.com/d/msgid/google-guice/CAJEBNUfYv-q3ZKbZHMxfdWZsxECcEEPjCmU70Y%2BC0By96mbitQ%40mail.gmail.com.

[Sam Berlin]

Awesome, thanks. I'll poke around and see what turns up.

sam

To view this discussion on the web visit https://groups.google.com/d/msgid/google-guice/51DEE776-3F43-46B0-A6F2-3C2D245C1382%40gmail.com.

[Stuart McCulloch]

BTW, the debug logging is very verbose so I’d only use it to find the location and then switch it off again to avoid littering the build logs :)

I also did some digging in the Travis docs and it looks like they have a 'standard-with-extra-repos’ profile which is enabled by default and this defines the extra repositories.

You should be able to turn that profile off with:

mvn '-P!standard-with-extra-repos' …etc...

(single-quotes to protect the ! operator on linux)

To view this discussion on the web visit https://groups.google.com/d/msgid/google-guice/CAJEBNUdJeaJ-MDPsYyAEPoOTsbrkvx4K5%2B02EVPv-aXh7h7O%2Bg%40mail.gmail.com.

[Sam Berlin]

I captured the settings.xml files @ https://gist.github.com/sameb/fe709b8a0495df149b40.

To view this discussion on the web visit https://groups.google.com/d/msgid/google-guice/0B711EF2-E77F-449F-BC2C-F6F44F1A70CE%40gmail.com.

[Sam Berlin]

... and looks like adding the '-P!standard-with-extra-repos'  fixes things to download from the correct spot.  Should I open an issue with the Travis folks to tell them their defaults are bad?

sam

[Sam Berlin]

FYI, I filed https://github.com/travis-ci/travis-ci/issues/2528 for Travis about the bad defaults.

sam