OS X test machine & expertise needed

40 views
Skip to first unread message

Michael Crusoe

unread,
Jul 26, 2016, 6:19:45 AM7/26/16
to common-workf...@googlegroups.com
Hello all,

We have a hole in our testing infrastructure: OS X.

We could run tests using Travis CI's OS X support, but for troubleshooting I don't personally have access to any OS X computers.

If you, or someone you know, can donate access to an OS X computer I would appreciate it. Since I rarely work on OS X myself I would also appreciate assistance debugging the recent reports of problems with cwltool+OS X+docker.

Thanks! 

--
Michael R. Crusoe
Community Engineer & Co-founder
Common Workflow Language project
https://impactstory.org/u/0000-0002-2961-9670
michael...@gmail.com
+32 (0) 2 808 25 58
+1 480 627 9108

Roman Valls

unread,
Jul 27, 2016, 3:38:21 AM7/27/16
to Michael Crusoe, common-workf...@googlegroups.com
Hi Michael,

I assume you would want to test the
https://github.com/common-workflow-language/workflows repo? I'm still
a bit confused about the CI/CD mashup between different components and
repos... in the main page there's a reference to Curoverse's Jenkins
CI, but I guess newcomers might have a hard time figuring out what's
the current state and where things are tested.

Once I sort this in my head, I could try adding up a minimal TravisCI
target for OSX perhaps?

Cheers!
Roman
> --
> You received this message because you are subscribed to the Google Groups
> "common-workflow-language" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to common-workflow-la...@googlegroups.com.
> To post to this group, send email to
> common-workf...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/common-workflow-language/CAD%3DWrc%2BS%2Bpii%2BzmV9S4pJMnLSh-3csYVbrxUgwgR%2BLjnrbsoNw%40mail.gmail.com.
> For more options, visit https://groups.google.com/d/optout.

Alex Barrera

unread,
Jul 28, 2016, 5:44:10 PM7/28/16
to common-workflow-language, michael...@gmail.com
Hi,

I also assumed Michael was referring to https://github.com/common-workflow-language/workflows, however the fact that there is no cwltool google group and that many cwltool related questions land in this forum makes it a bit confusing. Maybe is a good time to create a dedicated cwltool google group? Just an idea.

That aside, I'm also a bit puzzled by the CI setup. It seems that the workflows repo has TravisCI integration, but there is no reference to it in the README.md. 

I see that currently the workflows repo is not passing the tests, apparently because of the problem with parsing hints. However, even if that wasn't a problem, I don't see any reference to how to download the files needed for the tests.. what am I missing?

I wouldn't mind to try to add os x support once I understand better the current testing setup.

Best,
Alex 

Michael Crusoe

unread,
Aug 9, 2016, 9:02:48 AM8/9/16
to Alex Barrera, common-workflow-language
Thanks all for the replies.

Here is the state of testing:

https://ci.commonwl.org is a Linux server running Jenkins (hosted for free by Rackspace) that tests conformance of all F/OSS CWL implementations as they are updated or as the standard is updated.


None of the CWL implementations, including the reference implementation, are tested on OS X. This could be accomplished by setting up Jenkins to remotely run tests or by using TravisCI to accomplish the same thing. 

The other topic is the testing of the Workflows. Ideally we would test them using actual (small) data sets, but that has proven to be tricky. Previously we had conformance style tests that just looked at the constructed command lines without running them but that script has gotten out of date with how cwltest works.




> To post to this group, send email to



--
Michael R. Crusoe
Community Engineer & Co-founder
Common Workflow Language project
https://impactstory.org/u/0000-0002-2961-9670
michael...@gmail.com
Reply all
Reply to author
Forward
0 new messages