make test failing on OSX 10.11 (specifically M2Crypto)

471 views
Skip to first unread message

Graham Dunn

unread,
Oct 15, 2015, 12:02:39 PM10/15/15
to Simian Discuss
The swig compiled and installed by make swig (1.3.40) is causing problems when trying to install the M2Crypto 0.22.5 egg.

running google_test
Searching for M2Crypto==0.22.5
Best match: M2Crypto 0.22.5
Processing M2Crypto-0.22.5.tar.gz
Writing /var/folders/b_/wzz1323d2fsgzcrfvwj0dm600000gp/T/easy_install-ZTtJPB/M2Crypto-0.22.5/setup.cfg
Running M2Crypto-0.22.5/setup.py -q bdist_egg --dist-dir /var/folders/b_/wzz1323d2fsgzcrfvwj0dm600000gp/T/easy_install-ZTtJPB/M2Crypto-0.22.5/egg-dist-tmp-eDHbVJ
warning: no previously-included files found matching 'M2Crypto/_m2crypto.py'
swig error : Unrecognized option -builtin
Use 'swig -help' for available options.
error: Setup script exited with error: command 'swig' failed with exit status 1
make: *** [test] Error 1

Apparently the -builtin option was added in swig 2.0.4, trying the version of swig from homebrew (3.0.7) has problems as well:

➜  simian git:(master) ✗ make test
/usr/bin/python2.6 -c 'import virtualenv' || \
sudo easy_install-2.6 -U virtualenv==1.10.1
[ -d VE ] || \
/usr/bin/python2.6 /usr/local/bin/virtualenv --no-site-packages VE
[ -f test ] || \
env SIMIAN_CONFIG_PATH="/Users/gdunn/src/simian/etc/simian/" \
VE/bin/python setup.py google_test && touch test && \
echo ALL TESTS COMPLETED SUCCESSFULLY
running google_test
Searching for M2Crypto==0.22.5
Best match: M2Crypto 0.22.5
Processing M2Crypto-0.22.5.tar.gz
Writing /var/folders/b_/wzz1323d2fsgzcrfvwj0dm600000gp/T/easy_install-B4iFQm/M2Crypto-0.22.5/setup.cfg
Running M2Crypto-0.22.5/setup.py -q bdist_egg --dist-dir /var/folders/b_/wzz1323d2fsgzcrfvwj0dm600000gp/T/easy_install-B4iFQm/M2Crypto-0.22.5/egg-dist-tmp-a2YWs_
warning: no previously-included files found matching 'M2Crypto/_m2crypto.py'
SWIG/_m2crypto.i:31: Error: Unable to find 'openssl/opensslv.h'
SWIG/_m2crypto.i:45: Error: Unable to find 'openssl/safestack.h'
SWIG/_evp.i:12: Error: Unable to find 'openssl/opensslconf.h'
SWIG/_ec.i:7: Error: Unable to find 'openssl/opensslconf.h'
error: Setup script exited with error: command 'swig' failed with exit status 1
make: *** [test] Error 1

Justin McWilliams

unread,
Oct 15, 2015, 1:52:48 PM10/15/15
to Simian Discuss
Relevant to this thread as well, using (current default) M2Crypto-0.22.3 Graham encountered this error (different than above):

Searching for M2Crypto==0.22.3
Reading https://pypi.python.org/simple/M2Crypto/
Best match: M2Crypto 0.22.3
Downloading https://pypi.python.org/packages/source/M/M2Crypto/M2Crypto-0.22.3.tar.gz#md5=573f21aaac7d5c9549798e72ffcefedd
Processing M2Crypto-0.22.3.tar.gz
Writing /var/folders/b_/wzz1323d2fsgzcrfvwj0dm600000gp/T/easy_install-gMCh81/M2Crypto-0.22.3/setup.cfg
Running M2Crypto-0.22.3/setup.py -q bdist_egg --dist-dir /var/folders/b_/wzz1323d2fsgzcrfvwj0dm600000gp/T/easy_install-gMCh81/M2Crypto-0.22.3/egg-dist-tmp-qKMbHF
SWIG/_m2crypto.i:30: Error: Unable to find 'openssl/opensslv.h'
SWIG/_m2crypto.i:33: Error: Unable to find 'openssl/safestack.h'

SWIG/_evp.i:12: Error: Unable to find 'openssl/opensslconf.h'
SWIG/_ec.i:7: Error: Unable to find 'openssl/opensslconf.h'
error: Setup script exited with error: command 'swig' failed with exit status 1
make: *** [test] Error 1

--
You received this message because you are subscribed to the Google Groups "Simian Discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to simian-discus...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Justin McWilliams

unread,
Oct 21, 2015, 6:13:45 PM10/21/15
to Simian Discuss
I hope to get to this by end of week.

Is anyone else having issues running tests / building on 10.11?

Thomas Maerz

unread,
Oct 30, 2015, 2:52:31 PM10/30/15
to Simian Discuss
Yes. 10.11, XCode 7.1, Command Line tools installed, make test yields:

Installed /Users/tmaerz/simian/WebOb-1.5.0-py2.6.egg
Searching for M2Crypto==0.22.3
Best match: M2Crypto 0.22.3
Processing M2Crypto-0.22.3.tar.gz
Writing /var/folders/bc/yzncd9zd34bcq_kr3qzp32fm0000gn/T/easy_install-D25umA/M2Crypto-0.22.3/setup.cfg
Running M2Crypto-0.22.3/setup.py -q bdist_egg --dist-dir /var/folders/bc/yzncd9zd34bcq_kr3qzp32fm0000gn/T/easy_install-D25umA/M2Crypto-0.22.3/egg-dist-tmp-znno9L
SWIG/_m2crypto.i:30: Error: Unable to find 'openssl/opensslv.h'
SWIG/_m2crypto.i:33: Error: Unable to find 'openssl/safestack.h'
SWIG/_evp.i:12: Error: Unable to find 'openssl/opensslconf.h'
SWIG/_ec.i:7: Error: Unable to find 'openssl/opensslconf.h'
error: Setup script exited with error: command 'swig' failed with exit status 1
make: *** [test] Error 1
tmaerzimac:simian tmaerz$ make test
/usr/bin/python2.6 -c 'import virtualenv' || \
sudo easy_install-2.6 -U virtualenv==1.10.1
[ -d VE ] || \
/usr/bin/python2.6 /usr/local/bin/virtualenv --no-site-packages VE
[ -f test ] || \
env SIMIAN_CONFIG_PATH="/Users/tmaerz/simian/etc/simian/" \
VE/bin/python setup.py google_test && touch test && \
echo ALL TESTS COMPLETED SUCCESSFULLY
running google_test
Searching for M2Crypto==0.22.3
Best match: M2Crypto 0.22.3
Processing M2Crypto-0.22.3.tar.gz
Writing /var/folders/bc/yzncd9zd34bcq_kr3qzp32fm0000gn/T/easy_install-BScByr/M2Crypto-0.22.3/setup.cfg
Running M2Crypto-0.22.3/setup.py -q bdist_egg --dist-dir /var/folders/bc/yzncd9zd34bcq_kr3qzp32fm0000gn/T/easy_install-BScByr/M2Crypto-0.22.3/egg-dist-tmp-3EvEZv
SWIG/_m2crypto.i:30: Error: Unable to find 'openssl/opensslv.h'
SWIG/_m2crypto.i:33: Error: Unable to find 'openssl/safestack.h'
SWIG/_evp.i:12: Error: Unable to find 'openssl/opensslconf.h'
SWIG/_ec.i:7: Error: Unable to find 'openssl/opensslconf.h'
error: Setup script exited with error: command 'swig' failed with exit status 1
make: *** [test] Error 1

Michael Holt

unread,
Nov 24, 2015, 6:35:23 PM11/24/15
to Simian Discuss
any progress made on this? I just tried building on 10.11.1 and encountered the same issue

Justin McWilliams

unread,
Nov 24, 2015, 6:55:29 PM11/24/15
to Simian Discuss
The only progress I've got in the past couple of weeks is:
1) upgrade my OS X machine to 10.11
2) reproduce this issue

But I haven't yet gotten time to investigate a fix.  We've seen very similar issues in the past with incompatible versions of swig and M2Crypto, and this time I've tried a few different combinations all of which yield this or other issues.

For now, the workaround is to build on 10.10 or earlier; note, building clients targeted for deployment on 10.11 this way should work as expected, as the issue is with M2Crypto needed for tests, not the client itself.

One possible approach I'd like to try is using the pre-compiled M2Crypto (the same one we include for the clients) in the build/test cases as well, entirely avoiding the need to compile M2Crypto for test purposes, and thus avoiding this recurring issue going forward.

Given the holidays are coming up, my "day job" plate is becoming cleaner by the day, so I hope to dedicate some time on this...

Michael Holt

unread,
Nov 24, 2015, 6:57:05 PM11/24/15
to Simian Discuss
Ok thanks for the update! I’ll spin up a 10.10 VM for now to build

---------------------------

Real Life Church

Michael Holt / IT Administrator
(661) 705-4711/ mh...@reallifechurch.org

Real Life Church Office: (661) 775-7401 
23841 Newhall Ranch Rd
Valencia, CA 91355
http://www.reallifechurch.org

This e-mail message may contain confidential or legally privileged information and is intended only for the use of the intended recipient(s). Any unauthorized disclosure, dissemination, distribution, copying or the taking of any action in reliance on the information herein is prohibited. E-mails are not secure and cannot be guaranteed to be error free as they can be intercepted, amended, or contain viruses. Anyone who communicates with us by e-mail is deemed to have accepted these risks. Company Name is not responsible for errors or omissions in this message and denies any responsibility for any damage arising from the use of e-mail. Any opinion and other statement contained in this message and any attachment are solely those of the author and do not necessarily represent those of the company.

Justin McWilliams

unread,
Nov 24, 2015, 7:40:38 PM11/24/15
to Simian Discuss
On Tue, Nov 24, 2015 at 6:54 PM, Justin McWilliams <og...@google.com> wrote:
The only progress I've got in the past couple of weeks is:
1) upgrade my OS X machine to 10.11
2) reproduce this issue

But I haven't yet gotten time to investigate a fix.  We've seen very similar issues in the past with incompatible versions of swig and M2Crypto, and this time I've tried a few different combinations all of which yield this or other issues.

For now, the workaround is to build on 10.10 or earlier; note, building clients targeted for deployment on 10.11 this way should work as expected, as the issue is with M2Crypto needed for tests, not the client itself.

One possible approach I'd like to try is using the pre-compiled M2Crypto (the same one we include for the clients) in the build/test cases as well, entirely avoiding the need to compile M2Crypto for test purposes, and thus avoiding this recurring issue going forward.

I've done exactly this, and it fixed build and tests on my 10.11 box:

 
Please give it a whirl and let me know.

Michael Holt

unread,
Nov 24, 2015, 7:52:39 PM11/24/15
to simian-...@googlegroups.com
Just left the office but I'll give it a try tomorrow 

Graham Dunn

unread,
Nov 27, 2015, 10:58:08 AM11/27/15
to simian-...@googlegroups.com
I pulled master this morning and make test completes!

Thanks,
Graham

--
You received this message because you are subscribed to a topic in the Google Groups "Simian Discuss" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/simian-discuss/fGUUQJzrY_Y/unsubscribe.
To unsubscribe from this group and all its topics, send an email to simian-discus...@googlegroups.com.

Michael Holt

unread,
Nov 27, 2015, 12:35:14 PM11/27/15
to simian-...@googlegroups.com
Sorry forgot to respond the other day, worked for me too

Justin McWilliams

unread,
Nov 27, 2015, 12:41:29 PM11/27/15
to Simian Discuss

Good to hear!  Here's to hoping this strategy will be more stable with future OS X releases...

// mobile

Reply all
Reply to author
Forward
0 new messages