Re: Porting OpenNMS to FreeBSD 10.x with OpenJDK7

[Paul Pathiakis via freebsd-java]

Well, I'm kind of at a dead stop here. Does anyone have input into this?

To me, it looks like the runaway process got killed by the OS once it
had consumed a whole bunch of resources.

Does anyone see anything different? Does anyone have a direction I
should go in?

Thank you,

P.


On 11/21/2014 09:26, Paul Pathiakis wrote:
> Ed,
>
> Thank you for the assist in showing me how to get a backtrace so we
> didn't spam. I'll post here.
>
> # gdb /usr/local/openjdk7/bin/java java.core
> GNU gdb 6.1.1 [FreeBSD]
> Copyright 2004 Free Software Foundation, Inc.
> GDB is free software, covered by the GNU General Public License, and
> you are
> welcome to change it and/or distribute copies of it under certain
> conditions.
> Type "show copying" to see the conditions.
> There is absolutely no warranty for GDB. Type "show warranty" for
> details.
> This GDB was configured as "amd64-marcel-freebsd"...(no debugging
> symbols found)...
> Core was generated by `java'.
> Program terminated with signal 6, Aborted.
> Reading symbols from /lib/libz.so.6...(no debugging symbols
> found)...done.
> Loaded symbols for /lib/libz.so.6
> Reading symbols from /lib/libthr.so.3...(no debugging symbols
> found)...done.
> Loaded symbols for /lib/libthr.so.3
> Reading symbols from /lib/libc.so.7...(no debugging symbols
> found)...done.
> Loaded symbols for /lib/libc.so.7
> Reading symbols from
> /usr/local/openjdk7/jre/lib/amd64/server/libjvm.so...(no debugging
> symbols found)...done.
> Loaded symbols for /usr/local/openjdk7/jre/lib/amd64/server/libjvm.so
> Reading symbols from /lib/libm.so.5...(no debugging symbols
> found)...done.
> Loaded symbols for /lib/libm.so.5
> Reading symbols from /usr/lib/libc++.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /usr/lib/libc++.so.1
> Reading symbols from /lib/libcxxrt.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /lib/libcxxrt.so.1
> Reading symbols from /lib/libgcc_s.so.1...(no debugging symbols
> found)...done.
> Loaded symbols for /lib/libgcc_s.so.1
> Reading symbols from
> /usr/local/openjdk7/jre/lib/amd64/libverify.so...Reading symbols from
> /usr/local/openjdk7/jre/lib/amd64/libverify.debuginfo...done.
> done.
> Loaded symbols for /usr/local/openjdk7/jre/lib/amd64/libverify.so
> Reading symbols from /usr/local/openjdk7/jre/lib/amd64/libjava.so...done.
> Loaded symbols for /usr/local/openjdk7/jre/lib/amd64/libjava.so
> Reading symbols from /usr/local/openjdk7/jre/lib/amd64/libzip.so...done.
> Loaded symbols for /usr/local/openjdk7/jre/lib/amd64/libzip.so
> Reading symbols from
> /usr/local/openjdk7/jre/lib/amd64/libmanagement.so...Reading symbols
> from /usr/local/openjdk7/jre/lib/amd64/libmanagement.debuginfo...done.
> done.
> Loaded symbols for /usr/local/openjdk7/jre/lib/amd64/libmanagement.so
> Reading symbols from /usr/local/openjdk7/jre/lib/amd64/libnet.so...done.
> Loaded symbols for /usr/local/openjdk7/jre/lib/amd64/libnet.so
> Reading symbols from /usr/local/openjdk7/jre/lib/amd64/libnio.so...done.
> Loaded symbols for /usr/local/openjdk7/jre/lib/amd64/libnio.so
> Reading symbols from /usr/local/lib/libjicmp.so...done.
> Loaded symbols for /usr/local/lib/libjicmp.so
> Reading symbols from /usr/local/lib/libjicmp6.so...done.
> Loaded symbols for /usr/local/lib/libjicmp6.so
> Reading symbols from
> /usr/local/openjdk7/jre/lib/amd64/libsunec.so...done.
> Loaded symbols for /usr/local/openjdk7/jre/lib/amd64/libsunec.so
> Reading symbols from
> /usr/local/opennms/data/tmp/jna7571192420975492788.tmp...done.
> Loaded symbols for /usr/local/opennms/data/tmp/jna7571192420975492788.tmp
> Reading symbols from /libexec/ld-elf.so.1...done.
> Loaded symbols for /libexec/ld-elf.so.1
> #0 0x0000000800ccc26a in thr_kill () from /lib/libc.so.7
> [New Thread 8f37c8800 (LWP 102483/java)]
> [New Thread 8f7773800 (LWP 102482/java)]
> [New Thread 8f3dc5400 (LWP 102481/java)]
> [New Thread 8f3dc4800 (LWP 102480/java)]
> [New Thread 8f4978000 (LWP 102479/java)]
> [New Thread 8f4977400 (LWP 102478/java)]
> [New Thread 8f24ce800 (LWP 102477/java)]
> [New Thread 8f24ce400 (LWP 102476/java)]
> [New Thread 8f521b800 (LWP 102475/java)]
> [New Thread 8f521ac00 (LWP 102474/java)]
> [New Thread 8f4d9f400 (LWP 102473/java)]
> [New Thread 8f4d9e800 (LWP 102472/java)]
> [New Thread 8e8abd800 (LWP 102471/java)]
> [New Thread 8e8f97800 (LWP 102470/java)]
> [New Thread 8e8e6f800 (LWP 102468/java)]
> [New Thread 8f381d400 (LWP 102467/java)]
> [New Thread 8f381c800 (LWP 102466/java)]
> [New Thread 8f2accc00 (LWP 102465/java)]
> [New Thread 8f2acc000 (LWP 102464/java)]
> [New Thread 8f2f0c400 (LWP 102463/java)]
> [New Thread 8f2d88c00 (LWP 102462/java)]
> [New Thread 8f31cac00 (LWP 102461/java)]
> [New Thread 8f31bb400 (LWP 102460/java)]
> [New Thread 8e86fc400 (LWP 102459/java)]
> [New Thread 8e86c1c00 (LWP 102458/java)]
> [New Thread 8e8aa6800 (LWP 102456/java)]
> [New Thread 8f2391400 (LWP 102400/java)]
> [New Thread 8fc3f1000 (LWP 102399/java)]
> [New Thread 801437000 (LWP 102393/java)]
> [New Thread 8f2a59800 (LWP 102389/java)]
> [New Thread 8fc3ef400 (LWP 102388/java)]
> [New Thread 8fc3ec800 (LWP 102387/java)]
> [New Thread 8f2abd800 (LWP 102379/java)]
> [New Thread 8f24cec00 (LWP 102374/java)]
> [New Thread 8fcc87c00 (LWP 102373/java)]
> [New Thread 8fc3e7800 (LWP 102370/java)]
> [New Thread 8f341b400 (LWP 102368/java)]
> [New Thread 8fcc88800 (LWP 102367/java)]
> [New Thread 8e86b3000 (LWP 102365/java)]
> [New Thread 8fc3ee000 (LWP 102271/java)]
> [New Thread 8fcc89400 (LWP 102270/java)]
> [New Thread 8fc8d4400 (LWP 102145/java)]
> [New Thread 8f238c000 (LWP 101271/java)]
> [New Thread 8f491fc00 (LWP 100220/java)]
> [New Thread 8fc8d0400 (LWP 100149/java)]
> [New Thread 8fc3e5800 (LWP 101744/java)]
> [New Thread 8f3157400 (LWP 101727/java)]
> [New Thread 8f2d89000 (LWP 101715/java)]
> [New Thread 8f6620800 (LWP 101628/java)]
> [New Thread 8fc3ea400 (LWP 101456/java)]
> [New Thread 8fcc84800 (LWP 101929/java)]
> [New Thread 8fcc8a000 (LWP 101928/java)]
> [New Thread 8fc3e5400 (LWP 101927/java)]
> [New Thread 8fc3e4800 (LWP 101925/java)]
> [New Thread 8e7dda000 (LWP 101924/java)]
> [New Thread 8fc3e4400 (LWP 101923/java)]
> [New Thread 8f297cc00 (LWP 101921/java)]
> [New Thread 8fc3e7000 (LWP 101920/java)]
> [New Thread 8fc3e8000 (LWP 101645/java)]
> [New Thread 8fc3ebc00 (LWP 101839/java)]
> [New Thread 8fcc85800 (LWP 100451/java)]
> [New Thread 8fc3e3800 (LWP 100223/java)]
> [New Thread 8fc3e6400 (LWP 101826/java)]
> [New Thread 8fc3f0000 (LWP 101825/java)]
> [New Thread 8fcc85400 (LWP 101729/java)]
> [New Thread 8fc8d3400 (LWP 101728/java)]
> [New Thread 8fc3ed400 (LWP 101724/java)]
> [New Thread 8fc8d1c00 (LWP 101723/java)]
> [New Thread 8fc3e8c00 (LWP 101721/java)]
> [New Thread 8fc3e2c00 (LWP 101720/java)]
> [New Thread 8f7c40800 (LWP 101719/java)]
> [New Thread 8fc8d2800 (LWP 101672/java)]
> [New Thread 8f26a1400 (LWP 100477/java)]
> [New Thread 8fc8d4000 (LWP 101709/java)]
> [New Thread 8fc3f0400 (LWP 101708/java)]
> [New Thread 8fcc87000 (LWP 101707/java)]
> [New Thread 8fc3f1c00 (LWP 101706/java)]
> [New Thread 8fcc86400 (LWP 101705/java)]
> [New Thread 8fcc8ac00 (LWP 101702/java)]
> [New Thread 8e845f800 (LWP 101700/java)]
> [New Thread 8fc3e9800 (LWP 101699/java)]
> [New Thread 8fc3eb000 (LWP 101671/java)]
> [New Thread 8fc3e7c00 (LWP 101678/java)]
> [New Thread 8f6842000 (LWP 100108/java)]
> [New Thread 8fcc85000 (LWP 100103/java)]
> [New Thread 8014d5800 (LWP 102268/java)]
> [New Thread 8f6623800 (LWP 102192/java)]
> [New Thread 8e7dd9400 (LWP 102191/java)]
> [New Thread 8f26a2000 (LWP 102190/java)]
> [New Thread 8f297d800 (LWP 101495/java)]
> [New Thread 8e8a48400 (LWP 101489/java)]
> [New Thread 8f3158000 (LWP 101486/java)]
> [New Thread 8f2d88400 (LWP 101484/java)]
> [New Thread 8e7982400 (LWP 101483/java)]
> [New Thread 8e8250800 (LWP 101482/java)]
> [New Thread 8e824fc00 (LWP 101481/java)]
> [New Thread 8e7981800 (LWP 101475/java)]
> [New Thread 8e8460400 (LWP 101473/java)]
> [New Thread 8e8c5c800 (LWP 101470/java)]
> [New Thread 8f6622c00 (LWP 101448/java)]
> [New Thread 8e8a49000 (LWP 101366/java)]
> [New Thread 8f7774000 (LWP 101438/java)]
> [New Thread 8f7773400 (LWP 101435/java)]
> [New Thread 8014d4c00 (LWP 100454/java)]
> [New Thread 8e8c5d400 (LWP 100237/java)]
> [New Thread 8f7c40400 (LWP 100244/java)]
> [New Thread 8f2391000 (LWP 102173/java)]
> [New Thread 8f2390c00 (LWP 102171/java)]
> [New Thread 8f890dc00 (LWP 102170/java)]
> [New Thread 8f2d1d800 (LWP 102168/java)]
> [New Thread 8e8942800 (LWP 102167/java)]
> [New Thread 8f2d1cc00 (LWP 102165/java)]
> [New Thread 8f28c8000 (LWP 102164/java)]
> [New Thread 8e819a800 (LWP 102163/java)]
> [New Thread 8f51a1800 (LWP 102144/java)]
> [New Thread 8f24cf800 (LWP 102143/java)]
> [New Thread 8f890e800 (LWP 102142/java)]
> [New Thread 8e8941c00 (LWP 102141/java)]
> [New Thread 8f8574400 (LWP 102139/java)]
> [New Thread 8e8199c00 (LWP 102138/java)]
> [New Thread 8f8575000 (LWP 101985/java)]
> [New Thread 8f51a2400 (LWP 101710/java)]
> [New Thread 8f28c7400 (LWP 101690/java)]
> [New Thread 8f7c3f800 (LWP 101601/java)]
> [New Thread 8f3cb5000 (LWP 101599/java)]
> [New Thread 8fcba8000 (LWP 101597/java)]
> [New Thread 8f3cb4400 (LWP 101595/java)]
> [New Thread 8f2573000 (LWP 101517/java)]
> [New Thread 8f2572400 (LWP 101511/java)]
> [New Thread 8f24d0400 (LWP 101411/java)]
> [New Thread 8fcba7000 (LWP 102351/java)]
> [New Thread 8f54d8800 (LWP 102350/java)]
> [New Thread 8f54d8400 (LWP 102349/java)]
> [New Thread 8f54d7800 (LWP 102348/java)]
> [New Thread 8f54d6c00 (LWP 102347/java)]
> [New Thread 8f5472c00 (LWP 102346/java)]
> [New Thread 8f5472800 (LWP 102345/java)]
> [New Thread 8f5472000 (LWP 102344/java)]
> [New Thread 8f5471c00 (LWP 102343/java)]
> [New Thread 8f5471800 (LWP 102342/java)]
> [New Thread 8f5471400 (LWP 102341/java)]
> [New Thread 8f5471000 (LWP 102340/java)]
> [New Thread 8f54b8800 (LWP 102337/java)]
> [New Thread 8f5470400 (LWP 102336/java)]
> [New Thread 8f54b7c00 (LWP 102335/java)]
> [New Thread 8f546f800 (LWP 102334/java)]
> [New Thread 8fcba6c00 (LWP 102333/java)]
> [New Thread 8f546ec00 (LWP 102332/java)]
> [New Thread 8fcba6000 (LWP 102331/java)]
> [New Thread 8f546e000 (LWP 102330/java)]
> [New Thread 8f546dc00 (LWP 102329/java)]
> [New Thread 8f546d800 (LWP 102328/java)]
> [New Thread 8f546cc00 (LWP 102326/java)]
> [New Thread 8f546c000 (LWP 102325/java)]
> [New Thread 8f546b400 (LWP 102324/java)]
> [New Thread 8f546a800 (LWP 102323/java)]
> [New Thread 8f5469c00 (LWP 102322/java)]
> [New Thread 8fcba5800 (LWP 102321/java)]
> [New Thread 8f5469000 (LWP 102320/java)]
> [New Thread 8f5468400 (LWP 102319/java)]
> [New Thread 8f5467800 (LWP 102318/java)]
> [New Thread 8f2390800 (LWP 102317/java)]
> [New Thread 8f5466c00 (LWP 102316/java)]
> [New Thread 8fcba4c00 (LWP 102315/java)]
> [New Thread 8f5466000 (LWP 102314/java)]
> [New Thread 8f5465400 (LWP 102313/java)]
> [New Thread 8f5464800 (LWP 102312/java)]
> [New Thread 8fcba4000 (LWP 102311/java)]
> [New Thread 8f5463c00 (LWP 102310/java)]
> [New Thread 8e887cc00 (LWP 102309/java)]
> [New Thread 8fcba3400 (LWP 102308/java)]
> [New Thread 8fcba2800 (LWP 102307/java)]
> [New Thread 8fcba1c00 (LWP 102306/java)]
> [New Thread 8fcba1000 (LWP 102305/java)]
> [New Thread 8fcba0400 (LWP 102304/java)]
> [New Thread 8fcb9f800 (LWP 102303/java)]
> [New Thread 8fcb9ec00 (LWP 102302/java)]
> [New Thread 8fcb9e400 (LWP 102301/java)]
> [New Thread 8fca9ec00 (LWP 102300/java)]
> [New Thread 8fca9e800 (LWP 102299/java)]
> [New Thread 8fca9e400 (LWP 102298/java)]
> [New Thread 8fca9e000 (LWP 102297/java)]
> [New Thread 8fca9d400 (LWP 102296/java)]
> [New Thread 8fca9c800 (LWP 102295/java)]
> [New Thread 8fca9bc00 (LWP 102294/java)]
> [New Thread 8fca9b000 (LWP 102140/java)]
> [New Thread 8fca9a400 (LWP 102136/java)]
> [New Thread 8fca99800 (LWP 102135/java)]
> [New Thread 8fca98c00 (LWP 102072/java)]
> [New Thread 8fca98000 (LWP 101713/java)]
> [New Thread 8fca97800 (LWP 101711/java)]
> [New Thread 8fca97400 (LWP 101602/java)]
> [New Thread 8fca97000 (LWP 101600/java)]
> [New Thread 8fca96400 (LWP 101598/java)]
> [New Thread 8fca95800 (LWP 101596/java)]
> [New Thread 8fca94c00 (LWP 101594/java)]
> [New Thread 8fca94000 (LWP 101516/java)]
> [New Thread 8fca93400 (LWP 101510/java)]
> [New Thread 8fca92800 (LWP 101509/java)]
> [New Thread 8fca91c00 (LWP 101504/java)]
> [New Thread 8fca91000 (LWP 101479/java)]
> [New Thread 8fca90400 (LWP 101474/java)]
> [New Thread 8fca8fc00 (LWP 100533/java)]
> [New Thread 8fca8f400 (LWP 102290/java)]
> [New Thread 8fbe9b800 (LWP 102289/java)]
> [New Thread 8fbe9ac00 (LWP 102288/java)]
> [New Thread 8fbe9a000 (LWP 102287/java)]
> [New Thread 8fbe99400 (LWP 102286/java)]
> [New Thread 8fbe98800 (LWP 102285/java)]
> [New Thread 8fbe97c00 (LWP 102284/java)]
> [New Thread 8fbe97000 (LWP 102283/java)]
> [New Thread 8fbe96400 (LWP 102282/java)]
> [New Thread 8fbe95800 (LWP 102281/java)]
> [New Thread 8e7889c00 (LWP 102280/java)]
> [New Thread 8f6845c00 (LWP 102279/java)]
> [New Thread 8f7c3f400 (LWP 102277/java)]
> [New Thread 8e788a000 (LWP 102276/java)]
> [New Thread 8e8096c00 (LWP 102275/java)]
> [New Thread 8e7c60800 (LWP 102274/java)]
> [New Thread 8e8097000 (LWP 102267/java)]
> [New Thread 8f6849c00 (LWP 102263/java)]
> [New Thread 8f6846000 (LWP 102262/java)]
> [New Thread 8f6846400 (LWP 102261/java)]
> [New Thread 8f6844800 (LWP 101478/java)]
> [New Thread 8f6849000 (LWP 101476/java)]
> [New Thread 8f684a800 (LWP 101424/java)]
> [New Thread 8f6843000 (LWP 101423/java)]
> [New Thread 8f684b800 (LWP 101417/java)]
> [New Thread 8f6843c00 (LWP 101413/java)]
> [New Thread 8f6842400 (LWP 101408/java)]
> [New Thread 8e7c60400 (LWP 102228/java)]
> [New Thread 8f684b400 (LWP 102209/java)]
> [New Thread 8f6840800 (LWP 102043/java)]
> [New Thread 8f6840400 (LWP 102042/java)]
> [New Thread 8f6840000 (LWP 102041/java)]
> [New Thread 8f683fc00 (LWP 102040/java)]
> [New Thread 8f683f800 (LWP 101071/java)]
> [New Thread 8f683f400 (LWP 101069/java)]
> [New Thread 8f683f000 (LWP 100703/java)]
> [New Thread 8f683ec00 (LWP 100165/java)]
> [New Thread 8f683e800 (LWP 100125/java)]
> [New Thread 80304dc00 (LWP 101908/java)]
> [New Thread 80304d000 (LWP 101906/java)]
> [New Thread 80304c800 (LWP 101905/java)]
> [New Thread 80304c400 (LWP 101904/java)]
> [New Thread 80304bc00 (LWP 101903/java)]
> [New Thread 80304b000 (LWP 101902/java)]
> [New Thread 80304a400 (LWP 101901/java)]
> [New Thread 803049800 (LWP 101900/java)]
> [New Thread 803048800 (LWP 101882/java)]
> [New Thread 803047c00 (LWP 101881/java)]
> [New Thread 803047000 (LWP 101880/java)]
> [New Thread 803046000 (LWP 101876/java)]
> [New Thread 803045400 (LWP 101874/java)]
> [New Thread 803044800 (LWP 101873/java)]
> [New Thread 803043c00 (LWP 101872/java)]
> [New Thread 803043000 (LWP 101871/java)]
> [New Thread 803042400 (LWP 101870/java)]
> [New Thread 801406800 (LWP 100420/java)]
> [New Thread 801406400 (LWP 101682/java)]
> (gdb) bt
> #0 0x0000000800ccc26a in thr_kill () from /lib/libc.so.7
> #1 0x0000000800d93ac9 in abort () from /lib/libc.so.7
> #2 0x0000000801f11bc1 in os::abort () from
> /usr/local/openjdk7/jre/lib/amd64/server/libjvm.so
> #3 0x000000080204d599 in VMError::report_and_die () from
> /usr/local/openjdk7/jre/lib/amd64/server/libjvm.so
> #4 0x0000000801f17032 in JVM_handle_bsd_signal () from
> /usr/local/openjdk7/jre/lib/amd64/server/libjvm.so
> #5 0x0000000800a4a3f6 in swapcontext () from /lib/libthr.so.3
> #6 0x0000000800a49ff3 in sigaction () from /lib/libthr.so.3
> #7 <signal handler called>
> #8 0x000000080383f4ae in ?? ()
> #9 0x00007fffef7ea398 in ?? ()
> #10 0x0000000806d08b00 in ?? ()
> #11 0x00007fffef7ea3e8 in ?? ()
> #12 0x0000000806d0a150 in ?? ()
> #13 0x0000000000000000 in ?? ()
> (gdb)
>
> At that point, I was watching top -H. Although this happens all the
> time, it can be accelerated by using the jetty web server (to view
> graphs and reports). The process had started to run away with all the
> memory. That is, java started to grow to almost 8GB (yes, I have 8GB
> of free RAM - 16GB in the machine.)
>
> I'm running this in a jail and it occurs on both FreeBSD 10.0 and 10.1
> with OpenJDK7. I can't use OpenJDK8 as the app has known 'issues'
> with that JDK.
>
> *From the OpenNMS application's hs_errpid<PID>.log file that is dumped
> at the same time as the java.core.**
> *
> VM Arguments:
> jvm_args: -Djava.endorsed.dirs=/usr/local/opennms/lib/endorsed
> -Dopennms.home=/usr/local/opennms
> -Dcom.sun.management.jmxremote.port=18980
> -Dcom.sun.management.jmxremote.ssl=false
> -Dcom.sun.management.jmxremote.authenticate=false -Xmx2048m
> -XX:+HeapDumpOnOutOfMemoryError -XX:MaxPermSize=1536m
> -DisThreadContextMapInheritable=true
> -Djava.io.tmpdir=/usr/local/opennms/data/tmp -verbose:gc
> java_command: /usr/local/opennms/lib/opennms_bootstrap.jar start
> Launcher Type: SUN_STANDARD
>
> Environment Variables:
> JAVA_HOME=/usr/local/openjdk7
> PATH=/sbin:/bin:/usr/sbin:/usr/bin:/usr/games:/usr/local/sbin:/usr/local/bin:/root/bin
>
> LD_LIBRARY_PATH=:/usr/local/opennms/lib
> SHELL=/bin/csh
> HOSTTYPE=FreeBSD
> OSTYPE=FreeBSD
> MACHTYPE=x86_64
>
> --------------- S Y S T E M ---------------
>
> OS:BSDuname:FreeBSD 10.1-RELEASE FreeBSD 10.1-RELEASE #0 r274401: Tue
> Nov 11 21:02:49 UTC 2014
> ro...@releng1.nyi.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64
> rlimit: STACK 8192k, CORE infinity, NPROC 19558, NOFILE 20480, AS
> infinity
> load average:0.40 0.72 0.67
>
> CPU:total 6 (6 cores per cpu, 1 threads per core) family 21 model 2
> stepping 0, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, sse4.1,
> sse4.2, popcnt, avx, aes, mmxext, 3dnowpref, lzcnt, sse4a, tsc,
> tscinvbit, tscinv
>
> /proc/cpuinfo:
> <Not Available>
>
> Memory: 4k page, physical 7837880k(1959470k free)
>
> /proc/meminfo:
>
>
> vm_info: OpenJDK 64-Bit Server VM (24.71-b01) for bsd-amd64 JRE
> (1.7.0_71-b14), built on Nov 6 2014 07:13:56 by "root" with gcc 4.2.1
> Compatible FreeBSD Clang 3.3 (tags/RELEASE_33/final 183502)
>
> time: Thu Nov 20 20:21:33 2014
> elapsed time: 334 seconds
>
> *From the OpenNMS application's output.log file:**
> *
> Creating topology provider
> returning enhanced topology provider
> [GC 742216K->218524K(845824K), 0.0237450 secs]
> [Full GC 218524K->204245K(951296K), 0.9773840 secs]
> [GC 747477K->212845K(955392K), 0.0183540 secs]
> #
> # A fatal error has been detected by the Java Runtime Environment:
> #
> # SIGSEGV (0xb) at pc=0x000000080383f4ae, pid=55942, tid=38451038208
> #
> # JRE version: OpenJDK Runtime Environment (7.0-b14) (build 1.7.0_71-b14)
> # Java VM: OpenJDK 64-Bit Server VM (24.71-b01 mixed mode bsd-amd64
> compressed oops)
> # Problematic frame:
> # j java.net.Inet4Address.<init>()V+0
> #
> # Core dump written. Default location: /cores/core or core.55942
> #
> # An error report file with more information is saved as:
> # /usr/local/opennms/hs_err_pid55942.log
> [thread 38511523840 also had an error]
> #
> # If you would like to submit a bug report, please visit:
> # http://bugreport.sun.com/bugreport/crash.jsp
> #
>
>
>
>
> On 11/20/2014 19:34, Ed Maste wrote:
>> On 20 November 2014 13:11, Paul Pathiakis
>> <ppath...@atlantisservices.net> wrote:
>>> Hi,
>>>
>>> I'm trying to create the port/pkg for the OpenNMS monitoring tool.
>>>
>>> The latest version came out, 1.14, and I have the latest package.
>>>
>>> However, there still seems to be a problem with it dumping core after a
>>> couple of hours.
>> Can you get a backtrace from the crash?
>
> _______________________________________________
> freebs...@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-java
> To unsubscribe, send any mail to "freebsd-java...@freebsd.org"

_______________________________________________
freebs...@freebsd.org mailing list
http://lists.freebsd.org/mailman/listinfo/freebsd-java
To unsubscribe, send any mail to "freebsd-java...@freebsd.org"

[Ronald Klop]

It is 'java -version'.
The java version is choosen by something called javavmwrapper. This helps
if you have multiple java versions installed. You can bypass this by going
to the right directory immediately like '/usr/local/openjdk7/bin/java'.

But first try -version with one dash.

$ java --version
Unrecognized option: --version
Error: Could not create the Java Virtual Machine.
Error: A fatal exception has occurred. Program will exit.

$ java -version
openjdk version "1.7.0_71"
OpenJDK Runtime Environment (build 1.7.0_71-b14)
OpenJDK 64-Bit Server VM (build 24.71-b01, mixed mode)

Regards,

Ronald.

On Wed, 03 Dec 2014 17:35:32 +0100, Paul Pathiakis via freebsd-java
<freebs...@freebsd.org> wrote:

> Hi all,
>
> I am trying to get anything to work with regards to OpenNMS and any
> version of Java 1.7.
>
> My latest attempt was to try and get it running with the linux-sun-jdk17
> port.
> It tells me that it can't find a usable JVM.
>
> java --version
> java: error: no suitable JavaVMs found
>
> I'm running this in a jail, but I don't think that should have any issue.
>
> Anyone have further ideas?
>
> P.

[Paul Pathiakis via freebsd-java]

*Feverishly tries to erase e-mail, other people's e-mails on the list
and archives.... doesn't work*

Nothing to see here... Nope... Nothing.... I didn't do something so
boneheaded....

*whistles and walks away embarrassed* ;-)

I am not a java person. :-) Obviously.

Anyhow, I did get things to start compiling and have run into a problem
with part of the software that assembles it for install.

Working with the OpenNMS group now to see how to get NSIS installed. It
seems that the older version (2.46) doesn't build on FreeBSD. I had to
go with the 3.0b.

P.

[Achilleas Mantzios]

On 04/12/2014 18:52, Paul Pathiakis via freebsd-java wrote:
> *Feverishly tries to erase e-mail, other people's e-mails on the list and archives.... doesn't work*
>
> Nothing to see here... Nope... Nothing.... I didn't do something so boneheaded....
>
> *whistles and walks away embarrassed* ;-)
>
> I am not a java person. :-) Obviously.

In which case there are plenty of sites specialized in java exclusively, maybe you could
get yourself some java knowledge first from there or by some books, and after you are skilful enough with Java, then you might attempt to jump into the FreeBSD deep waters.
Doing it all at once seems like a recipe for failure.

--
Achilleas Mantzios
Head of IT DEV
IT DEPT
Dynacom Tankers Mgmt

[Paul Pathiakis via freebsd-java]

Hi All!!!

OK. Well, I've been working with the OpenNMS people for a couple of
weeks and it looks like it's either FreeBSD or OpenJDK 1.7 that is the
problem in their product working on FreeBSD.

It was tried in two configurations on 10.1.

Configuration:

OpenNMS 14.0.0.1 on both with FreeBSD 10.1

1) openjdk 1.7
2) linux-sun-jdk17

Ron Roskens over at the OpenNMS project ran through this to find out
what was wrong:

I’ve been able to solve two of the unit test issues so far. Still running into the other unit test failures.


> On Dec 10, 2014, at 9:22 PM, Ronald Roskens<ros...@elfin.net> wrote:
>
> Here are some of the ones I know about it erroring/failing, but don’t know why or how to fix them yet:
>
> org.opennms.core.test.db.MirgratorTest:
> testUpdate():
> org.opennms.core.schema.MigrationException: unable to migrate the database
>
> testMultipleChangelogs():
> PSQLException: ERROR: relation “databasechangelog” does not exist

NMS-7254: MigratorTest fails on two of the 3 tests.

The problem here is two fold.
First, the test environment as configured by the maven surefire plugin can be different, and results in different results. One run can use filesystem resources, subsequent runs use jar file resources.
Second, MigratorTest assume it will be passed jar file resources on the classpath.


> org.opennms.jicmp.jna.ByteBufferTest:
> testPassing():
> com.sun.jna.LastErrorException: errno was 47

NMS-7257: ByteBufferTest.testPassing() fails on FreeBSD 10.1
This one is due a difference between the sockaddr_in class on Linux vs FreeBSD. Having a BSD specific version of the ByteBufferTest class that uses bsd_sockaddr_in objects allows all tests to pass.


Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 1.243 sec <<< FAILURE! - in org.opennms.netmgt.provision.persist.RequisitionFileUtilsTest
testCreateTemporaryRequisition(org.opennms.netmgt.provision.persist.RequisitionFileUtilsTest) Time elapsed: 0.013 sec <<< FAILURE!
java.lang.AssertionError: expected:<2> but was:<1>
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.opennms.netmgt.provision.persist.RequisitionFileUtilsTest.testCreateTemporaryRequisition(RequisitionFileUtilsTest.java:74)

This failure seems to occur randomly. You can continue the test run after it fails, and this test will run successfully.


Then I run into some generate-features-xml errors which only occur on the first run.

The next test failure is:

Tests run: 1, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1.345 sec <<< FAILURE! - in org.opennms.features.vaadin.nodemaps.internal.gwt.client.ui.controls.search.SearchStateTest
org.opennms.features.vaadin.nodemaps.internal.gwt.client.ui.controls.search.SearchStateTest Time elapsed: 1.322 sec <<< ERROR!
java.lang.VerifyError: Bad <init> method call from inside of a branch
Exception Details:
Location:
org/opennms/features/vaadin/nodemaps/internal/gwt/client/ui/controls/search/SearchStateTest$TestSchedulerImpl.<init>(Lorg/opennms/features/vaadin/nodemaps/internal/gwt/client/ui/controls/search/SearchStateTest$1;)V @34: invokespecial
Reason:
Error exists in the bytecode
Bytecode:
0000000: 2a4d 125b b800 1603 bd00 0d12 17b8 001b
0000010: b800 213a 0419 04b2 0025 a500 0e2a 01c0
0000020: 0027 b700 2aa7 0009 2cb7 005c 0157 b1
Stackmap Table:
full_frame(@40,{UninitializedThis,Object[#89],UninitializedThis,Top,Object[#13]},{})
full_frame(@46,{Object[#2],Object[#89],Object[#2],Top,Object[#13]},{})

at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:191)
at javassist.runtime.Desc.getClassObject(Desc.java:43)
at javassist.runtime.Desc.getClassType(Desc.java:152)
at javassist.runtime.Desc.getType(Desc.java:122)
at javassist.runtime.Desc.getType(Desc.java:78)
at org.opennms.features.vaadin.nodemaps.internal.gwt.client.ui.controls.search.SearchStateTest.setUpClass(SearchStateTest.java:92)


Adding -noverify to the argLine configuration property for the maven surefire plugin gets us get beyond that error.




------------------------------------------------------------------------------
Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server
from Actuate! Instantly Supercharge Your Business Reports and Dashboards
with Interactivity, Sharing, Native Excel Exports, App Integration & more
Get technology previously reserved for billion-dollar corporations, FREE
http://pubads.g.doubleclick.net/gampad/clk?id=164703151&iu=/4140/ostg.clktrk
_______________________________________________
Please read the OpenNMS Mailing List FAQ:
http://www.opennms.org/index.php/Mailing_List_FAQ

opennms-discuss mailing list

To*unsubscribe* or change your subscription options, see the bottom of this page:
https://lists.sourceforge.net/lists/listinfo/opennms-discuss


Ron followed up with this e-mail after submitting all his patches to the
code to allow for FreeBSD specifics:

> On Dec 13, 2014, at 10:27 PM, Ronald Roskens<ros...@elfin.net> wrote:
>
> I was able to get the unit tests after that to run through to completion.
>
> I’ve checked my fixes for NMS-7254, NMS-7257, and NMS-7260 into a branch roskens/freebsd-build in the repository, and its just starting it run through the bamboo CI process.
>
> If its without any errors I’ll see about getting it merged into master & develop branches.
>
> I am cautiously optimistic that you could run a build of OpenNMS 14.0.2 on FreeBSD 10.1 with OpenJDK 1.7.0_71-b14. I think any further problems uncovered would likely be FreeBSD JVM specific issues with OpenJDK.
>
> Ron

My optimism has been greatly diminished because on running the build after about 10 minutes, the JVM crashed with a fatal error:

#
# A fatal error has been detected by the Java Runtime Environment:
#

# SIGSEGV (0xb) at pc=0x0000000803a4d4ae, pid=84602, tid=35353228288

#
# JRE version: OpenJDK Runtime Environment (7.0-b14) (build 1.7.0_71-b14)
# Java VM: OpenJDK 64-Bit Server VM (24.71-b01 mixed mode bsd-amd64 compressed oops)
# Problematic frame:

# j java.net.SocketException.<init>(Ljava/lang/String;)V+0
#
# Core dump written. Default location: /cores/core or core.84602



When I tried to run OpenNMS with the linux-sun-jdk17 it runs, but I got this error in web.log when I tried to access the web interface.

2014-12-14 14:17:14,213 WARN [Main] o.e.j.u.c.AbstractLifeCycle: FAILED org.eclipse.jetty.server.nio.SelectChannelConnector$ConnectorSelectorManager@131fc7e: java.io.IOException: Function not implemented
java.io.IOException: Function not implemented
at sun.nio.ch.EPollArrayWrapper.epollCreate(Native Method) ~[?:1.7.0_71]
at sun.nio.ch.EPollArrayWrapper.<init>(EPollArrayWrapper.java:130) ~[?:1.7.0_71]
at sun.nio.ch.EPollSelectorImpl.<init>(EPollSelectorImpl.java:68) ~[?:1.7.0_71]
at sun.nio.ch.EPollSelectorProvider.openSelector(EPollSelectorProvider.java:36) ~[?:1.7.0_71]
at java.nio.channels.Selector.open(Selector.java:227) ~[?:1.7.0_71]
…

Which I take to mean that the FreeBSD Linux kernel emulator doesn’t implement the epoll interface.

Creating $OPENNMS_HOME/etc/opennms.conf with:
ADDITIONAL_MANAGER_OPTIONS="-Djava.nio.channels.spi.SelectorProvider=sun.nio.ch.PollSelectorProvider"

Then its up and running.

Ron


Gentlemen of FreeBSD Java/OpenJDK.... It runs on the linux-sun-jdk17
without issue once you put the two options into the file as described in
the last 2-4 lines of the second letter. Now that it's been narrowed
down to being an OpenJDK compliance issue, could we please dig into it a
bit?

I am going to run FreeBSD 10.1, OpenNMS 1.14.0.2 with OpenJDK-latest and
see if the issue still exists. I'm happy to assist but I'm not a java
person and I would think that I have shown I am committed to getting
this port done and to continue supporting the jicmp, jicmp6, jrrd, and
the OpenNMS port going forward. I need someone in the OpenJDK support
group to assist in either finding where the problem is in OpenJDK or
where OpenNMS makes an incorrect call in OpenJDK 1.7 on FreeBSD 10.1.
(Although, I believe, Ron Roskens has pretty well dug in to find it's
probably not OpenNMS.)

One last thing, the OpenNMS project tends to be Windows, MacOSX and LINUX

Check out what Ron had to say when first exposed to FreeBSD:

Thats pretty neat that FreeBSD have VM templates you can download and use as a base. Using that, I installed git, openjdk-7, jicmp, jicmp6 and postgresql94 packages.

I cloned the OpenNMS repo, checked out master, and then ran “./compile.pl && ./assemble.pl -Dopennms.home=/opt/opennms” which ran through to completion.

I wonder if using the linux jdk is whats causing it to attempt to run the NSIS part. You could try adding -Dos.name=FreeBSD to the build arguments to compile.pl and/or assemble.pl.

Ron


That's an open mind. Can the FreeBSD community do any less than take
the baton and run the next leg of this race?

Thank you for the effort in bringing this home!

P.

http://sourceforge.net/projects/opennms/?source=typ_redirect <---Source Code

Process: download... unpack...

./compile.pl
./assemble.pl -Dopennms.home=/usr/local/opennms

When done, copy from initial directory/targets and grab the
opennms-1.14.0.2.tar.gz and copy it to the home directory
(/usr/local/opennms)

Unpack that in the directory.
You'll need a postgres instance to connect to.

Here to help with anything more.