Looking for a pure Java VMF parser

688 views
Skip to first unread message

Alex O'Ree

unread,
Mar 21, 2015, 1:08:16 PM3/21/15
to mil...@googlegroups.com
Anyone know where I can source a pure Java VMF parser?

Chris Mattmann

unread,
Mar 21, 2015, 1:36:45 PM3/21/15
to mil...@googlegroups.com, d...@tika.apache.org
Hi Alex,

[CC to d...@tika.a.o]

You may want to look at Apache Tika, which is like a “digital babel

fish” parser and MIME type identification and language detection
system for 1200+ file formats.

http://tika.apache.org/

Is VMF this “VMF” format?

https://developer.valvesoftware.com/wiki/Valve_Map_Format


If so, it doesn’t look like Tika has support for it - but you
may want to file a request at https://issues.apache.org/jira/browse/TIKA
requesting support and maybe someone will consider it.

In addition if you find an ALv2 compatible [1] licensed parser
in Java and it works well please consider letting folks know on
the JIRA issue and/or submitting it upstream to Tika by wrapping
it using Tika’s Parser interface [2].

Cheers,
Chris

[1] http://www.apache.org/legal/resolved.html#category-a
[2] http://tika.apache.org/1.7/parser_guide.html
>--
>--
>You received this message because you are subscribed to the "Military
>Open Source Software" Google Group.
>To post to this group, send email to mil...@googlegroups.com
>To unsubscribe from this group, send email to
>mil-oss+u...@googlegroups.com
>For more options, visit this group at
>http://groups.google.com/group/mil-oss?hl=en
>
>www.mil-oss.org
>
>---
>You received this message because you are subscribed to the Google Groups
>"Military Open Source Software" group.
>To unsubscribe from this group and stop receiving emails from it, send an
>email to mil-oss+u...@googlegroups.com.
>For more options, visit https://groups.google.com/d/optout.


Boyd Fletcher

unread,
Mar 21, 2015, 1:49:22 PM3/21/15
to mil...@googlegroups.com, <dev@tika.apache.org>
Alex

We have been developing an open source scala (Runs on a JVM ) based generic parser called daffodil that uses the dfdl specification. Works great from Java apps.

Google " daffodil dfdl" . Located at the NCSA link.

We have generated dfdl schemas for USMTF and VMF messages. They are on www.forge.mil - I can send url if interested.

Boyd

Brad Hards

unread,
Mar 21, 2015, 6:21:47 PM3/21/15
to mil...@googlegroups.com, Chris Mattmann
On Sat, 21 Mar 2015 10:36:15 AM Chris Mattmann wrote:
> Is VMF this “VMF” format?
>
> https://developer.valvesoftware.com/wiki/Valve_Map_Format
Given the mailing list, probably "Variable Message Format" - MIL-STD-6017 (and
some underlying transports that kill interoperability but probably don't make
much difference once you've got the VMF-level bits).

IIRC, the spec is not Distribution Statement A, so it'll be hard to find a FOSS
implementation. So a forge.mil solution (like Boyd's suggestion) is probably
the best bet.

Brad

Boyd Fletcher

unread,
Mar 21, 2015, 8:21:24 PM3/21/15
to mil...@googlegroups.com, Chris Mattmann
In our case, the daffodil parser is completely open source. It can process a very wide variety of fixed format ascii, Unicode and binary data. We have written parse tables USMTF , various CSV-like file types, VMF, pcap, and we are working dfdl schemas for CEF, IPFIX/Netflow, and silk data types. You can even parse JPEG with DFDL.


Because usmtf and VMF are fouo specs we had to post the dfdl schemas on forge.mil

Btw, the data format description language (DFDL) is an open spec from the open grid forum.

We have also integrated daffodil with the open source calabash xproc engine so you can use XML technologies to validate and transform the data that was parsed by daffodil. It's pretty cool technology.

IBM has developed Java and C DFDL parsers for their message broker 8.

Boyd

Jack Gold

unread,
Mar 22, 2015, 4:35:18 AM3/22/15
to mil...@googlegroups.com, Chris Mattmann
I recall in the past some company produced libraries for such things. I know my company builds them in house. Very likely Brad is correct. MIL-STD-6017 for "Variable Message Format" is most probably what you are looking at. There are multiple releases of the standard and they are not all available outside US FOUO. Some are NATO only. Additionally, there are new replacement standards in the works for this protocol.

I also believe there is a such a library floating around on NIPR, though I have no access to that these days.

--Jack

Alex O'Ree

unread,
Mar 22, 2015, 11:48:25 AM3/22/15
to mil...@googlegroups.com, Chris Mattmann
Yes I was looking for a 6017 library, specifically something that's android friendly. Android doesn't like anything javax.xml related (JAXB or otherwise). Thanks everyone for the replies
Reply all
Reply to author
Forward
0 new messages