Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

[Caml-list] OPLP: Ocaml APache Log Parser

25 views
Skip to first unread message

Chris Yocum

unread,
Oct 11, 2010, 9:44:48 AM10/11/10
to caml...@inria.fr
Dear Everyone,

I just wanted to let Ocaml'ers know that I am currently working on an
apache combined log parser. It is still in very early stages of
development but patches/comments/feature requests/bug reports are very
welcome. The code lives on github (http://github.com/cyocum/OPLP).

All the best,
Chris Yocum

signature.asc

oli...@first.in-berlin.de

unread,
Oct 11, 2010, 9:54:29 AM10/11/10
to caml...@inria.fr
[...]

Aha... long ago I had done something similar, and it had an sql-like
language for using it.

The annoyance (and advantage ;)) with the apache logfiles is, that there
are many "standard" formats, and you also can design your own output format.

So it would make sense (I didn't do that) to parse the apache config files,
and create a logparser from that information...

Do you have planned to do this, or do you want to stick with some of the
most used formats?

Ciao,
Oliver

_______________________________________________
Caml-list mailing list. Subscription management:
http://yquem.inria.fr/cgi-bin/mailman/listinfo/caml-list
Archives: http://caml.inria.fr
Beginner's list: http://groups.yahoo.com/group/ocaml_beginners
Bug reports: http://caml.inria.fr/bin/caml-bugs

Chris Yocum

unread,
Oct 11, 2010, 10:03:56 AM10/11/10
to oli...@first.in-berlin.de, caml...@inria.fr
Hi Oliver,

For now, I was just concentrating on the "combined" format that is used
as an example on the apache site. I will probably branch out into
parsing the log format itself later once I get more experience with it.

Also, does anyone have a smallish block of apache log files (<30k) that
I can use for testing?

All the best,
Chris Yocum

signature.asc

Mihamina Rakotomandimby

unread,
Oct 12, 2010, 2:48:30 AM10/12/10
to caml...@yquem.inria.fr
> cyo...@gmail.com :

> I just wanted to let Ocaml'ers know that I am currently working on an
> apache combined log parser.

I would like to encourage you registering your project to the forge:
http://forge.ocamlcore.org/

Using github is not a problem, but there is an effort to make OCaml big
& small project visible. Let's also encourage it.

--

Architecte Informatique chez Blueline/Gulfsat:
Administration Systeme, Recherche & Developpement
+261 34 56 000 19

Chris Yocum

unread,
Oct 12, 2010, 8:36:59 AM10/12/10
to Mihamina Rakotomandimby, caml...@yquem.inria.fr
Cool. I will do so presently.

Thanks!,
Chris

signature.asc

Richard Jones

unread,
Oct 13, 2010, 6:38:35 AM10/13/10
to Chris Yocum, caml...@inria.fr
On Mon, Oct 11, 2010 at 02:45:49PM +0100, Chris Yocum wrote:

These projects are not maintained any more but may be of
interest:

http://merjis.com/developers/weblogs
http://merjis.com/developers/hostip

Rich.

--
Richard Jones
Red Hat

Chris Yocum

unread,
Oct 13, 2010, 7:01:46 AM10/13/10
to Richard Jones, caml...@inria.fr
Hi Rich,

Thanks!

Chris

signature.asc

Gaius Hammond

unread,
Oct 14, 2010, 2:23:24 PM10/14/10
to oli...@first.in-berlin.de, caml...@inria.fr

On 11 Oct 2010, at 14:54, oli...@first.in-berlin.de wrote:

> On Mon, Oct 11, 2010 at 02:45:49PM +0100, Chris Yocum wrote:
>> Dear Everyone,
>>
>> I just wanted to let Ocaml'ers know that I am currently working on an
>> apache combined log parser. It is still in very early stages of
>> development but patches/comments/feature requests/bug reports are
>> very
>> welcome. The code lives on github (http://github.com/cyocum/OPLP).
> [...]
>
> Aha... long ago I had done something similar, and it had an sql-like
> language for using it.


I do something like this, but using OCaml to load a logfile into
SQLite, and analyze it with "real" SQL.

http://gaiustech.wordpress.com/2010/09/12/analyzing-logfiles-1/

Probably my technique using sscanf wouldn't be fast enough for
something as big as an Apache log that might have a million lines.

Cheers,


G

oli...@first.in-berlin.de

unread,
Oct 22, 2010, 6:18:58 PM10/22/10
to caml...@inria.fr
On Mon, Oct 11, 2010 at 03:54:22PM +0200, oli...@first.in-berlin.de wrote:
> On Mon, Oct 11, 2010 at 02:45:49PM +0100, Chris Yocum wrote:
> > Dear Everyone,
> >
> > I just wanted to let Ocaml'ers know that I am currently working on an
> > apache combined log parser. It is still in very early stages of
> > development but patches/comments/feature requests/bug reports are very
> > welcome. The code lives on github (http://github.com/cyocum/OPLP).
> [...]
>
> Aha... long ago I had done something similar, and it had an sql-like
> language for using it.
[...]


Here is the URL for that tool:

http://www.first.in-berlin.de/software/tools/apalogretrieve/

0 new messages