I just wanted to let Ocaml'ers know that I am currently working on an
apache combined log parser. It is still in very early stages of
development but patches/comments/feature requests/bug reports are very
welcome. The code lives on github (http://github.com/cyocum/OPLP).
All the best,
Chris Yocum
Aha... long ago I had done something similar, and it had an sql-like
language for using it.
The annoyance (and advantage ;)) with the apache logfiles is, that there
are many "standard" formats, and you also can design your own output format.
So it would make sense (I didn't do that) to parse the apache config files,
and create a logparser from that information...
Do you have planned to do this, or do you want to stick with some of the
most used formats?
Ciao,
Oliver
_______________________________________________
Caml-list mailing list. Subscription management:
http://yquem.inria.fr/cgi-bin/mailman/listinfo/caml-list
Archives: http://caml.inria.fr
Beginner's list: http://groups.yahoo.com/group/ocaml_beginners
Bug reports: http://caml.inria.fr/bin/caml-bugs
For now, I was just concentrating on the "combined" format that is used
as an example on the apache site. I will probably branch out into
parsing the log format itself later once I get more experience with it.
Also, does anyone have a smallish block of apache log files (<30k) that
I can use for testing?
All the best,
Chris Yocum
I would like to encourage you registering your project to the forge:
http://forge.ocamlcore.org/
Using github is not a problem, but there is an effort to make OCaml big
& small project visible. Let's also encourage it.
--
Architecte Informatique chez Blueline/Gulfsat:
Administration Systeme, Recherche & Developpement
+261 34 56 000 19
These projects are not maintained any more but may be of
interest:
http://merjis.com/developers/weblogs
http://merjis.com/developers/hostip
Rich.
--
Richard Jones
Red Hat
> On Mon, Oct 11, 2010 at 02:45:49PM +0100, Chris Yocum wrote:
>> Dear Everyone,
>>
>> I just wanted to let Ocaml'ers know that I am currently working on an
>> apache combined log parser. It is still in very early stages of
>> development but patches/comments/feature requests/bug reports are
>> very
>> welcome. The code lives on github (http://github.com/cyocum/OPLP).
> [...]
>
> Aha... long ago I had done something similar, and it had an sql-like
> language for using it.
I do something like this, but using OCaml to load a logfile into
SQLite, and analyze it with "real" SQL.
http://gaiustech.wordpress.com/2010/09/12/analyzing-logfiles-1/
Probably my technique using sscanf wouldn't be fast enough for
something as big as an Apache log that might have a million lines.
Cheers,
G
Here is the URL for that tool:
http://www.first.in-berlin.de/software/tools/apalogretrieve/