draft of architecture

21 views
Skip to first unread message

Steve Morin

unread,
Nov 12, 2013, 8:54:14 PM11/12/13
to spar...@googlegroups.com
Cui, this looks good as a first pass, I guess start documenting what the handler config would look like and generate a sample config file.
-Steve

I got same idea, 

  • output fields customization
    Output fields can be customized as the existing log hander format,  e.g.
        sn_fields %time_stamp% %http_referer% %http_ip% %http_uri%

    But there will be a little difference. Multi output formats are available. 
        e.g. If specify output format is json
                 sn_format json
              output will be as below:
                 { "time_stamp" : 1345678912, "http_referer" :"http://www.google.com" , "http_ip":"1.1.1.1", "http_uri":"/about" }

        if output format is plain text:
                 sn_format plain,'|'           # '|' is the delimiter character, hex character also can be used, e.g. '\2'. It will make parsing log very easy, in python: log.split( '|' )
              output will be as below:
                 1345678912|http://www.google.com|1.1.1.1|/about




A draft Sparkngin  design has been added into bottom of https://github.com/DemandCube/Sparkngin/blob/dev/README.md

Could you take a look at it and tell me what problems there are?


As a first draft looks good and the understanding is good too.  I would like to be able to mimic the existing log handler implementation and be able to accept any variable that the existing log handler can.  What do you think of being able to mimic the existing log hander format?

Cui Yingjie

unread,
Nov 13, 2013, 3:05:17 AM11/13/13
to spar...@googlegroups.com
I've appended configuration directives into https://github.com/DemandCube/Sparkngin/blob/master/README.md

Could you check it and tell me what you think?

Steve Morin

unread,
Nov 15, 2013, 3:42:10 AM11/15/13
to Cui Yingjie, spar...@googlegroups.com
The changes look good.

Additionally I updated the project documentation with how to contribute to the project.  Future documentation improvements are going to go through commiter reviews and postings on the mailing list.

Cui are you going to do a first cut of the Sparkngin module?  Do you feel there is enough of a specification yet?  

-Steve


--
You received this message because you are subscribed to the Google Groups "Sparkngin" group.
To unsubscribe from this group and stop receiving emails from it, send an email to sparkngin+...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.

Reply all
Reply to author
Forward
0 new messages