Job/Batch ID's ... no way to link the log files?

[Sumit Bansal]

Hi Group,

I am using a JOB to fire off multiple transformations as well as a single Shell step.

I have turned on logging (and batch-id) in in the job settings as well as in each of the transformation steps. I setup a job log table as well as a transformation log table, both have the requisite BATCH-ID fields.

When I run the job, I get an entry into the job log table and multiple entries into the transformation log table (one for each transformation process).

What I don't get, is any common "batch id" (or any ID) in either file (job log or transformation log) that links anything together. No Job ID that links multiple Transformation ID'S to each other. No Transformation ID'S that group the Transformations together.

I would assume that a "batch-id" would start at the JOB level and be passed into each of the transformation logs linking them all together.

Isn't this what Batch-ID was meant for? and if so, what am I doing wrong?

Can anyone help How i can achieved this?

Regards

Sumit

[Dan]

Enable channel logging and it all links together.

Sent from my phone

--
You received this message because you are subscribed to the Google Groups "Pentaho Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pentaho-commun...@googlegroups.com.
To post to this group, send email to pentaho-...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/pentaho-community/1fd7936e-094d-446e-885e-9fd6caa6950f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Sumit Bansal]

Hi Dan,

Thanks of for your suitable response.i really appreciate for that ..

Thanks & Regards

Sumit Bansal

BI Developer

Blog:biwithui.blogspot.in

--
You received this message because you are subscribed to a topic in the Google Groups "Pentaho Community" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/pentaho-community/9Fn5pFbBUv4/unsubscribe.
To unsubscribe from this group and all its topics, send an email to pentaho-commun...@googlegroups.com.

To post to this group, send email to pentaho-...@googlegroups.com.

To view this discussion on the web visit https://groups.google.com/d/msgid/pentaho-community/CAGujiv1nBT880SEG6qz8BjcXbe1jVVkV6MK1rz9XZ%3DUq2KfKzw%40mail.gmail.com.

[Sumit Bansal]

Hi Dan,

Actually i am new on the ETL...Right now i am using PDI 5.1.0 CE.

Could you please provide me more detail  how i can enable channel logging ?

Please help me in that problem

Thanks & Regards

Sumit Bansal

BI Developer

Blog:biwithui.blogspot.in

[Matt Casters]

It's a logging table just like all other logging tables, available for jobs and transformations but only the top level job or transformation logs anything.

Op 30-okt.-2014 19:32 schreef "Sumit Bansal" <sumitba...@gmail.com>:

To view this discussion on the web visit https://groups.google.com/d/msgid/pentaho-community/CAKLMBOhZxpYJkWqqZZYtS6OjB%3Df8GU8FNCe7SSwQ_2U2pbaaqw%40mail.gmail.com.

[Sumit Bansal]

Thanks Matt and Dan for your suitable response.

As per my understanding instead of logging table i need to enable logging channel table in the job setting as well as in each of the transformation steps? and in get system info instead of transformation batch id i need to select parent job batch id?

Please correct me if i m wrong ..then i hope it should work...

Thanks & Regards

Sumit Bansal

BI Developer

Blog:biwithui.blogspot.in

To view this discussion on the web visit https://groups.google.com/d/msgid/pentaho-community/CAM1YkNL2A1fpyCC87czTNVfR0RT3CEVQEdEot7BsLtsVpHaGZA%40mail.gmail.com.

[Sumit Bansal]

No success till now ..after enabling the channel logging ..

Right now i m using PDI:5.1.0 CE ?

Any one help me how i can solve that issue...if possible..

Thanks & Regards

Sumit Bansal

BI Developer

Blog:biwithui.blogspot.in

[Matt Casters]

It's pretty obvious if you look at it that the log channel ID's link the various tables.

Since the logging channel table contains the complete execution lineage you have everything you need.

Good luck and please try to look a bit yourself.  This is not a self help group :-)

--

Matt Casters <mcas...@pentaho.org>
Chief Data Integration, Kettle founder, Author of Pentaho Kettle Solutions (Wiley)
Fonteinstraat 70 - 9400 OKEGEM - Belgium - Cell : +32 486 97 29 37

Pentaho  -  Powerful Analytics Made Easy

To view this discussion on the web visit https://groups.google.com/d/msgid/pentaho-community/CAKLMBOgzbDxsJ9Cq-bOpQXUjbM9AZ7WtwAPYcajN_HohJZAZnA%40mail.gmail.com.

[Sumit Bansal]

Finally i solve that issue...i have done through using set and get variable..Thanks Dan or Matt for your all support..