X12 issues Learning Bots

[aoplnx]

Hi henk-jan

I have a lot of experience in EDI in Mainframe and Unix. Now I started to Learn Bots and also Python. (totally new to me)

I was looking for sometime a good open source tool and find this one. I really like what I see and learn so far.

For now I am interesting in mapping X12 format.

Following one of your example I was able to Map and 850 document from EDI to Flat file. Everything O.K.

Now using the flat file that I created I am trying to Map a Flat File to and EDI 810 document.

Here I am stuck with and issue I will appreciated if you can point me to the right direction for resolving this issue.

I am getting this error:

InMessageError: [A51]: Found non-valid data at end of edi file; probably a problem with separators or message structure: "[{1: u'BIL', 2: 0, 3: 2, 6: u'BILLTO ANDRES INC 9 2499999990099 101 HUMBER CIRCLE BRAMPTON ON L6Y 5S5 CA X'}]". 

I am attaching the flat file and the grammar if you can take a look

Regard

Andres

[henk-jan ebbers]

hi Andres,

you use fixed records.
some records have an BOTSID of 3 pos, some use 6 positions.
if you use 3 pos for all these BOTSID (and adapt length next field, use 3-pos record-ID'sit goes OK)

(i am not sure what goes wrong here, wll examine this when I have mroe time)

kind regards,
henk-jan

> --
> You received this message because you are subscribed to the Google Groups "Bots Open Source EDI Translator" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to botsmail+u...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>

[aoplnx]

Hi 

I keep going and I was able to produce the outbound EDI 810.

I just changed the BOTSID for all record to 3. 

Still I don't understand why this make a difference but I guess when I get a more familiar with this application I will understand why.

regard

Andres

[henk-jan ebbers]

hi andres,

bots has to understand the structure of the incoming file: which record is a header, which are the lines etc.
in order know which record is which, there has to be a way to identify the record: so bots has to know where the recordID is.

in your case one record has an ID of 6 positions, elsewhere it is 3 positions.
how should bots know if it should read 3 or 6 positions as an identifier?


kind regards
henk-jan

> > To unsubscribe from this group and stop receiving emails from it, send an email to botsmail+u...@googlegroups.com <javascript:>.
> > For more options, visit https://groups.google.com/groups/opt_out <https://groups.google.com/groups/opt_out>.

[aoplnx]

Hi Henk-Jan

I already have an output for an EDI 810. Your explanation make more sense to me now.

I will keep learning bots.

Thank you for update

Andres

[Harold DeWayne]

Hi all...

I have successfully built a map to translate a v5010 X12 997 document to an XML file and I expect to have to post-process the file to add my xmlns information (but that's not the problem I'm having).  I can see on the HTML webserver page that the data generated (Document-Out = Done) but when it goes through the merge phase it gets Stuck.  I have verified that data is in botssys/data/... successfully and my output channel has a filename of   {frompartner}_{botskey}_{messagetype}_{datetime:%Y%m%d_%H%M}_*.XML... Can anyone please let me know what to do to get the data to write to the output file so I can say I _actually_ completed a map?


Thanks.

Harold DeWayne

[henk-jan ebbers]

hi Harold,

when a file is truck it is generated/translated OK.
but the file did not go out of Bots (it's stuck!).
mostly something with outchannel not picking up the right file.
Let me guess: you are using filters for the outchannel?

;-))))
(it's a pain, lot's of people run into this)

henk-jan

btw did you already look at the confirmation/acknowledgement module in bots?

[Harold DeWayne]

Henk-Jan --

No, there are no filters on the out channel...  Already read up on that issue.  Also, the confirmation/acknowledgement module has nothing to do with this situation... we're receiving the X12 to send the XML on to our partner and they're processing the ack back into their system.

[henk-jan ebbers]

the generated file is not moved out of bots.
in what route do you expect it to go out, and what outchannel in that route?

henk-jan

> > To unsubscribe from this group and stop receiving emails from it, send an email to botsmail+u...@googlegroups.com <javascript:>.
> > For more options, visit https://groups.google.com/groups/opt_out <https://groups.google.com/groups/opt_out>.

[henk-jan ebbers]

will take a look at it later.
it is friday nigth here.

henk-jan

On 05/03/2013 09:13 PM, Harold DeWayne wrote:

> Thanks for being so responsive, Henk-Jan.
>
> I used specific inbound and outbound directories ( "/Clearpointt/Inbound" and "/Clearpointt/Outbound" ) and I can see that other data is going to the outbound directory (when I use
> transform.inn2out(inn,out)) so I know that part's working. I've attached a plugin with my data in case that will help. I'm running the Clearpointt route to generate the data. I've also turned off
> reporting for the empty 214 file and I'll take care of the v004010 997 after I get this one working.
>
>
> Thanks.
>
> Harold.

>
> On Tuesday, April 16, 2013 8:50:58 PM UTC-4, aoplnx wrote:
>

[henk-jan ebbers]

hmmm, therre are no input files in the plugin.
bots includes only input files in bots/botssys/infile

btw, in channel Clearpointt seq 9970 'frommessagetype' is not x12. Is that on purpose?

kind regards,

henk-jan


On 05/03/2013 09:13 PM, Harold DeWayne wrote:
> Thanks for being so responsive, Henk-Jan.
>
> I used specific inbound and outbound directories ( "/Clearpointt/Inbound" and "/Clearpointt/Outbound" ) and I can see that other data is going to the outbound directory (when I use
> transform.inn2out(inn,out)) so I know that part's working. I've attached a plugin with my data in case that will help. I'm running the Clearpointt route to generate the data. I've also turned off
> reporting for the empty 214 file and I'll take care of the v004010 997 after I get this one working.
>
>
> Thanks.
>
> Harold.
>
> On Tuesday, April 16, 2013 8:50:58 PM UTC-4, aoplnx wrote:
>

[henk-jan ebbers]

hi Harold,

there is filtering in the outchannel.
in that rout, under 'Filtering for outchannel', testindicator is 'T'.

kind regards,
henk-jan


On 05/04/2013 03:35 AM, Harold DeWayne wrote:
> I see route Clearpointt, sequence 9970, incoming channel is ClearpointIn997, from type is X12, from message type is 99700500, translate is translate, outgoing channel is ClearpointtOut.XML.
> InChannel ClearpointtIn997 is pointing to file in path /Clearpointt/Inbound/ and filename *997*X12.*.
> OutChannel ClearpointtOut.XML is pointing to file in path /Clearpointt/Outbound/ and filename {frompartner}_{botskey}_{messagetype}_{datetime:%Y%m%d_%H%M}_*.XML
>
> The result I'm seeing is below:
>
>
> Also, here is the input file:
> ISA*00* *00* *02*CLLQ *ZZ*PCOF *101104*1234*U*00501*000000813*0*P*:~
> GS*FA*CLLQ*PCOF*20101104*123442*813*X*005010~
> ST*997*000000813~
> AK1*SM*19393~
> AK2*204*0001~
> AK5*A~
> AK9*A*1*1*1~
> SE*6*000000813~
> GE*1*813~
> IEA*1*000000813~
>
> And the output file that is getting stuck:
> <?xml version="1.0" encoding="utf-8" ?><Ack cntrl="813" receiver="PCOF" sender="CLLQ"><GId number="19393" type="SM" /><TId number="0001" type="204" /><GRslt accepted="A" received="1" result="1" total="1" /></Ack>
>
>
>
> One more thing: I'm not getting a GRslt elementat all from this. What am I doing wrong? I figure it has to do with a inngetloop and out.putloop but I haven't figured that out yet.
>
>
>
> Thanks.
> Harold.

> > To unsubscribe from this group and stop receiving emails from it, send an email to botsmail+u...@googlegroups.com <javascript:>.
> > For more options, visit https://groups.google.com/groups/opt_out <https://groups.google.com/groups/opt_out>.

[Harold DeWayne]

Youdaman!!!  Now to tackle that inn.getloop() and out.putloop().


Thanks.
Harold

[henk-jan ebbers]

btw, I noticed that you have some Clearpointt routes-entries.
I do not know if it is useful for you, but what this does now could be done in one entry.

kind regards,
henk-jan

> > > For more options, visit https://groups.google.com/groups/opt_out <https://groups.google.com/groups/opt_out> <https://groups.google.com/groups/opt_out

[henk-jan ebbers]

can you send the xml file and the xml grammar?

another way is to use a setting in config/bots.ini
mappingdebug = True
this gives the results of the put's and gets in the log file.

btw, no need to count segmetns if you do like this:
out.put({'BOTSID':'ST'},{'BOTSID':'SE','SE01':out.getcount()+1,'SE02':out.ta_info['reference'].zfill(4)})
(this always gives the right number of segments in SE)


kind regards,
henk-jan

On 05/08/2013 05:59 PM, Harold DeWayne wrote:
> All --
>
> I am havingmore issues building output from BOTS...
>
> I am working on an x12 204, mapping from XML. The XML grammar was generated successfully by bots-xml2botsgrammar and apparently has no problems, the X12 grammar is the standard 204004010 grammar,
> but in my map, I have the following:
>
>
> import bots.transform as transform
>
> def main(inn,out):
>
> # Create and initialize counter(s)
> segcount = 2
>
> # build the ST segment for output
> out.put({'BOTSID':'ST','ST01':'210','ST02':out.ta_info['reference'].zfill(4)})
>
> # build the B3 segment for output
> out.put({'BOTSID':'ST'},{'BOTSID':'B3','B302':inn.get({'BOTSID':'ShipmentInvoice','Summary__invoice':None})})
> out.put({'BOTSID':'ST'},{'BOTSID':'B3','B303':inn.get({'BOTSID':'ShipmentInvoice','Summary__primary_id':None})})
> out.put({'BOTSID':'ST'},{'BOTSID':'B3','B304':inn.get({'BOTSID':'ShipmentInvoice','Summary__pay_method':None})})
> out.put({'BOTSID':'ST'},{'BOTSID':'B3','B306':inn.get({'BOTSID':'ShipmentInvoice','Summary__invoice_date':None})})
> out.put({'BOTSID':'ST'},{'BOTSID':'B3','B307':inn.get({'BOTSID':'ShipmentInvoice','Summary__amount':None})})
> out.put({'BOTSID':'ST'},{'BOTSID':'B3','B311':inn.get({'BOTSID':'ShipmentInvoice','Summary__scac':None})})
> segcount += 1 # Count the B3 segment
>
> # build the SE segment for output
> out.put({'BOTSID':'ST'},{'BOTSID':'SE','SE01':segcount})
> out.put({'BOTSID':'ST'},{'BOTSID':'SE','SE02':out.ta_info['reference'].zfill(4)})
>
> I keep getting the following error from BOTS: MessageError: [S03]: Record "[['ST'], ['B3']]" occurs 0 times, min is 1.
>
> I have verified that I have all the mandatory elements are mapped for the B3 segment and that all he XML element are populated, so I figure I'm just not identifying the B3 segment correctly.
>
> Here's what I'm seeing in my engine.log file:
> 20130508 11:45:54 INFO engine : running route Clearpointt 2100
> 20130508 11:45:54 DEBUG engine : no import of "/var/www/html/bots-3.0.0/bots/usersys/routescripts/Clearpointt".
> 20130508 11:45:54 DEBUG engine : start communication channel "ClearpointtIn210" type file in.
> 20130508 11:45:54 DEBUG engine : no import of "/var/www/html/bots-3.0.0/bots/usersys/communicationscripts/ClearpointtIn210".
> 20130508 11:45:54 DEBUG engine : finished communication channel "ClearpointtIn210" type file in.
> 20130508 11:45:54 DEBUG engine : no import of "/var/www/html/bots-3.0.0/bots/usersys/mappings/translation".
> 20130508 11:45:54 DEBUG engine : start translating file "28874" editype "xmlnocheck" messagetype "PCOF_XML_TO_210".
> 20130508 11:45:54 DEBUG engine : read edi file "28874".
> 20130508 11:45:54 DEBUG engine : import "/var/www/html/bots-3.0.0/bots/usersys/grammars/xmlnocheck.PCOF_XML_TO_210".
> 20130508 11:45:54 DEBUG engine : Mappingscript "PCOF_XML_TO_x12_210_4010" translates messagetype "PCOF_XML_TO_210" to messagetype "210004010".
> 20130508 11:45:54 DEBUG engine : import "/var/www/html/bots-3.0.0/bots/usersys/mappings/xmlnocheck.PCOF_XML_TO_x12_210_4010".
> 20130508 11:45:54 DEBUG engine : run userscript "main" in "/var/www/html/bots-3.0.0/bots/usersys/mappings/xmlnocheck.PCOF_XML_TO_x12_210_4010".
> 20130508 11:45:54 DEBUG engine : Mappingscript "PCOF_XML_TO_x12_210_4010" finished.
> 20130508 11:45:54 DEBUG engine : Start writing output file editype "x12" messagetype "210004010".
> 20130508 11:45:54 DEBUG engine : import "/var/www/html/bots-3.0.0/bots/usersys/grammars/x12.210004010".
> 20130508 11:45:54 DEBUG engine : record "ST":
> 20130508 11:45:54 DEBUG engine : "ST01" : "210"
> 20130508 11:45:54 DEBUG engine : "ST02" : "0743"
> 20130508 11:45:54 DEBUG engine : record "SE":
> 20130508 11:45:54 DEBUG engine : "SE01" : "3"
> 20130508 11:45:54 DEBUG engine : "SE02" : "0743"
> 20130508 11:45:54 DEBUG engine : translated input file "28874".
> 20130508 11:45:54 DEBUG engine : start communication channel "ClearpointtOut.X12" type file out.
> 20130508 11:45:54 DEBUG engine : no import of "/var/www/html/bots-3.0.0/bots/usersys/communicationscripts/ClearpointtOut.X12".
> 20130508 11:45:54 DEBUG engine : finished communication channel "ClearpointtOut.X12" type file out.
> 20130508 11:45:54 DEBUG engine : finished route Clearpointt 2100
>
>
> Can anyone tell me what I'm doing wrong, please?
>
>
> Thanks.
> Harold DeWayne
>
>
> PS: Henk-Jan, BikeMike... thanks for all you've done for me in helping me to understand. I'm trying not to disturb you anymore than I have to.

> <https://groups.google.com/groups/opt_out>> <https://groups.google.com/groups/opt_out <https://groups.google.com/groups/opt_out>

[Harold DeWayne]

You should have the files by now... I sent them privately due to NDAs.  Thanks for the counter info as well.

[henk-jan ebbers]

hi harold,

if you look at the grammar, you'll see that eg the name of the xml root is:
'{http://my/crazy/namespace}ShipmentInvoice', not ShipmentInvoice

(it is called xml namespace...xml is sooo much easier as x12 ;-)))

also check out: https://groups.google.com/forum/?fromgroups=#!searchin/botsmail/namespace/botsmail/PtAjn6QApy4/5WH-Gnm6yU4J
Mike gives some real good examples in the email just below the deleted one.


kind regards,
henk-jan

> > <https://groups.google.com/groups/opt_out <https://groups.google.com/groups/opt_out>>> <https://groups.google.com/groups/opt_out <https://groups.google.com/groups/opt_out>

[henk-jan ebbers]

On 05/08/2013 06:39 PM, Harold DeWayne wrote:
>

> another way is to use a setting in config/bots.ini
> mappingdebug = True
> this gives the results of the put's and gets in the log file.

Hi Harold,

this slipped my mind: there is a bug in the mappingdebug in bots 3.0.0
(http://code.google.com/p/bots/issues/detail?id=208&colspec=ID%20Type%20Status%20Priority%20Summary)

it is easy to fix:

in botsinit.py, line 188 should be:
botsglobal.logmap = logging.getLogger('engine.map')
(instead of)
botsglobal.logmap = logging.getLogger('bots.map')


kind regards,
henk-jan

[Harold DeWayne]

That greatly increases the usefulness of the engine.log file.  Thanks.


Harold.

[henk-jan ebbers]

ok, good.

I am busy testing a new feature: checking all get/getloops with grammar.
catches unintended errors in mapping scripts.

kind regards,
henk-jan

On 05/10/2013 04:06 PM, Harold DeWayne wrote:
> That greatly increases the usefulness of the engine.log file. Thanks.
>
>
> Harold.
>
> On Friday, May 10, 2013 7:40:47 AM UTC-4, eppye wrote:
>
>
> On 05/08/2013 06:39 PM, Harold DeWayne wrote:
> >
> > another way is to use a setting in config/bots.ini
> > mappingdebug = True
> > this gives the results of the put's and gets in the log file.
> Hi Harold,
>
> this slipped my mind: there is a bug in the mappingdebug in bots 3.0.0
> (http://code.google.com/p/bots/issues/detail?id=208&colspec=ID%20Type%20Status%20Priority%20Summary

> <http://code.google.com/p/bots/issues/detail?id=208&colspec=ID%20Type%20Status%20Priority%20Summary>)

>
> it is easy to fix:
>
> in botsinit.py, line 188 should be:
> botsglobal.logmap = logging.getLogger('engine.map')
> (instead of)
> botsglobal.logmap = logging.getLogger('bots.map')
>
>
> kind regards,
> henk-jan
>

[Harold DeWayne]

Sounds like a very useful feature... any hints on using nested loops?

Harold.

On Tuesday, April 16, 2013 8:50:58 PM UTC-4, aoplnx wrote:

[henk-jan ebbers]

hi harold,

did you check out the plugin x12toxml_supplier_version850-856-810-997
it deals with ASN several levels (order, shipment, package, item).

kind regards,
henk-jan

[aoplnx]

Hi Henk-Jan

Following  one of your plugin "x12toxml_retailer_version_850-856-810-997" i was able to adapted to my need. X12 to fixed data.

Everything is O.K I can received inbound 850 and send out 810 and 997.

The issue where I am stuck  is with the  997 outbound files. Header ISA_04 is O.K but ISA_06 is pointing to the GS_02 from the PO

Any input will appreciated for resolving this issue.

I have to use 4010VICS. I know that VICS is a subset of X12 so what I am doing is renaming your X12 4010 files to 4010VICS. this is working for me but my question is possible to get the VICS files for 4010 versions?

Regard

Andres

[henk-jan ebbers]

On 06/27/2013 02:45 AM, aoplnx wrote:
>
> Hi Henk-Jan
>
>
> Following one of your plugin "x12toxml_retailer_version_850-856-810-997" i was able to adapted to my need. X12 to fixed data.
> Everything is O.K I can received inbound 850 and send out 810 and 997.
>
> The issue where I am stuck is with the 997 outbound files. Header ISA_04 is O.K but ISA_06 is pointing to the GS_02 from the PO

what is the problem here?
sender/receiver are flipped for the 997.

or is the sender or receiver different in GS and ISA envelope?

>
> Any input will appreciated for resolving this issue.
>
> I have to use 4010VICS. I know that VICS is a subset of X12 so what I am doing is renaming your X12 4010 files to 4010VICS. this is working for me but my question is possible to get the VICS files
> for 4010 versions?

yes sure, just edit them.
but renaming is much easier, and is exactly what you should do.
VICS is not so much a subset, but instructions for usage, a sort of common MIG.
I do not think the the VICS documentation says: 'check that only the segments/elements used in this user-group are used, else give an error'. ;-))
On the contrary!

kind regards,
henk-jan

>
> Regard
>
> Andres
>
>
>
>
>
>
>
>
> --
> You received this message because you are subscribed to the Google Groups "Bots Open Source EDI Translator" group.

[aoplnx]

Hi Henk-Jan

Your replied make a lot of sense to me related to the VICS. I will use the 4010 X12 and rename VICS.

Related to my 997 issue where I am stuck is this:

I received an 850 with this header and translation went O.K

ISA*00*          *00*          *ZZ*AOPPROEDI      *12*4167691788     *130219*1103*U*00401*000063522*0*P*>
GS*PO*4167913211*4167691788*20130219*1103*63522*X*004010VICS

The 977 was this one ( wrong)

ISA*00*          *00*          *01*4167691788     *01*4167913211     *130626*1411*^*00403*000000020*1*P*>~
GS*FA*4167691788*4167913211*20130626*1411*20*X*004010~

This shoulbe to ZZ AOPPPROEDI.

Any help hint will be appreciate

Regard

Andres

[henk-jan ebbers]

On 06/27/2013 10:39 PM, aoplnx wrote:

> I received an 850 with this header and translation went O.K
>
> ISA*00* *00* *ZZ*AOPPROEDI *12*4167691788 *130219*1103*U*00401*000063522*0*P*>
> GS*PO*4167913211*4167691788*20130219*1103*63522*X*004010VICS
> The 977 was this one ( wrong)
> ISA*00* *00* *01*4167691788 *01*4167913211 *130626*1411*^*00403*000000020*1*P*>~
> GS*FA*4167691788*4167913211*20130626*1411*20*X*004010~

yes, bots picks up the ID from the GS.
To get the right ID in the ISA:
use a partnerdependent syntax file (usersys/partenrs/x12/4167913211.py)
see this page in wiki: http://code.google.com/p/bots/wiki/GrammarsPartnerSyntax

kind regards,
henk-jan

> > To unsubscribe from this group and stop receiving emails from it, send an email to botsmail+u...@googlegroups.com <javascript:>.
> > For more options, visit https://groups.google.com/groups/opt_out <https://groups.google.com/groups/opt_out>.

[aoplnx]

Hi henk-jan

Thank very much! I know I was missing something. Now it make sense and solve my problem

Regard

Andres

[aoplnx]

[aoplnx]

Hi henk-jan

Quick Question. I need to translated a pipe delimiter file into EDI. There is any samples around for read pipe delimiter files?

Regard

Andres

On Thursday, June 27, 2013 8:53:30 PM UTC-4, aoplnx wrote:

[BikeMike]

Hi Andres,
Pipe delimited is just csv in another form.  Use editype csv, and set syntax parameters in the grammar, for example...

syntax = {
        'field_sep':'|',
        'quote_char':'',
        'charset':"us-ascii",
        'skip_firstline':False,
        'merge':False,
        'noBOTSID':True,
        }

Kind Regards,
Mike

[aoplnx]

Thank you Mike.

Excellent example