Assistance with Database Destination Task or Input Cleansing

22 views
Skip to first unread message

John Nickell

unread,
Mar 4, 2024, 2:29:08 PM3/4/24
to COZYROC
I have a multi-step package that I'm encountering an issue with a particular character in the input data.

My input data is coming from a group of XML files. In one of those XML files a field's value starts with <STREET1>&#x200B;1700 </Street>.  This appears to cause issues in my package and I'm unable to determine how to handle this. I'd prefer to just get rid of the character

The Dataflow package Extracts the XML data, runs it through a Data Conversion step to cast this particular field to a DT_STR (100) field. This cast fails sending it to a Script task to get the column and error description. I use a derived column task to add a column with this information to the failing record. From this I attempt to write the column and error description to a different database table. This fails as well even though the problematic "Street" field is not referenced. 

I'd appreciate any pointers.
Thanks!

John Nickell

unread,
Mar 4, 2024, 3:36:51 PM3/4/24
to COZYROC
I think I figured out my problem. I had recreated my logging table and forgot to add the constraint for the Date_Created field to default it to GetDate() but the column was set to Not Null. 

Adding the constraint to the table seems to have addressed the issue I was having. 

Reply all
Reply to author
Forward
0 new messages