Google Groups no longer supports new Usenet posts or subscriptions. Historical content remains viewable.
Dismiss

Out of Memory Error while consuming a large file through pipeline

1 view
Skip to first unread message

elifeinchrist

unread,
Dec 31, 2009, 10:55:01 AM12/31/09
to
I am feeding in a large .csv file (160MB) to Biztalk. The Receive Port is
configured to the default PassThru Pipeline.

The file gets picked up and starts processing but then in sometime it throws
a OutOfMemory Error. I also see my BiztalkMsgBox Db growing in size.

Is there a better way to consume a large sized file without the OutofMemory
Error problem. I am curious if there is any Configuration Setting in Biztalk
which can help resolve this issue

Robert

Alastair Grant

unread,
Jan 15, 2010, 9:41:15 AM1/15/10
to
I'm not sure how the batch-size impacts an individual, albeit large
file. Perhaps increasing this to 200MB may help.

On 31 Dec 2009, 15:55, elifeinchrist

Daniel S

unread,
Jan 18, 2010, 12:10:12 PM1/18/10
to
Check out this article: http://msdn.microsoft.com/en-us/library/aa560481(BTS.20).aspx

Basically, you can set the "Large message Threshold" and "Large
message fragment size" properties on the *BizTalk GROUP* to help
control when and how your large message is written to the message box,
and should allow you to eliminate the out-of-memory errors.

- Dan

0 new messages