Re: Export only getting partial data

131 views
Skip to first unread message

theswami

unread,
Sep 9, 2012, 3:41:58 AM9/9/12
to data-loa...@googlegroups.com
Are there any errors during the export?  Does your API user have access to all the records? 

On Friday, September 7, 2012 2:30:18 PM UTC-7, linda p wrote:
Exporting all fields from Product and we only get 1000 records. Should get many more

theswami

unread,
Sep 10, 2012, 7:54:37 PM9/10/12
to data-loa...@googlegroups.com
Could you post the process-conf.xml file?  It would be under cliq_process/<your process name>/config.

Perhaps there is a strange setting there.

On Monday, September 10, 2012 8:57:42 AM UTC-7, linda p wrote:
no errors, API user is administrator so yes has access to all records, running same through Apex Data Loader interface with same account gets all records. There are like 2200 records, bat process out of cliq stops at 1000.

linda p

unread,
Sep 11, 2012, 10:48:56 AM9/11/12
to data-loa...@googlegroups.com
copy of process-conf.xml attached, I removed id and password, everything else is as it was, code that stops after 1000 records. NOTE: if I remove some of the columns we get all 2200 records...
process-conf.xml
process-conf - Copy.xml

Linda S. Pieper

unread,
Sep 11, 2012, 10:50:43 AM9/11/12
to data-loa...@googlegroups.com
I posted the process-conf.xml.  I meant to only post the copy with the password and id removed but i see it looks like both were posted . Could you please remove the process.conf.xml asap as it has our userid and password... and please let me know.

Thanks!
Linda Pieper
Caterpillar Inc.
Used Equipment Analyst
Customer Services Support
309-675-0636
Pieper_...@cat.com

Jose Garcia

unread,
Sep 11, 2012, 10:56:40 AM9/11/12
to data-loa...@googlegroups.com
Have you noticed that your query is only searching for Product_Source__c = 'CURINV'? Do you get more products using that criteria when you are not using the DL?

--
 
 




--
José Garcia Ponce

linda p

unread,
Sep 11, 2012, 1:51:02 PM9/11/12
to data-loa...@googlegroups.com
we should get 2217 records with the "curinv" filter, we get that many through the interface but only 1000 are written out using the cliq generated batch files
attached a log showing 2 runs, in the second where we get all records I removed some of the columns from the SOQL call
sdl.log

Jose Garcia

unread,
Sep 11, 2012, 3:51:22 PM9/11/12
to data-loa...@googlegroups.com
What happens if you run the same query (with all the columns) from the DL GUI?. Also, I believe you should have another file containing errors. In any case, I would be opening a case with support if you don't get any error on the gui or in the logs.

--
 
 



--
José Garcia Ponce

Linda S. Pieper

unread,
Sep 11, 2012, 3:55:12 PM9/11/12
to data-loa...@googlegroups.com
runs fine, exports all data through the DL GUI -- Linda

linda p

unread,
Sep 12, 2012, 6:09:33 PM9/12/12
to data-loa...@googlegroups.com
I'm getting an error Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
how do I fix that?

linda p

unread,
Sep 14, 2012, 12:22:45 PM9/14/12
to data-loa...@googlegroups.com
this fixed it
 

Your Process .bat file inside the bin folder where your Dataloader has been installed

..\_jvm\bin\java.exe -cp ..\DataLoader.jar -Dsalesforce.config.dir=%1 com.salesforce.dataloader.process.ProcessRunner %PROCESS_OPTION%

You will have to modify this to add

..\_jvm\bin\java.exe -Xms1024m -Xmx1024m -cp ..\DataLoader.jar -Dsalesforce.config.dir=%1 com.salesforce.dataloader.process.ProcessRunner %PROCESS_OPTION%


On Friday, September 7, 2012 4:30:18 PM UTC-5, linda p wrote:
Reply all
Reply to author
Forward
0 new messages