EXEXCIO in Rexx reading a 600,000 file

[Valone, Toren W.]

It appears you cannot read a file this large, I keep getting S878-10,
when running a Rexx Program in batch and coding Region=0m in the job
card or in the step. Does anyone know how to read a large file in Rexx?

----------------------------------------------------------------------
For TSO-REXX subscribe / signoff / archive access instructions,
send email to LIST...@VM.MARIST.EDU with the message: INFO TSO-REXX

[Imbriale, Donald]

Try coding REGION=64M first.

If that doesn't work, you'll have to modify the REXX exec to read the
file in chunks.

Don Imbriale

-----Original Message-----
From: TSO REXX Discussion List [mailto:TSO-...@VM.MARIST.EDU] On Behalf
Of Valone, Toren W.
Sent: Thursday, February 07, 2008 5:44 PM
To: TSO-...@VM.MARIST.EDU
Subject: EXEXCIO in Rexx reading a 600,000 file

It appears you cannot read a file this large, I keep getting S878-10,
when running a Rexx Program in batch and coding Region=0m in the job
card or in the step. Does anyone know how to read a large file in Rexx?

***********************************************************************
Bear Stearns is not responsible for any recommendation, solicitation,
offer or agreement or any information about any transaction, customer
account or account activity contained in this communication.
***********************************************************************

[Bob Stark]

The attached program shows the logic for reading a large file in chunks.

It reads 20 records at a time, you will want to read something like 5000 -
10000 at a time.

Look for the 20 in the EXECIO statement and change it.

Regards,

Bob Stark

ProTech - When you're serious about Systems Management
Consulting, Software, and Training for z/OS, UNIX and Internet
www.protechtraining.com 800-373-9188 x150 412-445-8072

-----Original Message-----
From: TSO REXX Discussion List [mailto:TSO-...@VM.MARIST.EDU] On Behalf Of
Valone, Toren W.
Sent: Thursday, February 07, 2008 5:44 PM
To: TSO-...@VM.MARIST.EDU
Subject: EXEXCIO in Rexx reading a 600,000 file

--
If this email is spam, report it here:
http://www.onlymyemail.com/view/?action=reportSpam&Id=Mzg3MzE6NTI4MDUwMDUzOm
JzdGFya0Bwcm90ZWNocHRzLmNvbQ%3D%3D

[Hamilton, Robert L]

This is BATCH_EM;

Do Forever
EXECIO 1000 DDNAME (STEM BATCH.
Process records /* check also for zero recs */
If batch.0 <1000 LEAVE
End /* do forever */

[Bill Turner, WB4ALM]

Region=0m does not do what you think it does.

It gives you the largest regionsize available at the momment.

The coding a region size greater that 16M and less then the maximum that
your shop will allow.

DO NOT code a value between something around 9meg and 16meg.

The largest region "below the line" that you can generally ask for is
between 8 and 10 meg in most shops.
The operating system resides in the space between that point and 16 meg.
If you need space greater than
what is available below the line, you must code a value higher than 16meg.

You stated that you had 600k records - how wide are they?

I have read files into memory with execio that were between 1.5 and 1.7
gig in size.

In most cases, reading the files in "chunks" as was suggested by another
individual is the best thing
to do... In my case I needed the entire file, because I was building
multiple indexes and summary
sums... To do it in chunks would have required reading the file
multiple times.

hope this helps...

/s/ Bill Turner

[Ryerse, Robin]

SCXSORT in file520 at www.cbttape.org might be your solution. If most of
the data (records and/or fields) are to be discarded, SORT's control
statements can do that elimination. SCXSORT will then present your exec
with only the selected/reformatted data in stemmed variables. And it all
happens with one pass of the source file without intermediate/temporary
datasets.

-----Original Message-----
From: TSO REXX Discussion List [mailto:TSO-...@VM.MARIST.EDU] On Behalf
Of Valone, Toren W.
Sent: February 7, 2008 5:44 PM
To: TSO-...@VM.MARIST.EDU
Subject: EXEXCIO in Rexx reading a 600,000 file

[Bob Bridges]

Why 10K records? I wouldn't bother doing fewer than 100K, unless the LRECL
is unusually great. Typically I don't run into problems until I get past
300 000 or 400 000 records.

---
Bob Bridges, rhb...@attglobal.net
cell 336 382-7313

/* Men are not angered by mere misfortune but by misfortune conceived as
injury. And the sense of injury depends on the feeling that a legitimate
claim has been denied. The more claims on life, therefore, that your
patient can be induced to make, the more often he will feel injured and, as
a result, ill-tempered. -advice to a tempter, from "The Screwtape Letters"
by C S Lewis */

-----Original Message-----
From: Bob Stark
Sent: Thursday, February 7, 2008 20:10

The attached program shows the logic for reading a large file in chunks.
It reads 20 records at a time, you will want to read something like 5000 -
10000 at a time. Look for the 20 in the EXECIO statement and change it.

[Hamilton, Robert L]

I PUT the chunk size as a parm; We don't seem to have such problems with
a later version of z/OS

bobh

-----Original Message-----
From: TSO REXX Discussion List [mailto:TSO-...@VM.MARIST.EDU] On Behalf

[Frank Clarke]

On 11 Feb 2008 09:27:07 -0800, rhb...@ATTGLOBAL.NET (Bob Bridges) wrote:
<02ff01c86cd3$29486a10$020fa8c0@rhblap1>

>Why 10K records? I wouldn't bother doing fewer than 100K, unless the LRECL
>is unusually great. Typically I don't run into problems until I get past
>300 000 or 400 000 records.

Does it really matter? The system is going to read block-at-a-time regardless
how many records you specify to be read by EXECIO. If size is a problem,
EXECIO 1 ....
which merely accesses the next record in the buffer.

(change Arabic number to Roman numeral to email)