Max number of rows

[Richard Keller]

Back in the day there was a maximum row limit or 1,000,000. Is there still
such a limit ( other then memory ) ?

Thanks,
Richard

[philipsalgannik]

Why would you want even to think about this :-) ?

[Richard Keller]

I have a manufacturing operation with over 3,000,000 raw materials. In our
operations, we typically load the Bill of Materials into memory and run our
own sorting techniques to reduce database load for certain allocation,
purchasing, and manufacturing sequencing. This is not a rookie question
but a real question. Not everything is transactional. I just need to know
the upper limits of the datawindow as I have seen Powerbuilder Runtime Error
a couple of times in our application when it hasn't been seen in years of
operation at other plants.

Richard

<Philip Salgannik> wrote in message
news:43e284cb.5ad...@sybase.com...

[philipsalgannik]

> I have a manufacturing operation with over 3,000,000 raw
> materials. In our operations, we typically load the
> Bill of Materials into memory and run our own sorting
> techniques to reduce database load for certain allocation,
> purchasing, and manufacturing sequencing. This is not a
> rookie question but a real question. Not everything is
> transactional.

The fact that not everything is transactional does NOT in
itself equal to a statement that it should NOT happen in the
database.
The goal is to move processing TO the data as close as
possible, not the other way around, ESPECIALLY when we are
talking about magnitudes of data like this.
What's the point of moving these amounts of data to a client
across the wire to "run your own sorting techniques" instead
of moving thos sorting techiques to the data?

[Richard Keller]

This is an application that resides on the database server and runs as an NT
service not sent over the wire to a client workstation. We have a real
time engine that runs an allocation sequence for multiple facilities and
multiple manufacturing cells. Historically, until this client loading a
bill of materials and product listing into memory and running a binary sort
to locate the record was MUCH faster then running a retrieve for each row.
We can go back to that if necessary. I was just trying to isolate the
Powerbuilder Runtime Error and wondered if it was table size related.

Richard

<philip Salgannik> wrote in message
news:43e29004.663...@sybase.com...

[Sanjiv Das [TeamSybase]]

Richard,

Could you please post the error details as well? May help narrow down the
problem.

Thanks,

Sanjiv.

"Richard Keller" <ric...@kellersystems.com> wrote in message
news:43e29fa9$1@forums-1-dub...

[Jim Egan]

ric...@kellersystems.com wrote...

> This is an application that resides on the database server and runs as an NT
> service not sent over the wire to a client workstation. We have a real
> time engine that runs an allocation sequence for multiple facilities and
> multiple manufacturing cells. Historically, until this client loading a
> bill of materials and product listing into memory and running a binary sort
> to locate the record was MUCH faster then running a retrieve for each row.
> We can go back to that if necessary. I was just trying to isolate the
> Powerbuilder Runtime Error and wondered if it was table size related.
>

How about the version of PB too.
--
Jim Egan [TeamSybase]
Sybase product enhancement requests:
http://www.isug.com/cgi-bin/ISUG2/submit_enhancement

[Jerry Siegel]

And which DBMS?

"Richard Keller" <ric...@kellersystems.com> wrote in message
news:43e29fa9$1@forums-1-dub...

[Chris Pollach]

Richard;

The current PB 10.2.1 version limitation is: 2,147,483,647 rows.

Suggestion: If I were you with 3M rows.. I would use the "RowsToDisk" option
and let the DataStore handle the fetching from memory to disk. You may find
this almost as all rows to memory but with without the large RAM overhead.
Food for thought.

Regards ... Chris

"Richard Keller" <ric...@kellersystems.com> wrote in message

news:43e26454$1@forums-2-dub...

[philipsalgannik]

The fact that it runs on the same machine is essentially
irrelevant, the data needs to be marshalled from db process
address space to the separate address space of the your app.
Depending on the DBMS you have a lot of choices as far as
running massive data processing in the database...

[Dean Jones]

This sounds like a company I worked with and I had suggested a design to
break the processing up into logical units of work and process in EAS so you
could manage threads and divide the work up to multiple servers. Do you work
for a textile company?

--
Dean Jones [TeamSybase]
CEO
Certified PowerBuilder Developer
www.powerobjects.com
(612) 339-3355 ext 112

"Richard Keller" <ric...@kellersystems.com> wrote in message

news:43e29fa9$1@forums-1-dub...

[Richard Keller]

No, I have a software company that manages multiple manufacturing and
distribution companies. I have a textile company as a customer however
this is at a large faucets and cabinitry customer.

Technical Details:
MS SQL Server 2005, PB 10.2

We may have to go the route of EAS and this process was architected under
the DPB style years ago so that is not a big deal to convert over if
necessary.

Thanks for the input.

Richard

"Dean Jones" <dean_dot_jones_at_powerobjects_dot_com> wrote in message
news:43e39b43$1@forums-1-dub...

[Richard Keller]

Already have it as RowsToDisk and the memory grows anyways.

Richard

"Chris Pollach" <cpol...@travel-net.dot.com> wrote in message
news:43e38337$1@forums-2-dub...

[Dean Jones]

I would divide the process up to run on multiple servers using EAS and
threadmanager. Not only do you have an issue with large volumes of data you
have an issue with the time it takes to process it all.

--
Dean Jones [TeamSybase]
CEO
Certified PowerBuilder Developer
www.powerobjects.com
(612) 339-3355 ext 112

"Richard Keller" <ric...@kellersystems.com> wrote in message

news:43e3ca3e$1@forums-1-dub...

[Richard Keller]

Ok, EAS Server has to be licensed for each server then what is the cheapest
license available. This is the problem with the EAS Server license model
when it is a simple process like this there should be a single user license
that would allow the features to be used at a reasonable price.

"Dean Jones" <dean_dot_jones_at_powerobjects_dot_com> wrote in message

news:43e3c827$1@forums-2-dub...

[Dean Jones]

Look at workgroup edition. We would be happy to quote a price, but you are
looking at $3000 for a dual cpu server.

The app server will make the whole process much easier, you have a
controlling app that chunks the work and makes requests to multiple server
to process the work load. Now you can simply add more servers as needed.

--
Dean Jones [TeamSybase]
CEO
Certified PowerBuilder Developer
www.powerobjects.com
(612) 339-3355 ext 112

"Richard Keller" <ric...@kellersystems.com> wrote in message

news:43e3cd6b@forums-2-dub...

[Richard Keller]

I reduced it down to a row by row operation and I get the memory error
anyways.

"The instruction at 0x0121722d referenced memory at
0x01241fa8. The Memory could not be read."

Not much to go on may Tech Support will understand the offsets. Usually
there is more to go on.

Richard

"Sanjiv Das [TeamSybase]" <No-Spam-SDa...@HotMail.Com> wrote in
message news:43e2c070$1@forums-1-dub...

[Chris Pollach]

We need Distributed PB back ... that was a reasonable cost!!!!

"Richard Keller" <ric...@kellersystems.com> wrote in message

news:43e3cd6b@forums-2-dub...

[Dean Jones]

LOL

--
Dean Jones [TeamSybase]
CEO
Certified PowerBuilder Developer
www.powerobjects.com
(612) 339-3355 ext 112

"Chris Pollach" <cpol...@travel-net.dot.com> wrote in message

news:43e7535e@forums-1-dub...

[Jim Egan]

cpol...@travel-net.dot.com wrote...

> We need Distributed PB back ... that was a reasonable cost!!!!

Step out of the freezing weather. Your brain is starting to become irrational. <G>