out of memory. yes I need this many pixels, this is how i roll

[Jeffrey Martin]

I am trying to render a panorama that has some large source images.

There are 4 source images and they are each 230GB (yes really) in size.

I have many TB free disk space but it seems to be insufficient. No matter what I do I'm getting an "out of memory" error. I'm not getting any "scratch disk is full error" at all though.

I have 64GB of ram in this machine. it is set to render using the GPU, maybe I should switch that off? 

I have set the first scratch disk to be the HDD which has 5TB free space (but again I'm not getting a "scratch disk is full" error)

The output pano is set to 290,000 x 145,000 pixels, 16 bit tiff, not compressed.

In the case where this is completely impossible, maybe I can render it as cube faces instead, which would be around 128,000 x 128,000 pixels in size per cube face?

If I wanted to render this panorama completely in-core, how much RAM would I need, is there a way to calculate that? 1TB? 2TB?

thank you :-) 

Jeffrey

[PTGui Support]

Hi Jeffrey,

Could you try disabling optimum seam finding initially? This might eat
significant amounts of memory. Before loading the images, go to Panorama
Editor, Blending side bar and uncheck 'Find Optimum Seams'. Then load
the images.

Kind regards,

Joost Nieuwenhuijse
www.ptgui.com

> --
> You received this message because you are subscribed to the Google
> Groups "PTGui Support" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to ptgui+un...@googlegroups.com
> <mailto:ptgui+un...@googlegroups.com>.
> To view this discussion on the web visit https://groups.google.com/d/
> msgid/ptgui/79687863-6cc1-45d1-9e1c-463becb82a50n%40googlegroups.com
> <https://groups.google.com/d/msgid/
> ptgui/79687863-6cc1-45d1-9e1c-463becb82a50n%40googlegroups.com?
> utm_medium=email&utm_source=footer>.

[Jeffrey Martin]

I will definitely try that, although that would negate the entire purpose of doing it this way.... but ok let's try that first.

[Jeffrey Martin]

switched off "optimum seams". saved project. relaunched ptgui. opened batch stitcher. loaded project.

after about 12 hours and the progress bar didn't move... out of memory. no "scratch disk full" errors.

I did already once output a 30,000px wide jpeg, so I know that something is possible....

[PTGui Support]

Ok then at least we know it's not related to seam finding.

Could you send me the project file?

Also, are you able to open the project in the GUI (not batch stitcher)
and do you get a preview in the panorama editor eventually? Or do you
get errors even at that stage?

I think it's a bug in PTGui. I have a feeling the issue can be worked
around by increasing Windows swap space, see for example:
https://www.windowscentral.com/software-apps/windows-11/how-to-manage-virtual-memory-on-windows-11
and adding more RAM is never a bad thing to do.

Kind regards,

Joost Nieuwenhuijse
www.ptgui.com

On 05-10-2024 09:51, Jeffrey Martin wrote:
> switched off "optimum seams". saved project. relaunched ptgui. opened
> batch stitcher. loaded project.
>
> after about 12 hours and the progress bar didn't move... out of memory.
> no "scratch disk full" errors.
>
> I did already once output a 30,000px wide jpeg, so I know that something
> is possible....
>
> On Friday, October 4, 2024 at 12:49:45 PM UTC+2 Jeffrey Martin wrote:
>
> I will definitely try that, although that would negate the entire
> purpose of doing it this way.... but ok let's try that first.
>
> On Friday, October 4, 2024 at 8:55:40 AM UTC+2 PTGui Support wrote:
>
> Hi Jeffrey,
>
> Could you try disabling optimum seam finding initially? This
> might eat
> significant amounts of memory. Before loading the images, go to
> Panorama
> Editor, Blending side bar and uncheck 'Find Optimum Seams'. Then
> load
> the images.
>
> Kind regards,
>
> Joost Nieuwenhuijse

> www.ptgui.com <http://www.ptgui.com>

> groups.google.com/d/ <https://groups.google.com/d/>
> > msgid/
> ptgui/79687863-6cc1-45d1-9e1c-463becb82a50n%40googlegroups.com
> <http://40googlegroups.com>
> > <https://groups.google.com/d/msgid/ <https://
> groups.google.com/d/msgid/>
> >
> ptgui/79687863-6cc1-45d1-9e1c-463becb82a50n%40googlegroups.com
> <http://40googlegroups.com>?
> > utm_medium=email&utm_source=footer>.

>
> --
> You received this message because you are subscribed to the Google
> Groups "PTGui Support" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to ptgui+un...@googlegroups.com
> <mailto:ptgui+un...@googlegroups.com>.
> To view this discussion on the web visit https://groups.google.com/d/

> msgid/ptgui/ddfbd2d5-4fe5-4304-8e28-17d3a9bddeb0n%40googlegroups.com
> <https://groups.google.com/d/msgid/ptgui/
> ddfbd2d5-4fe5-4304-8e28-17d3a9bddeb0n%40googlegroups.com?
> utm_medium=email&utm_source=footer>.

[Jeffrey Martin]

I'll send you the project file, give me a moment. 

Yes, I can open it in PTGui, it loads everything. It takes about a day to load everything though :) 

cheers.

[Jeffrey Martin]

I've increased the virtual memory - it was only on the C system drive, i set it to allow a couple more drives as well. I'll restart the machine and try it again, and i'll let you know. thanks!

[Robin Hood]

Jeffrey . . .

I deleted a mail I almost sent in the week, (advising to only use external drives for scratch disks), but thought 5TB couldn't be the C: prime drive.

Yes sequence all the external drives you can spare as scratch space, and C: should always be last and UNCHECKED.

(I think adobe advise this in prefs). This fixed my memory issues on large files . . . hope it does yours!

RH

To unsubscribe from this group and stop receiving emails from it, send an email to ptgui+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/ptgui/c6098a21-a72f-412f-b410-294b91abfa3en%40googlegroups.com.

[Jeffrey Martin]

@robin this didn't help, i'm not using C as scratch disk at all.

@joost after setting up multiple disks to allow "system managed" virtual memory, I still get "out of memory" error when trying to render the file in full size.

the largest i've managed so far is 60,000 x 30,000 in 8 bits.

[Jeffrey Martin]

Yeah, out of memory again, no matter what I do :( 

[PTGui Support]

Hi Jeffrey,

I will investigate.

Kind regards,

Joost Nieuwenhuijse
www.ptgui.com

On 08-10-2024 03:06, Jeffrey Martin wrote:
> Yeah, out of memory again, no matter what I do :(
>
> On Sunday, October 6, 2024 at 9:58:32 PM UTC-7 Jeffrey Martin wrote:
>
> @robin this didn't help, i'm not using C as scratch disk at all.
>
> @joost after setting up multiple disks to allow "system managed"
> virtual memory, I still get "out of memory" error when trying to
> render the file in full size.
>
> the largest i've managed so far is 60,000 x 30,000 in 8 bits.
>
> On Sunday, October 6, 2024 at 6:42:20 PM UTC+2 Robin Hood wrote:
>
> Jeffrey . . .
> I deleted a mail I almost sent in the week, (advising to only
> use external drives for scratch disks), but thought 5TB couldn't
> be the C: prime drive.
> Yes sequence all the external drives you can spare as scratch
> space, and C: should always be last and UNCHECKED.
> (I think adobe advise this in prefs). This fixed my memory
> issues on large files . . . hope it does yours!

> *RH*

> windows-11 <https://www.windowscentral.com/software-
> apps/windows-11/how-to-manage-virtual-memory-on-
> windows-11>

> and adding more RAM is never a bad thing to do.
>
> Kind regards,
>
> Joost Nieuwenhuijse

> www.ptgui.com <http://www.ptgui.com>

> > www.ptgui.com <http://www.ptgui.com> <http://

> > groups.google.com/d/ <http://groups.google.com/d/

> > <https://groups.google.com/d/ <https://
> groups.google.com/d/>>
> > > msgid/
> >
> ptgui/79687863-6cc1-45d1-9e1c-463becb82a50n%40googlegroups.com <http://40googlegroups.com>

> > <http://40googlegroups.com

> <http://40googlegroups.com>>
> > > <https://groups.google.com/d/msgid/ <https://

> groups.google.com/d/msgid/> <https://
> > groups.google.com/d/msgid/ <http://
> groups.google.com/d/msgid/>>
> > >
> >
> ptgui/79687863-6cc1-45d1-9e1c-463becb82a50n%40googlegroups.com <http://40googlegroups.com>
> > <http://40googlegroups.com

> <http://40googlegroups.com>>?
> > > utm_medium=email&utm_source=footer>.
> >
> > --
> > You received this message because you are
> subscribed to the Google
> > Groups "PTGui Support" group.
> > To unsubscribe from this group and stop receiving
> emails from it, send
> > an email to ptgui+un...@googlegroups.com
> > <mailto:ptgui+un...@googlegroups.com>.
> > To view this discussion on the web visit https://

> groups.google.com/d/ <https://groups.google.com/d/>
> > msgid/ptgui/
> ddfbd2d5-4fe5-4304-8e28-17d3a9bddeb0n%40googlegroups.com <http://40googlegroups.com>
> > <https://groups.google.com/d/msgid/ptgui/
> <https://groups.google.com/d/msgid/ptgui/>
> >
> ddfbd2d5-4fe5-4304-8e28-17d3a9bddeb0n%40googlegroups.com <http://40googlegroups.com>?

> > utm_medium=email&utm_source=footer>.
>
> --
> You received this message because you are subscribed to the
> Google Groups "PTGui Support" group.
>
> To unsubscribe from this group and stop receiving emails

> from it, send an email to ptgui+un...@googlegroups.com.
> To view this discussion on the web visit https://
> groups.google.com/d/msgid/ptgui/c6098a21-a72f-412f-

> b410-294b91abfa3en%40googlegroups.com <https://
> groups.google.com/d/msgid/ptgui/c6098a21-a72f-412f-
> b410-294b91abfa3en%40googlegroups.com?

> utm_medium=email&utm_source=footer>.
>
> --
> You received this message because you are subscribed to the Google
> Groups "PTGui Support" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to ptgui+un...@googlegroups.com
> <mailto:ptgui+un...@googlegroups.com>.
> To view this discussion on the web visit https://groups.google.com/d/

> msgid/ptgui/a3d34e21-64c0-4056-b386-7ac96bb9c0adn%40googlegroups.com
> <https://groups.google.com/d/msgid/ptgui/a3d34e21-64c0-4056-
> b386-7ac96bb9c0adn%40googlegroups.com?utm_medium=email&utm_source=footer>.