How to save images larger than 4GB size

3,082 views
Skip to first unread message

Emad ud din Bhatt

unread,
Nov 15, 2011, 7:50:38 AM11/15/11
to hugi...@googlegroups.com
 I am trying to create a gigapixel file which is larger than 4GB size. how can i do it in windows?



Frederic Da Vitoria

unread,
Nov 15, 2011, 8:51:22 AM11/15/11
to hugi...@googlegroups.com
2011/11/15, Emad ud din Bhatt <xyz...@gmail.com>:

> I am trying to create a gigapixel file which is larger than 4GB size. how
> can i do it in windows?

Which version of Windows? What type of partition do you want to write
your file to (FAT32 or NTFS)?

--
Frederic Da Vitoria
(davitof)

Membre de l'April - « promouvoir et défendre le logiciel libre » -
http://www.april.org

Gnome Nomad

unread,
Nov 15, 2011, 2:13:02 PM11/15/11
to hugi...@googlegroups.com
Emad ud din Bhatt wrote:
> I am trying to create a gigapixel file which is larger than 4GB size.
> how can i do it in windows?

Don't know Windows that well, but I believe the Windows NTFS disk format
supports files larger than that. Note: by default, Windows formats
external drives with FAT32, which can't handle files that large.

Now the question becomes, what image file format supports 4GB+ file sizes?

--
Gnome Nomad
gnome...@gmail.com
wandering the landscape of god
http://www.cafepress.com/otherend/

Karmadillo

unread,
Nov 15, 2011, 7:20:59 PM11/15/11
to hugin and other free panoramic software
TIFF file format will not support images larger than 4GB
Note that intermediate files are also subject to this limit so you may
find it hard to produce TIFF outputs above 3GB. The largest file size
I obtained was 3.4GB but the image was badly messed up and unusable. I
ended up settling for a 2.8GB version of this project as the highest
resolution.

So, I recommend that you try other file formats.

Another consideration is that you will need a lot of RAM to stitch
panoramas larger than 4GB. 64 bit windows will be necessary to get
above the 3.5GB RAM limitation.
However if you do choose 64 bit windows and plan to create HDR images,
be aware that EXR file format is broken on windows 64bit, leaving you
with no options to create HDR images larger than 4GB. This translates
into about 1.5GB max size image once it is tonemapped.
This is why I am moving to a Linux 64 bit platform (not quite there
yet).

On Nov 16, 5:13 am, Gnome Nomad <gnomeno...@gmail.com> wrote:
> Emad ud din Bhatt wrote:
>
> >  I am trying to create a gigapixel file which is larger than 4GB size.
> > how can i do it in windows?
>
> Don't know Windows that well, but I believe the Windows NTFS disk format
> supports files larger than that. Note: by default, Windows formats
> external drives with FAT32, which can't handle files that large.
>
> Now the question becomes, what image file format supports 4GB+ file sizes?
>
> --
> Gnome Nomad
> gnomeno...@gmail.com
> wandering the landscape of godhttp://www.cafepress.com/otherend/

Carlos Eduardo G. Carvalho (Cartola)

unread,
Nov 15, 2011, 7:29:17 PM11/15/11
to hugi...@googlegroups.com
I never did a gigapan. In fact the largest I have done was 15000x7500 what gives about 112megapixels I guess. I already think its very hard to post edit this picture, so I thought that when you do a giga you already do it into tiles, don`t you? And surely with a very well calibrated mechanism not to have to post edit it. Any hints about it? Can hugin do a gigapan?

Cheers,

Carlos E G Carvalho (Cartola)
http://cartola.org/360



2011/11/15 Karmadillo <directri...@gmail.com>
--
You received this message because you are subscribed to the Google Groups "Hugin and other free panoramic software" group.
A list of frequently asked questions is available at: http://wiki.panotools.org/Hugin_FAQ
To post to this group, send email to hugi...@googlegroups.com
To unsubscribe from this group, send email to hugin-ptx+...@googlegroups.com
For more options, visit this group at http://groups.google.com/group/hugin-ptx

Emad ud din Bhatt

unread,
Nov 16, 2011, 1:47:47 AM11/16/11
to hugi...@googlegroups.com
NTFS and FAT32 are not problems. Problem is with TIFF file limitations of 4GB size. 

I am not able to gigapixel images with hugin. But I have an innovative idea of doing it with hugin. Idea is all about tiles and than making a Mosaic.

1.If we are able to get gigapixel image rendered by hugin in Tiles.

Lets say hugin renders a gigapixel image in 8000x4000 tiles TIFF parts. 

I have a 89361 x 22554 file and hugin splits image into small tiles and stitches it in 8kx4k tiles.  

2. Convert TIFF tiles to jpg with GIMP or any other software.

3. A script to make a mosaic from these tiles. I hope hugin can do that. 

So it can be a feature request?

Well Autopanogiga provides .kro or krpano raw formats. These formats are than splitted into smaller tiles and after conversion they are joined back. So if this is solution than why not stitching software does it at stitching time. It will be a trend setting feature by Huginers:)

Regards,

Emaad
--


Emaad
www.flickr.com/emaad

Bruno Postle

unread,
Nov 16, 2011, 4:00:32 PM11/16/11
to Hugin ptx
On Wed 16-Nov-2011 at 11:47 +0500, Emad ud din Bhatt wrote:
>
> I am not able to gigapixel images with hugin. But I have an
> innovative idea of doing it with hugin. Idea is all about tiles
> and than making a Mosaic.
>
> 1.If we are able to get gigapixel image rendered by hugin in
> Tiles.
>
> Lets say hugin renders a gigapixel image in 8000x4000 tiles TIFF
> parts.
>
> I have a 89361 x 22554 file and hugin splits image into small
> tiles and stitches it in 8kx4k tiles.

Panotools::Script has a tool called gigatile that does exactly this.
It mostly works and scales very well, you can stitch unlimited size
panoramas on a low memory machine. It doesn't join the tiles
together so you need to use something like Google maps to present
it.

The major (and unfixable) drawback is that you can see some of the
edges between tiles because of the way enblend works.

"gigatile - stitch a Hugin project as multi-resolution tiles

gigatile -o project.pto.mk -p prefix project.pto

Options:
-o | --output name Filename of created Makefile.
-p | --prefix prefix for output files, can be a directory name.
--apikey a Google Maps API key (required to use online).
-h | --help Outputs help documentation.

gigatile is a tool with the same CLI as pto2mk. Instead of
creating rules for stitching a single panorama, the project
is split into 4096x4096 tiles which are rendered
independently, these tiles are then split to a pyramid of
256x256 JPEG tiles."

The zoomable results of my only test with this tool (a gigapixel of
Sheffield) are linked from here:
http://www.flickr.com/photos/36383814@N00/5510783736/

--
Bruno

Emad ud din Bhatt

unread,
Nov 17, 2011, 12:18:25 AM11/17/11
to hugi...@googlegroups.com
Thanks a lot Bruno. 

As per online search , at the moment gigapixel images are created this way

1. Capturing
2. stitching and making a PSB file or APG raw file format
3. Split into tiles
4. convert and merge back to one single file
5. Viewer again splits it into tiles as per user zoomed in area.

Tiles > one image> tiles.....:)) Look there is repetition of work which in unnecesary hardwork and requires lots of resources. 

But why not this workflow

1. Capturing
2. Stitching into tiles
3. Viewer does not have to split it into tiles. Images are already in tiles. 

This way we can make gigapixel images even on an normal C2D system. 

Bruno, I will try it.

Regards,

Emaad


--
You received this message because you are subscribed to the Google Groups "Hugin and other free panoramic software" group.
A list of frequently asked questions is available at: http://wiki.panotools.org/Hugin_FAQ
To post to this group, send email to hugi...@googlegroups.com
To unsubscribe from this group, send email to hugin-ptx+...@googlegroups.com
For more options, visit this group at http://groups.google.com/group/hugin-ptx



--


Emaad
www.flickr.com/emaad

kfj

unread,
Nov 17, 2011, 12:35:01 PM11/17/11
to hugin and other free panoramic software
On 15 Nov., 13:50, Emad ud din Bhatt <xyzt...@gmail.com> wrote:
>  I am trying to create a gigapixel file which is larger than 4GB size. how
> can i do it in windows?

Maybe VIPS an help you:

http://www.vips.ecs.soton.ac.uk/index.php?title=VIPS

Kay

Emad ud din Bhatt

unread,
Nov 18, 2011, 5:09:31 AM11/18/11
to hugi...@googlegroups.com
Bruno, how can i use gigatile? I am on windows and never tried any panotool script from command line. Please! Help me

Kay, Nips gui download is missing on website. Can you please send it.
--


Emaad
www.flickr.com/emaad

Bruno Postle

unread,
Nov 18, 2011, 5:20:45 PM11/18/11
to Hugin ptx
On Fri 18-Nov-2011 at 15:09 +0500, Emad ud din Bhatt wrote:
>Bruno, how can i use gigatile? I am on windows and never tried any panotool
>script from command line. Please! Help me

Sorry, I did a long time ago create Windows .exe versions of the
tools in Panotools::Script, but I'm not even sure how to do this
now since I don't have access to a suitable Windows computer.

--
Bruno

Emad ud din Bhatt

unread,
Nov 18, 2011, 11:54:23 PM11/18/11
to hugi...@googlegroups.com
oh!! Any tutorial that it can be used in windows using command line.





--
Bruno

--
You received this message because you are subscribed to the Google Groups "Hugin and other free panoramic software" group.
A list of frequently asked questions is available at: http://wiki.panotools.org/Hugin_FAQ
To post to this group, send email to hugi...@googlegroups.com
To unsubscribe from this group, send email to hugin-ptx+...@googlegroups.com
For more options, visit this group at http://groups.google.com/group/hugin-ptx



--


Emaad
www.flickr.com/emaad

kfj

unread,
Nov 19, 2011, 4:14:45 AM11/19/11
to hugin and other free panoramic software

On 18 Nov., 11:09, Emad ud din Bhatt <xyzt...@gmail.com> wrote:
>
> Kay, Nips gui download is missing on website. Can you please send it.

Have you tried at

http://www.vips.ecs.soton.ac.uk/supported/current/win32/

That's all I know. I downloaded the lates zip file

http://www.vips.ecs.soton.ac.uk/supported/current/win32/nip2-7.26.3.zip

- it has the installer inside. Directly downloading the installers
didn't work here. But I don't know if it works, since I'm on Linux.
Best of luck!

Kay

Carlos Eduardo G. Carvalho (Cartola)

unread,
Nov 19, 2011, 7:40:10 AM11/19/11
to hugi...@googlegroups.com
Hi Emad,

I have it ready to use on windows. It's necessary to have a working perl environment and it takes some time to compile the Panotools::Script and its dependencies. I have a version working as a portable software on windows and I can put it on a link for you to download. I have used the perl portable strawberry version and it already has every Panotools::Script working.

You need to download it, uncompress and you might want to put the path perl-5.12.2.0-portable-strawberry\perl\bin on your PATH environment variable. To do this maybe it will depend on your version of windows, Im not sure. Usually on winXP I open the "Properties" on "My Computer" icon on the desktop or on "my computer" at any windows explorer window. Then you have the "Advanced" tab where you can find a "Environment variables" button. There you can edit your PATH variable adding the complete path of where you uncompressed that. Don't erease whatever is already on that variable, just add the complete additional path, like c:\your\path\where\you\uncompressed\the\package\perl-5.12.2.0-portable-strawberry\perl\bin

Then you will be able to execute gigatile and all other scripts on any cmd window from any path where you are.

Here is the link for you to download it. Let me know when you get it so I can erase it.

http://www.cartola.org/perl+panotools.zip

Here a list of all the tools present in the package and its documentations:

http://search.cpan.org/dist/Panotools-Script/

In fact I have a whole group of portable tools to make many panorama steps on windows in my pen-drive:
- DevalVR player
- PanoPro player (that is a specific version of DevalVR)
- Panini 0.71.100
- SaladoConverter
- XnView
- enblend+enfuse
- hugin
- Panotool::Scripts
- ImageMagick
- GIMP

Those are all easy to get already as portable versions from their own sites, if I am not mistaken.


Cheers,

Carlos E G Carvalho (Cartola)
http://cartola.org/360



2011/11/18 Emad ud din Bhatt <xyz...@gmail.com>

Emad ud din Bhatt

unread,
Nov 19, 2011, 12:10:47 PM11/19/11
to hugi...@googlegroups.com
Many thanks Carlos Eduardo G. Carvalho for your support. i am on XP and I am familiar with adding environment variables. I will be able to test it by Monday as I am away from PC. Please! Keep files online till monday. 

Thanks again for your support.

Carlos Eduardo G. Carvalho (Cartola)

unread,
Nov 19, 2011, 6:27:07 PM11/19/11
to hugi...@googlegroups.com
No problem, just let me know when you download it or I will probably forget it there :)


Cheers,

Carlos E G Carvalho (Cartola)
http://cartola.org/360



2011/11/19 Emad ud din Bhatt <xyz...@gmail.com>

Emad ud din Bhatt

unread,
Nov 22, 2011, 7:36:16 AM11/22/11
to hugi...@googlegroups.com, Bruno Postle
Bruno, I have tried to use gigatile but it is generating errors.

Use of unintialized value in split at gigatile line83
use of uninitialized value in numeric lt <<> at gigatile line84
use of uninitialized value in numeric gt <<> at gigatile line84  

I ran gigatile from bin folder. I made a sample pto file and saved it in same bin folder. pto and mk files are under same bin folder where gigatile file is located. I am not good at using scripts but gigatile.bat is running fine. As it gives what options to use :) Error can be due to my poor knowledge about using scripts.

Looking for your help.

thanks

Emaad
IMG00802-20111122-0717.jpg
IMG00803-20111122-0718.jpg

Erik Krause

unread,
Nov 22, 2011, 3:30:32 PM11/22/11
to hugi...@googlegroups.com
Am 16.11.2011 22:00, schrieb Bruno Postle:
> The major (and unfixable) drawback is that you can see some of the
> edges between tiles because of the way enblend works.

Slicer by Bernhard Vogl <http://dativ.at/slicer/index.html> allows for
overscan - an area on the right and left side of each slice which must
be cut away prior to final assembly or display. This area should help to
minimize blending errors.

--
Erik Krause
http://www.erik-krause.de

Bruno Postle

unread,
Nov 22, 2011, 5:43:07 PM11/22/11
to Hugin ptx
On Tue 22-Nov-2011 at 17:36 +0500, Emad ud din Bhatt wrote:
>Bruno, I have tried to use gigatile but it is generating errors.
>
>Use of unintialized value in split at gigatile line83
>use of uninitialized value in numeric lt <<> at gigatile line84
>use of uninitialized value in numeric gt <<> at gigatile line84

It looks like gigatile assumes everyone has a partial panorama, which
would be a bug.

But this is just a warning - The tool should continue and do the
right thing anyway. Does gigatile crash or does it create the .mk
Makefile?

--
Bruno

Emad ud din Bhatt

unread,
Nov 23, 2011, 5:26:59 AM11/23/11
to hugi...@googlegroups.com
Thanks a lot Erik, I have downloaded it and will check it.

Bruno, Yes It created new pto and mk file. I opened new pto file and clicked on stitch. But it created just one single tile 4096x4096. 

 Thanks Erik and Bruno for your support. I feel like I am near to solution...






--
Bruno

--
You received this message because you are subscribed to the Google Groups "Hugin and other free panoramic software" group.
A list of frequently asked questions is available at: http://wiki.panotools.org/Hugin_FAQ
To post to this group, send email to hugi...@googlegroups.com
To unsubscribe from this group, send email to hugin-ptx+...@googlegroups.com
For more options, visit this group at http://groups.google.com/group/hugin-ptx



--


Emaad
www.flickr.com/emaad

Carlos Eduardo G. Carvalho (Cartola)

unread,
Nov 23, 2011, 6:54:35 AM11/23/11
to hugi...@googlegroups.com
Try to create the remmaped images or use nona on the command line, like:

nona -o output your_file.pto

where output would be the prefix of the output files and your_file.pto is the generated pto.


Cheers,

Carlos E G Carvalho (Cartola)
http://cartola.org/360



2011/11/23 Emad ud din Bhatt <xyz...@gmail.com>

Bruno Postle

unread,
Nov 23, 2011, 3:44:43 PM11/23/11
to Hugin ptx
On Wed 23-Nov-2011 at 15:26 +0500, Emad ud din Bhatt wrote:
>Thanks a lot Erik, I have downloaded it and will check it.
>
>Bruno, Yes It created new pto and mk file. I opened new pto file and
>clicked on stitch. But it created just one single tile 4096x4096.

gigatile creates a Makefile, which then needs to be processed on the
command-line.

So you create the Makefile with gigatile:

gigatile -o project.pto.mk -p prefix project.pto

..and process it with the 'make' tool like so (there should be a
copy of make.exe in the Hugin/bin folder):

make -f project.pto.mk

--
Bruno

Emad ud din Bhatt

unread,
Nov 24, 2011, 8:35:59 AM11/24/11
to hugi...@googlegroups.com

No I did not processed .mk file from command prompt. I used new pto file and it generated one tile. 

I have just now tried it from command line as you told me but result is same "one image file updated". I did all this:

1. I selected one pto file (made by hugin) and saved it to perl bin folder. 
2. I used gigatile -o project.pto.mk -p prefix project.pto command.
3. New pto file with name prefix.pto and prefix.pto.mk were made. 
4. Used hugin to stitch with new pto file........it generated one tile
5. Used command line   make -f project.pto.mk and it created one single file.

Am I doing something wrong?








--
Bruno

--
You received this message because you are subscribed to the Google Groups "Hugin and other free panoramic software" group.
A list of frequently asked questions is available at: http://wiki.panotools.org/Hugin_FAQ
To post to this group, send email to hugi...@googlegroups.com
To unsubscribe from this group, send email to hugin-ptx+...@googlegroups.com
For more options, visit this group at http://groups.google.com/group/hugin-ptx



--


Emaad
www.flickr.com/emaad

Emad ud din Bhatt

unread,
Nov 24, 2011, 8:41:19 AM11/24/11
to hugi...@googlegroups.com
One correction

5. Used command line make -f prefix.pto.mk and it created one single file
--


Emaad
www.flickr.com/emaad

Bruno Postle

unread,
Nov 25, 2011, 7:56:47 PM11/25/11
to Hugin ptx
On Thu 24-Nov-2011 at 18:35 +0500, Emad ud din Bhatt wrote:
>>
>> No I did not processed .mk file from command prompt. I used new pto file
>and it generated one tile.
>
>I have just now tried it from command line as you told me but result is
>same "one image file updated". I did all this:
>
>1. I selected one pto file (made by hugin) and saved it to perl bin folder.
>2. I used gigatile -o project.pto.mk -p prefix project.pto command.
>3. New pto file with name prefix.pto and prefix.pto.mk were made.
>4. Used hugin to stitch with new pto file........it generated one tile
>5. Used command line make -f project.pto.mk and it created one single
>file.

This is caused by the same bug that generates the warnings: Hugin
doesn't write a 'p'-line 'S' parameter if the crop rectangle is the
same as the image canvas, this wasn't expected.

You can fix gigatile, find the line that looks like this:

$pto->Read ($path_input);

..and insert this code directly after:

$pto->{panorama}->{S} = join (',', 0, $pto->{panorama}->{w}, 0, $pto->{panorama}->{h}) unless defined $pto->{panorama}->{S};

--
Bruno

Emad ud din Bhatt

unread,
Nov 27, 2011, 3:18:27 PM11/27/11
to hugi...@googlegroups.com
Thanks a lot Bruno. It works now. It splitted PTO file into 15 small pto files. Now I can generate tiles from these pto files using hugin or command prompt. 

Thanks again for your help.

Regards,

Emaad





--
Bruno

--
You received this message because you are subscribed to the Google Groups "Hugin and other free panoramic software" group.
A list of frequently asked questions is available at: http://wiki.panotools.org/Hugin_FAQ
To post to this group, send email to hugi...@googlegroups.com
To unsubscribe from this group, send email to hugin-ptx+...@googlegroups.com
For more options, visit this group at http://groups.google.com/group/hugin-ptx



--


Emaad
www.flickr.com/emaad

Karmadillo

unread,
Dec 4, 2011, 7:31:07 PM12/4/11
to hugin and other free panoramic software
If enblend was ported to VIPS it would be fantastic. VIPS architecture
is based around tiles or windows within very large images. This is
similar to the way enblend works currently - assembling numerous
images into a much larger image.
Plus VIPS is supposedly faster, lighter on memory, and uses multiple
cores better than most other architectures.
These are areas of weakness for enblend.
Reply all
Reply to author
Forward
0 new messages