DEMzip: compress ASC, TIF, BIL, IMG, ... into RasterLAZ
859 views
Skip to first unread message
Martin Isenburg
Jul 8, 2019, 2:39:01 PM7/8/19
to LAStools - efficient command line tools for LIDAR processing
Hello,
when Fugro searched for MH370 a user of LAStools at Geoscience Australia was testing which elevation raster format would be most compressed to upload the seafloor rasters produced on the survey vessels over a satellite link. He pointed out to me that in his experiments, LAZ was the most compressed way to store typical elevation rasters in comparison with TIF. ASC. gzipped ASC, BIL, gzipped BIL, IMG, etc.
I am now planning to release DEMzip - a compressor for elevation grids, GEOIDs and similar non-picture image rasters. This will turn TIF. BIL, IMG, and ASC into more compact RasterLAZ files. I'd like to find some people who can test the first demzip.exe and give me useful feedback.
Advantages of storing elevation grids and rasters as RasterLAZ:
(1) highest compression as far as I can tell
(2) directly feed into existing LAZ processing pipelines
(3) raster and points are merging anyways (photogrammetic DSMs)
(4) elevation values with fixed-point resolution, not in floating-point
(5) any (!!!) reasonable raster order is supported
(6) spatial indexing is readily supported
(7) entire range can be used. "nodata" rasters are simply omitted
(8) optional fast coverage decompression (coded separately for LAS 1.4)
(9) storage of additional (LAS-like) attributes supported
(10) display rasters mixed with points via Potree and/or Entwine / Greyhound
Once there is a RasterLAZ driver for GDAL this format could also become interesting for direct exploitation in raster processing packages.
A RasterLAZ file is a LAZ file with an extra VLR that stores the raster relevant extra information such as ncols, nrows, stepx resolution, stepy resolution, ...
Below two examples for DTM rasters in ASC and Geoid grids in TIF
============================
DTM raster: ASC -> RasterLAZ
============================
I've downloaded this ZIP file from the link above. It contains 25 DTMs with 50cm resolution from Englands Open LiDAR portal.
07/07/2019 02:08 PM 162,454,741 LIDAR-DTM-50CM-TQ37ne.zip
I then compressed the 25 ASC files while also adding the missing EPSG code 27700. The individual 25 files go from 631,601,776 bytes uncompressed ASC down to 50,030,353 bytes as RasterLAZ.A decrease of 92% in size. Also compared to the (not directly usable) zipped archive of 162,454,741 bytes the total file size decreases by nearly 70% in size. At a national scale those are *significant* savings in terms of storage, backup, and transmission bandwidth.
>> demzip -i *.asc -olaz -epsg 27700
done with 'tq3575_DTM_50CM.laz'. total time 8.238 sec.
done with 'tq3576_DTM_50CM.laz'. total time 8.274 sec.
done with 'tq3577_DTM_50CM.laz'. total time 7.784 sec.
done with 'tq3578_DTM_50CM.laz'. total time 7.771 sec.
done with 'tq3579_DTM_50CM.laz'. total time 7.761 sec.
done with 'tq3675_DTM_50CM.laz'. total time 8.662 sec.
done with 'tq3676_DTM_50CM.laz'. total time 8.596 sec.
done with 'tq3677_DTM_50CM.laz'. total time 7.731 sec.
done with 'tq3678_DTM_50CM.laz'. total time 7.707 sec.
done with 'tq3679_DTM_50CM.laz'. total time 7.722 sec.
done with 'tq3775_DTM_50CM.laz'. total time 8.54 sec.
done with 'tq3776_DTM_50CM.laz'. total time 8.085 sec.
done with 'tq3777_DTM_50CM.laz'. total time 7.841 sec.
done with 'tq3778_DTM_50CM.laz'. total time 7.799 sec.
done with 'tq3779_DTM_50CM.laz'. total time 7.691 sec.
done with 'tq3875_DTM_50CM.laz'. total time 8.489 sec.
done with 'tq3876_DTM_50CM.laz'. total time 8.637 sec.
done with 'tq3877_DTM_50CM.laz'. total time 8.292 sec.
done with 'tq3878_DTM_50CM.laz'. total time 7.77 sec.
done with 'tq3879_DTM_50CM.laz'. total time 8.312 sec.
done with 'tq3975_DTM_50CM.laz'. total time 9.256 sec.
done with 'tq3976_DTM_50CM.laz'. total time 8.766 sec.
done with 'tq3977_DTM_50CM.laz'. total time 8.689 sec.
done with 'tq3978_DTM_50CM.laz'. total time 7.785 sec.
done with 'tq3979_DTM_50CM.laz'. total time 7.722 sec.
done with all files. total time for 25 files 203.927 sec.
done with 'tq3575_DTM_50CM.laz'. total time 8.238 sec.
done with 'tq3576_DTM_50CM.laz'. total time 8.274 sec.
done with 'tq3577_DTM_50CM.laz'. total time 7.784 sec.
done with 'tq3578_DTM_50CM.laz'. total time 7.771 sec.
done with 'tq3579_DTM_50CM.laz'. total time 7.761 sec.
done with 'tq3675_DTM_50CM.laz'. total time 8.662 sec.
done with 'tq3676_DTM_50CM.laz'. total time 8.596 sec.
done with 'tq3677_DTM_50CM.laz'. total time 7.731 sec.
done with 'tq3678_DTM_50CM.laz'. total time 7.707 sec.
done with 'tq3679_DTM_50CM.laz'. total time 7.722 sec.
done with 'tq3775_DTM_50CM.laz'. total time 8.54 sec.
done with 'tq3776_DTM_50CM.laz'. total time 8.085 sec.
done with 'tq3777_DTM_50CM.laz'. total time 7.841 sec.
done with 'tq3778_DTM_50CM.laz'. total time 7.799 sec.
done with 'tq3779_DTM_50CM.laz'. total time 7.691 sec.
done with 'tq3875_DTM_50CM.laz'. total time 8.489 sec.
done with 'tq3876_DTM_50CM.laz'. total time 8.637 sec.
done with 'tq3877_DTM_50CM.laz'. total time 8.292 sec.
done with 'tq3878_DTM_50CM.laz'. total time 7.77 sec.
done with 'tq3879_DTM_50CM.laz'. total time 8.312 sec.
done with 'tq3975_DTM_50CM.laz'. total time 9.256 sec.
done with 'tq3976_DTM_50CM.laz'. total time 8.766 sec.
done with 'tq3977_DTM_50CM.laz'. total time 8.689 sec.
done with 'tq3978_DTM_50CM.laz'. total time 7.785 sec.
done with 'tq3979_DTM_50CM.laz'. total time 7.722 sec.
done with all files. total time for 25 files 203.927 sec.
>> lasinfo -i tq3575_DTM_50CM.laz
lasinfo (190706) report for 'tq3575_DTM_50CM.laz'
reporting all LAS header entries:
file signature: 'LASF'
file source ID: 0
global_encoding: 0
project ID GUID data 1-4: 00000000-0000-0000-0000-000000000000
version major.minor: 1.2
system identifier: 'raster compressed as LAZ points'
generating software: 'LAStools (c) by rapidlasso GmbH'
file creation day/year: 0/0
header size: 227
offset to point data: 455
number var. length records: 2
point data format: 0
point data record length: 20
number of point records: 4000000
number of points by return: 4000000 0 0 0 0
scale factor x y z: 0.25 0.25 0.01
offset x y z: 500000 100000 0
min x y z: 535000.00 175000.00 16.39
max x y z: 536000.00 176000.00 64.38
variable length header record 1 of 2:
reserved 0
user ID 'Raster LAZ'
record ID 7113
length after header 80
description 'by LAStools of rapidlasso GmbH'
ncols 2000
nrows 2000
llx 535000
lly 175000
stepx 0.5
stepy 0.5
sigmaxy <not set>
variable length header record 2 of 2:
reserved 0
user ID 'LASF_Projection'
record ID 34735
length after header 40
description 'by LAStools of rapidlasso GmbH'
GeoKeyDirectoryTag version 1.1.0 number of keys 4
key 1024 tiff_tag_location 0 count 1 value_offset 1 - GTModelTypeGeoKey: ModelTypeProjected
key 3072 tiff_tag_location 0 count 1 value_offset 27700 - ProjectedCSTypeGeoKey: OSGB 1936 / British National Grid
key 3076 tiff_tag_location 0 count 1 value_offset 9001 - ProjLinearUnitsGeoKey: Linear_Meter
key 4099 tiff_tag_location 0 count 1 value_offset 9001 - VerticalUnitsGeoKey: Linear_Meter
LASzip compression (version 3.4r1 c2 50000): POINT10 2
reporting minimum and maximum for all LAS point record entries ...
X 140001 143999
Y 300001 303999
Z 1639 6438
intensity 0 0
return_number 1 1
number_of_returns 1 1
edge_of_flight_line 0 0
scan_direction_flag 0 0
classification 0 0
scan_angle_rank 0 0
user_data 0 0
point_source_ID 0 0
number of first returns: 4000000
number of intermediate returns: 0
number of last returns: 4000000
number of single returns: 4000000
overview over number of returns of given pulse: 4000000 0 0 0 0 0 0
histogram of classification of points:
4000000 never classified (0)
lasinfo (190706) report for 'tq3575_DTM_50CM.laz'
reporting all LAS header entries:
file signature: 'LASF'
file source ID: 0
global_encoding: 0
project ID GUID data 1-4: 00000000-0000-0000-0000-000000000000
version major.minor: 1.2
system identifier: 'raster compressed as LAZ points'
generating software: 'LAStools (c) by rapidlasso GmbH'
file creation day/year: 0/0
header size: 227
offset to point data: 455
number var. length records: 2
point data format: 0
point data record length: 20
number of point records: 4000000
number of points by return: 4000000 0 0 0 0
scale factor x y z: 0.25 0.25 0.01
offset x y z: 500000 100000 0
min x y z: 535000.00 175000.00 16.39
max x y z: 536000.00 176000.00 64.38
variable length header record 1 of 2:
reserved 0
user ID 'Raster LAZ'
record ID 7113
length after header 80
description 'by LAStools of rapidlasso GmbH'
ncols 2000
nrows 2000
llx 535000
lly 175000
stepx 0.5
stepy 0.5
sigmaxy <not set>
variable length header record 2 of 2:
reserved 0
user ID 'LASF_Projection'
record ID 34735
length after header 40
description 'by LAStools of rapidlasso GmbH'
GeoKeyDirectoryTag version 1.1.0 number of keys 4
key 1024 tiff_tag_location 0 count 1 value_offset 1 - GTModelTypeGeoKey: ModelTypeProjected
key 3072 tiff_tag_location 0 count 1 value_offset 27700 - ProjectedCSTypeGeoKey: OSGB 1936 / British National Grid
key 3076 tiff_tag_location 0 count 1 value_offset 9001 - ProjLinearUnitsGeoKey: Linear_Meter
key 4099 tiff_tag_location 0 count 1 value_offset 9001 - VerticalUnitsGeoKey: Linear_Meter
LASzip compression (version 3.4r1 c2 50000): POINT10 2
reporting minimum and maximum for all LAS point record entries ...
X 140001 143999
Y 300001 303999
Z 1639 6438
intensity 0 0
return_number 1 1
number_of_returns 1 1
edge_of_flight_line 0 0
scan_direction_flag 0 0
classification 0 0
scan_angle_rank 0 0
user_data 0 0
point_source_ID 0 0
number of first returns: 4000000
number of intermediate returns: 0
number of last returns: 4000000
number of single returns: 4000000
overview over number of returns of given pulse: 4000000 0 0 0 0 0 0
histogram of classification of points:
4000000 never classified (0)
ASC
07/07/2019 09:43 PM 24,794,485 tq3575_DTM_50CM.asc
07/07/2019 09:43 PM 25,560,233 tq3576_DTM_50CM.asc
07/07/2019 09:43 PM 23,732,074 tq3577_DTM_50CM.asc
07/07/2019 09:43 PM 23,795,594 tq3578_DTM_50CM.asc
07/08/2019 10:57 AM 23,749,362 tq3579_DTM_50CM.asc
07/07/2019 09:43 PM 27,911,259 tq3675_DTM_50CM.asc
07/07/2019 09:43 PM 27,496,804 tq3676_DTM_50CM.asc
07/07/2019 09:43 PM 23,879,579 tq3677_DTM_50CM.asc
07/07/2019 09:43 PM 23,761,068 tq3678_DTM_50CM.asc
07/07/2019 09:43 PM 23,738,069 tq3679_DTM_50CM.asc
07/07/2019 09:43 PM 27,388,247 tq3775_DTM_50CM.asc
07/07/2019 09:43 PM 25,415,208 tq3776_DTM_50CM.asc
07/07/2019 09:43 PM 24,026,165 tq3777_DTM_50CM.asc
07/07/2019 09:43 PM 23,829,645 tq3778_DTM_50CM.asc
07/07/2019 09:43 PM 23,731,954 tq3779_DTM_50CM.asc
07/07/2019 09:43 PM 26,748,219 tq3875_DTM_50CM.asc
07/07/2019 09:43 PM 27,681,443 tq3876_DTM_50CM.asc
07/07/2019 09:43 PM 25,822,100 tq3877_DTM_50CM.asc
07/07/2019 09:43 PM 23,889,443 tq3878_DTM_50CM.asc
07/07/2019 09:43 PM 23,770,079 tq3879_DTM_50CM.asc
07/07/2019 09:43 PM 27,837,577 tq3975_DTM_50CM.asc
07/07/2019 09:43 PM 27,880,449 tq3976_DTM_50CM.asc
07/07/2019 09:43 PM 27,420,501 tq3977_DTM_50CM.asc
07/07/2019 09:43 PM 23,912,035 tq3978_DTM_50CM.asc
07/07/2019 09:43 PM 23,830,184 tq3979_DTM_50CM.asc
25 Datei(en), 631,601,776 Bytes
RasterLAZ
07/08/2019 01:59 PM 2,111,020 tq3575_DTM_50CM.laz
07/08/2019 01:59 PM 2,021,144 tq3576_DTM_50CM.laz
07/08/2019 01:59 PM 2,024,230 tq3577_DTM_50CM.laz
07/08/2019 01:59 PM 2,099,126 tq3578_DTM_50CM.laz
07/08/2019 01:59 PM 1,942,613 tq3579_DTM_50CM.laz
07/08/2019 01:59 PM 2,051,800 tq3675_DTM_50CM.laz
07/08/2019 01:59 PM 2,302,776 tq3676_DTM_50CM.laz
07/08/2019 02:00 PM 1,965,062 tq3677_DTM_50CM.laz
07/08/2019 02:00 PM 1,919,514 tq3678_DTM_50CM.laz
07/08/2019 02:00 PM 1,906,005 tq3679_DTM_50CM.laz
07/08/2019 02:00 PM 2,142,144 tq3775_DTM_50CM.laz
07/08/2019 02:00 PM 2,147,488 tq3776_DTM_50CM.laz
07/08/2019 02:00 PM 1,917,417 tq3777_DTM_50CM.laz
07/08/2019 02:00 PM 1,839,256 tq3778_DTM_50CM.laz
07/08/2019 02:00 PM 1,873,992 tq3779_DTM_50CM.laz
07/08/2019 02:01 PM 2,119,843 tq3875_DTM_50CM.laz
07/08/2019 02:01 PM 2,150,978 tq3876_DTM_50CM.laz
07/08/2019 02:01 PM 2,059,777 tq3877_DTM_50CM.laz
07/08/2019 02:01 PM 2,036,149 tq3878_DTM_50CM.laz
07/08/2019 02:01 PM 1,829,444 tq3879_DTM_50CM.laz
07/08/2019 02:01 PM 1,980,088 tq3975_DTM_50CM.laz
07/08/2019 02:01 PM 1,813,433 tq3976_DTM_50CM.laz
07/08/2019 02:02 PM 2,081,793 tq3977_DTM_50CM.laz
07/08/2019 02:02 PM 1,885,422 tq3978_DTM_50CM.laz
07/08/2019 02:02 PM 1,809,839 tq3979_DTM_50CM.laz
25 Datei(en), 50,030,353 Bytes
07/07/2019 09:43 PM 25,560,233 tq3576_DTM_50CM.asc
07/07/2019 09:43 PM 23,732,074 tq3577_DTM_50CM.asc
07/07/2019 09:43 PM 23,795,594 tq3578_DTM_50CM.asc
07/08/2019 10:57 AM 23,749,362 tq3579_DTM_50CM.asc
07/07/2019 09:43 PM 27,911,259 tq3675_DTM_50CM.asc
07/07/2019 09:43 PM 27,496,804 tq3676_DTM_50CM.asc
07/07/2019 09:43 PM 23,879,579 tq3677_DTM_50CM.asc
07/07/2019 09:43 PM 23,761,068 tq3678_DTM_50CM.asc
07/07/2019 09:43 PM 23,738,069 tq3679_DTM_50CM.asc
07/07/2019 09:43 PM 27,388,247 tq3775_DTM_50CM.asc
07/07/2019 09:43 PM 25,415,208 tq3776_DTM_50CM.asc
07/07/2019 09:43 PM 24,026,165 tq3777_DTM_50CM.asc
07/07/2019 09:43 PM 23,829,645 tq3778_DTM_50CM.asc
07/07/2019 09:43 PM 23,731,954 tq3779_DTM_50CM.asc
07/07/2019 09:43 PM 26,748,219 tq3875_DTM_50CM.asc
07/07/2019 09:43 PM 27,681,443 tq3876_DTM_50CM.asc
07/07/2019 09:43 PM 25,822,100 tq3877_DTM_50CM.asc
07/07/2019 09:43 PM 23,889,443 tq3878_DTM_50CM.asc
07/07/2019 09:43 PM 23,770,079 tq3879_DTM_50CM.asc
07/07/2019 09:43 PM 27,837,577 tq3975_DTM_50CM.asc
07/07/2019 09:43 PM 27,880,449 tq3976_DTM_50CM.asc
07/07/2019 09:43 PM 27,420,501 tq3977_DTM_50CM.asc
07/07/2019 09:43 PM 23,912,035 tq3978_DTM_50CM.asc
07/07/2019 09:43 PM 23,830,184 tq3979_DTM_50CM.asc
25 Datei(en), 631,601,776 Bytes
RasterLAZ
07/08/2019 01:59 PM 2,111,020 tq3575_DTM_50CM.laz
07/08/2019 01:59 PM 2,021,144 tq3576_DTM_50CM.laz
07/08/2019 01:59 PM 2,024,230 tq3577_DTM_50CM.laz
07/08/2019 01:59 PM 2,099,126 tq3578_DTM_50CM.laz
07/08/2019 01:59 PM 1,942,613 tq3579_DTM_50CM.laz
07/08/2019 01:59 PM 2,051,800 tq3675_DTM_50CM.laz
07/08/2019 01:59 PM 2,302,776 tq3676_DTM_50CM.laz
07/08/2019 02:00 PM 1,965,062 tq3677_DTM_50CM.laz
07/08/2019 02:00 PM 1,919,514 tq3678_DTM_50CM.laz
07/08/2019 02:00 PM 1,906,005 tq3679_DTM_50CM.laz
07/08/2019 02:00 PM 2,142,144 tq3775_DTM_50CM.laz
07/08/2019 02:00 PM 2,147,488 tq3776_DTM_50CM.laz
07/08/2019 02:00 PM 1,917,417 tq3777_DTM_50CM.laz
07/08/2019 02:00 PM 1,839,256 tq3778_DTM_50CM.laz
07/08/2019 02:00 PM 1,873,992 tq3779_DTM_50CM.laz
07/08/2019 02:01 PM 2,119,843 tq3875_DTM_50CM.laz
07/08/2019 02:01 PM 2,150,978 tq3876_DTM_50CM.laz
07/08/2019 02:01 PM 2,059,777 tq3877_DTM_50CM.laz
07/08/2019 02:01 PM 2,036,149 tq3878_DTM_50CM.laz
07/08/2019 02:01 PM 1,829,444 tq3879_DTM_50CM.laz
07/08/2019 02:01 PM 1,980,088 tq3975_DTM_50CM.laz
07/08/2019 02:01 PM 1,813,433 tq3976_DTM_50CM.laz
07/08/2019 02:02 PM 2,081,793 tq3977_DTM_50CM.laz
07/08/2019 02:02 PM 1,885,422 tq3978_DTM_50CM.laz
07/08/2019 02:02 PM 1,809,839 tq3979_DTM_50CM.laz
25 Datei(en), 50,030,353 Bytes
============================
geoid grids: TIF-> RasterLAZ
============================
Compressing 6 NAVD88 geoid files with demzip means going from
202,247,212 bytes in TIF down to 32,202,120 bytes in RasterLAZ, which corresponds to a decrease of 84% in file size.
>> demzip -i navd*.tif -longlat -nad83 -olaz
done with 'navd88-03.laz'. total time 4.061 sec.
done with 'navd88-06.laz'. total time 1.288 sec.
done with 'navd88-09.laz'. total time 4.987 sec.
done with 'navd88-12a.laz'. total time 4.938 sec.
done with 'navd88-12b.laz'. total time 4.906 sec.
done with 'navd88-99.laz'. total time 3.937 sec.
done with all files. total time for 6 files 24.117 sec.
TIF
done with 'navd88-03.laz'. total time 4.061 sec.
done with 'navd88-06.laz'. total time 1.288 sec.
done with 'navd88-09.laz'. total time 4.987 sec.
done with 'navd88-12a.laz'. total time 4.938 sec.
done with 'navd88-12b.laz'. total time 4.906 sec.
done with 'navd88-99.laz'. total time 3.937 sec.
done with all files. total time for 6 files 24.117 sec.
TIF
07/05/2019 10:28 AM 37,304,531 navd88-03.tif
07/05/2019 10:26 AM 15,033,645 navd88-06.tif
07/05/2019 10:28 AM 37,579,719 navd88-09.tif
07/05/2019 10:28 AM 38,237,925 navd88-12a.tif
07/05/2019 10:27 AM 38,238,057 navd88-12b.tif
07/05/2019 10:28 AM 35,853,335 navd88-99.tif
6 Datei(en), 202,247,212 Bytes
RasterLAZ
07/08/2019 08:21 PM 5,962,465 navd88-03.laz
07/08/2019 08:21 PM 1,942,043 navd88-06.laz
07/08/2019 08:21 PM 6,074,111 navd88-09.laz
07/08/2019 08:21 PM 6,132,612 navd88-12a.laz
07/08/2019 08:21 PM 6,132,653 navd88-12b.laz
07/08/2019 08:21 PM 5,958,236 navd88-99.laz
07/05/2019 10:26 AM 15,033,645 navd88-06.tif
07/05/2019 10:28 AM 37,579,719 navd88-09.tif
07/05/2019 10:28 AM 38,237,925 navd88-12a.tif
07/05/2019 10:27 AM 38,238,057 navd88-12b.tif
07/05/2019 10:28 AM 35,853,335 navd88-99.tif
6 Datei(en), 202,247,212 Bytes
RasterLAZ
07/08/2019 08:21 PM 5,962,465 navd88-03.laz
07/08/2019 08:21 PM 1,942,043 navd88-06.laz
07/08/2019 08:21 PM 6,074,111 navd88-09.laz
07/08/2019 08:21 PM 6,132,612 navd88-12a.laz
07/08/2019 08:21 PM 6,132,653 navd88-12b.laz
07/08/2019 08:21 PM 5,958,236 navd88-99.laz
6 Datei(en), 32,202,120 Bytes
>> lasinfo -i navd88-99.laz
lasinfo (190706) report for 'navd88-99.laz'
reporting all LAS header entries:
file signature: 'LASF'
file source ID: 0
global_encoding: 0
project ID GUID data 1-4: 00000000-0000-0000-0000-000000000000
version major.minor: 1.2
system identifier: 'raster compressed as LAZ points'
generating software: 'LAStools (c) by rapidlasso GmbH'
file creation day/year: 0/0
header size: 227
offset to point data: 447
number var. length records: 2
point data format: 0
point data record length: 20
number of point records: 13843203
number of points by return: 13843203 0 0 0 0
scale factor x y z: 0.008333333333333 0.008333333333333 0.01
offset x y z: 0 0 0
min x y z: 171.99166666666716 14.991666666666733 -70.88
max x y z: 300.00833333333418 72.008333333333653 28.10
variable length header record 1 of 2:
reserved 0
user ID 'Raster LAZ'
record ID 7113
length after header 80
description 'by LAStools of rapidlasso GmbH'
ncols 7681
nrows 3421
llx 171.992
lly 14.9917
stepx 0.0166667
stepy 0.0166667
sigmaxy <not set>
variable length header record 2 of 2:
reserved 0
user ID 'LASF_Projection'
record ID 34735
length after header 32
description 'by LAStools of rapidlasso GmbH'
GeoKeyDirectoryTag version 1.1.0 number of keys 3
key 1024 tiff_tag_location 0 count 1 value_offset 2 - GTModelTypeGeoKey: ModelTypeGeographic
key 2048 tiff_tag_location 0 count 1 value_offset 4269 - GeographicTypeGeoKey: GCS_NAD83
key 4099 tiff_tag_location 0 count 1 value_offset 9001 - VerticalUnitsGeoKey: Linear_Meter
LASzip compression (version 3.4r1 c2 50000): POINT10 2
reporting minimum and maximum for all LAS point record entries ...
X 20640 36000
Y 1800 8640
Z -7088 2810
intensity 0 0
return_number 1 1
number_of_returns 1 1
edge_of_flight_line 0 0
scan_direction_flag 0 0
classification 0 0
scan_angle_rank 0 0
user_data 0 0
point_source_ID 0 0
number of first returns: 13843203
number of intermediate returns: 0
number of last returns: 13843203
number of single returns: 13843203
overview over number of returns of given pulse: 13843203 0 0 0 0 0 0
histogram of classification of points:
13843203 never classified (0)
lasinfo (190706) report for 'navd88-99.laz'
reporting all LAS header entries:
file signature: 'LASF'
file source ID: 0
global_encoding: 0
project ID GUID data 1-4: 00000000-0000-0000-0000-000000000000
version major.minor: 1.2
system identifier: 'raster compressed as LAZ points'
generating software: 'LAStools (c) by rapidlasso GmbH'
file creation day/year: 0/0
header size: 227
offset to point data: 447
number var. length records: 2
point data format: 0
point data record length: 20
number of point records: 13843203
number of points by return: 13843203 0 0 0 0
scale factor x y z: 0.008333333333333 0.008333333333333 0.01
offset x y z: 0 0 0
min x y z: 171.99166666666716 14.991666666666733 -70.88
max x y z: 300.00833333333418 72.008333333333653 28.10
variable length header record 1 of 2:
reserved 0
user ID 'Raster LAZ'
record ID 7113
length after header 80
description 'by LAStools of rapidlasso GmbH'
ncols 7681
nrows 3421
llx 171.992
lly 14.9917
stepx 0.0166667
stepy 0.0166667
sigmaxy <not set>
variable length header record 2 of 2:
reserved 0
user ID 'LASF_Projection'
record ID 34735
length after header 32
description 'by LAStools of rapidlasso GmbH'
GeoKeyDirectoryTag version 1.1.0 number of keys 3
key 1024 tiff_tag_location 0 count 1 value_offset 2 - GTModelTypeGeoKey: ModelTypeGeographic
key 2048 tiff_tag_location 0 count 1 value_offset 4269 - GeographicTypeGeoKey: GCS_NAD83
key 4099 tiff_tag_location 0 count 1 value_offset 9001 - VerticalUnitsGeoKey: Linear_Meter
LASzip compression (version 3.4r1 c2 50000): POINT10 2
reporting minimum and maximum for all LAS point record entries ...
X 20640 36000
Y 1800 8640
Z -7088 2810
intensity 0 0
return_number 1 1
number_of_returns 1 1
edge_of_flight_line 0 0
scan_direction_flag 0 0
classification 0 0
scan_angle_rank 0 0
user_data 0 0
point_source_ID 0 0
number of first returns: 13843203
number of intermediate returns: 0
number of last returns: 13843203
number of single returns: 13843203
overview over number of returns of given pulse: 13843203 0 0 0 0 0 0
histogram of classification of points:
13843203 never classified (0)
Newcomb, Doug
Jul 8, 2019, 3:09:09 PM7/8/19
to last...@googlegroups.com
Martin,
Cool idea! I assume that it is an uncompressed TIF? How does it compare to deflate compression with predictors for TIF?
Doug
--
Download LAStools at
http://lastools.org
http://rapidlasso.com
Be social with LAStools at
http://facebook.com/LAStools
http://twitter.com/LAStools
http://linkedin.com/groups/LAStools-4408378
Manage your settings at
http://groups.google.com/group/lastools/subscribe
---
You received this message because you are subscribed to the Google Groups "LAStools - efficient tools for LiDAR processing" group.
To unsubscribe from this group and stop receiving emails from it, send an email to lastools+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/lastools/CABSWR-GWf_JvbVUqYDMt5%2BDEds7r27YU%2Bmqyo3%2BQRgJUzuCJZQ%40mail.gmail.com.
Doug Newcomb - Cartographer
USFWS
551F Pylon Dr
Raleigh, NC
---------------------------------------------------------------------------------------------------------
NOTE: This email correspondence and any attachments to and from this sender is subject to the Freedom of Information Act (FOIA) and may be disclosed to third parties.
Martin Isenburg
Jul 8, 2019, 3:23:03 PM7/8/19
to LAStools - efficient command line tools for LIDAR processing
Hello Doug,
the TIF files are also compressed. The typical "COMPRESSION=LZW" is used (see corresponding GDAL info report for "navd88-99.tif"). However, as the 32 bit pixel type is a floating-point number it contains a lot of "uncompressible" noise (despite my 12 years of lamenting since May 2007 [1]) whereas the LAZ rasters are storing the GEOID grids quantized to a more appropriate centimeter (or centifeet?) precision.
The gain of RasterLAZ over LZW compressed TIF is an additional decrease of 84% in file size. Here is how it looks in comparison to ASC:
07/08/2019 09:17 PM 188,338,577 navd88-99.asc
07/08/2019 08:21 PM 5,958,236 navd88-99.laz
07/05/2019 10:28 AM 35,853,335 navd88-99.tif
07/05/2019 02:03 PM 1,350,570,991 navd88-99.xyz
with
C:\GDAL\bin>more navd88-99.asc
ncols 7681
nrows 3421
xllcorner 171.991667
yllcorner 14.991667
cellsize 0.016667
NODATA_value -9999.0
2.04 2.04 2.04 2.03 2.03 2.03 2.02 2.02 2.01 2.01 2.00 2.00 1.99 [...]
ncols 7681
nrows 3421
xllcorner 171.991667
yllcorner 14.991667
cellsize 0.016667
NODATA_value -9999.0
2.04 2.04 2.04 2.03 2.03 2.03 2.02 2.02 2.01 2.01 2.00 2.00 1.99 [...]
and
C:\GDAL\bin>more navd88-99.xyz
172 72.000000000000242 2.0439999103546143
172.01666666666668 72.000000000000242 2.041100025177002
172.03333333333333 72.000000000000242 2.0378999710083008
172.05000000000001 72.000000000000242 2.0343000888824463
172.06666666666666 72.000000000000242 2.0302999019622803
172.08333333333334 72.000000000000242 2.0258998870849609
172 72.000000000000242 2.0439999103546143
172.01666666666668 72.000000000000242 2.041100025177002
172.03333333333333 72.000000000000242 2.0378999710083008
172.05000000000001 72.000000000000242 2.0343000888824463
172.06666666666666 72.000000000000242 2.0302999019622803
172.08333333333334 72.000000000000242 2.0258998870849609
[...]
C:\GDAL\bin>gdalinfo navd88-99.tif
Driver: GTiff/GeoTIFF
Files: navd88-99.tif
Size is 7681, 3421
Coordinate System is:
GEOGCS["NAD83",
DATUM["North_American_Datum_1983",
SPHEROID["GRS 1980",6378137,298.2572221010002,
AUTHORITY["EPSG","7019"]],
AUTHORITY["EPSG","6269"]],
PRIMEM["Greenwich",0],
UNIT["degree",0.0174532925199433],
AUTHORITY["EPSG","4269"]]
Origin = (171.991666666666670,72.008333333333582)
Pixel Size = (0.016666666666667,-0.016666666666667)
Metadata:
AREA_OR_POINT=Area
TIFFTAG_IMAGEDESCRIPTION=VERT_DATUM["North American Vertical Datum 1988",2005,AUTHORITY["EPSG","5103"]]
Image Structure Metadata:
COMPRESSION=LZW
INTERLEAVE=BAND
Corner Coordinates:
Upper Left ( 171.9916667, 72.0083333)
Lower Left ( 171.9916667, 14.9916667)
Upper Right ( 300.008, 72.008)
Lower Right ( 300.008, 14.992)
Center ( 236.000, 43.500)
Band 1 Block=256x256 Type=Float32, ColorInterp=Gray
NoData Value=-32767
Driver: GTiff/GeoTIFF
Files: navd88-99.tif
Size is 7681, 3421
Coordinate System is:
GEOGCS["NAD83",
DATUM["North_American_Datum_1983",
SPHEROID["GRS 1980",6378137,298.2572221010002,
AUTHORITY["EPSG","7019"]],
AUTHORITY["EPSG","6269"]],
PRIMEM["Greenwich",0],
UNIT["degree",0.0174532925199433],
AUTHORITY["EPSG","4269"]]
Origin = (171.991666666666670,72.008333333333582)
Pixel Size = (0.016666666666667,-0.016666666666667)
Metadata:
AREA_OR_POINT=Area
TIFFTAG_IMAGEDESCRIPTION=VERT_DATUM["North American Vertical Datum 1988",2005,AUTHORITY["EPSG","5103"]]
Image Structure Metadata:
COMPRESSION=LZW
INTERLEAVE=BAND
Corner Coordinates:
Upper Left ( 171.9916667, 72.0083333)
Lower Left ( 171.9916667, 14.9916667)
Upper Right ( 300.008, 72.008)
Lower Right ( 300.008, 14.992)
Center ( 236.000, 43.500)
Band 1 Block=256x256 Type=Float32, ColorInterp=Gray
NoData Value=-32767
To view this discussion on the web visit https://groups.google.com/d/msgid/lastools/CALQGVr04X1GP8LjtkiNBaZ63AHOpn%2B7Y3GsGDmLTzjaCZxpquQ%40mail.gmail.com.
Newcomb, Doug
Jul 9, 2019, 12:33:43 AM7/9/19
to last...@googlegroups.com
I thought that's what you might be doing, looking forward to trying it out!
Doug
To view this discussion on the web visit https://groups.google.com/d/msgid/lastools/CABSWR-G0Ovg2MGnE-V00zUZGJUJ5LLKoZr2xAF88YtP82LYNvw%40mail.gmail.com.
Martin Isenburg
Jul 9, 2019, 2:16:53 PM7/9/19
to LAStools - efficient command line tools for LIDAR processing
Hello,
here is an (early) prototype for compression and decompression of TIF, ASC, and BIL rasters:
please try it on your DEM and DTM and GEOID rasters and tell me if you find any issues. Obviously you cannot decompress "regular" LAZ file to a raster. Only RasterLAZ files.
=======================
demzip -i ..\data\fusa.laz -o fusa.tif
ERROR: cannot find RasterLAZ VLR in '..\data\fusa.laz'
ERROR: cannot open LAZ raster 'fusa.laz'
ERROR: cannot find RasterLAZ VLR in '..\data\fusa.laz'
ERROR: cannot open LAZ raster 'fusa.laz'
=======================
demzip -help
usage:
demzip -i dem.tif -o dem.laz
demzip -i dem.laz -o dem.tif
demzip -i dem.bil -o dem.laz
demzip -i dem.laz -o dem.bil
demzip -i dem.asc -o dem.laz
demzip -i dem.laz -o dem.asc
demzip -i dem\*.tif -olaz -cores 3
demzip -i dem\*.bil -olaz -cores 3
demzip -i dem\*.asc -olaz -cores 3
demzip -i dem\*.laz -otif -cores 3
demzip -i dem\*.laz -obil -cores 3
demzip -i dem\*.laz -oasc -cores 3
demzip -i dem\*.asc -odir compressed_dem -olaz -cores 2
demzip -i compressed_dem\*.laz -odir dem -oasc -cores 2
demzip -h
other options:
-nodata -9999 : raster value -9999 considered nodata
-nodata_min -1000 : raster values -1000 or below considered nodata
-nodata_min 32768 : raster values 32768 or above considered nodata
-longlat -wgs84 : set horizontal datum to longlat on WGS84
-longlat -etrs89 : set horizontal datum to longlat on ETRS89
-longlat -gda94 : set horizontal datum to longlat on GDA94
-longlat -nad83 : set horizontal datum to longlat on NAD83
-longlat -nad83_csrs : set horizontal datum to longlat on NAD83(CSRS)
-longlat -nad83_2011 : set horizontal datum to longlat on NAD83(2001)
-longlat -nad83_harn : set horizontal datum to longlat on NAD83(HARN)
-utm 32north -wgs84 : set horizontal datum to UTM32 north on WGS84
-epsg 27700 : set horizontal datum to EPSG code 27700
-vertical_wgs84 : set vertical datum to WGS84
-vertical_navd88 : set vertical datum to NAVD88
-vertical_cgvd2013 : set vertical datum to CGVD2013
-vertical_nn2000 : set vertical datum to NN2000
-vertical_dhhn92 : set vertical datum to DHHN92
-vertical_dhhn2016 : set vertical datum to DHHN2016
-elevation_survey_feet : set vertical units from meters to US survey feet
-sigmaxy 0.5 : horizontal accuracy expected at 0.5 meters (inactive)
usage:
demzip -i dem.tif -o dem.laz
demzip -i dem.laz -o dem.tif
demzip -i dem.bil -o dem.laz
demzip -i dem.laz -o dem.bil
demzip -i dem.asc -o dem.laz
demzip -i dem.laz -o dem.asc
demzip -i dem\*.tif -olaz -cores 3
demzip -i dem\*.bil -olaz -cores 3
demzip -i dem\*.asc -olaz -cores 3
demzip -i dem\*.laz -otif -cores 3
demzip -i dem\*.laz -obil -cores 3
demzip -i dem\*.laz -oasc -cores 3
demzip -i dem\*.asc -odir compressed_dem -olaz -cores 2
demzip -i compressed_dem\*.laz -odir dem -oasc -cores 2
demzip -h
other options:
-nodata -9999 : raster value -9999 considered nodata
-nodata_min -1000 : raster values -1000 or below considered nodata
-nodata_min 32768 : raster values 32768 or above considered nodata
-longlat -wgs84 : set horizontal datum to longlat on WGS84
-longlat -etrs89 : set horizontal datum to longlat on ETRS89
-longlat -gda94 : set horizontal datum to longlat on GDA94
-longlat -nad83 : set horizontal datum to longlat on NAD83
-longlat -nad83_csrs : set horizontal datum to longlat on NAD83(CSRS)
-longlat -nad83_2011 : set horizontal datum to longlat on NAD83(2001)
-longlat -nad83_harn : set horizontal datum to longlat on NAD83(HARN)
-utm 32north -wgs84 : set horizontal datum to UTM32 north on WGS84
-epsg 27700 : set horizontal datum to EPSG code 27700
-vertical_wgs84 : set vertical datum to WGS84
-vertical_navd88 : set vertical datum to NAVD88
-vertical_cgvd2013 : set vertical datum to CGVD2013
-vertical_nn2000 : set vertical datum to NN2000
-vertical_dhhn92 : set vertical datum to DHHN92
-vertical_dhhn2016 : set vertical datum to DHHN2016
-elevation_survey_feet : set vertical units from meters to US survey feet
-sigmaxy 0.5 : horizontal accuracy expected at 0.5 meters (inactive)
=======================
example compression:
=======================
demzip -i LIDAR-DTM-50CM-TQ37ne\*.asc ^
-epsg 27700 ^
-olaz ^
-cores 2
done with 'LIDAR-DTM-50CM-TQ37ne\tq3575_DTM_50CM.laz'. total time 10.467 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3576_DTM_50CM.laz'. total time 10.704 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3577_DTM_50CM.laz'. total time 9.662 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3578_DTM_50CM.laz'. total time 9.533 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3579_DTM_50CM.laz'. total time 9.671 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3675_DTM_50CM.laz'. total time 10.897 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3676_DTM_50CM.laz'. total time 11.275 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3677_DTM_50CM.laz'. total time 10.077 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3678_DTM_50CM.laz'. total time 9.925 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3679_DTM_50CM.laz'. total time 9.85 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3776_DTM_50CM.laz'. total time 10.314 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3775_DTM_50CM.laz'. total time 10.867 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3777_DTM_50CM.laz'. total time 10.221 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3778_DTM_50CM.laz'. total time 10.1 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3779_DTM_50CM.laz'. total time 10.12 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3875_DTM_50CM.laz'. total time 11.227 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3876_DTM_50CM.laz'. total time 11.614 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3877_DTM_50CM.laz'. total time 10.996 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3878_DTM_50CM.laz'. total time 10.049 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3879_DTM_50CM.laz'. total time 9.986 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3975_DTM_50CM.laz'. total time 11.266 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3976_DTM_50CM.laz'. total time 11.231 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3978_DTM_50CM.laz'. total time 9.809 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3977_DTM_50CM.laz'. total time 10.833 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3979_DTM_50CM.laz'. total time 8.491 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3576_DTM_50CM.laz'. total time 10.704 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3577_DTM_50CM.laz'. total time 9.662 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3578_DTM_50CM.laz'. total time 9.533 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3579_DTM_50CM.laz'. total time 9.671 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3675_DTM_50CM.laz'. total time 10.897 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3676_DTM_50CM.laz'. total time 11.275 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3677_DTM_50CM.laz'. total time 10.077 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3678_DTM_50CM.laz'. total time 9.925 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3679_DTM_50CM.laz'. total time 9.85 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3776_DTM_50CM.laz'. total time 10.314 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3775_DTM_50CM.laz'. total time 10.867 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3777_DTM_50CM.laz'. total time 10.221 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3778_DTM_50CM.laz'. total time 10.1 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3779_DTM_50CM.laz'. total time 10.12 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3875_DTM_50CM.laz'. total time 11.227 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3876_DTM_50CM.laz'. total time 11.614 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3877_DTM_50CM.laz'. total time 10.996 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3878_DTM_50CM.laz'. total time 10.049 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3879_DTM_50CM.laz'. total time 9.986 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3975_DTM_50CM.laz'. total time 11.266 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3976_DTM_50CM.laz'. total time 11.231 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3978_DTM_50CM.laz'. total time 9.809 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3977_DTM_50CM.laz'. total time 10.833 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3979_DTM_50CM.laz'. total time 8.491 sec.
=======================
example decompression:
=======================
demzip -i C:\Users\martin\Downloads\LIDAR-DTM-50CM-TQ37ne\*.laz ^
-obil ^
-cores 2
done with 'LIDAR-DTM-50CM-TQ37ne\tq3575_DTM_50CM.bil'. total time 0.956 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3576_DTM_50CM.bil'. total time 0.957 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3578_DTM_50CM.bil'. total time 0.993 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3577_DTM_50CM.bil'. total time 1.017 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3579_DTM_50CM.bil'. total time 0.936 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3675_DTM_50CM.bil'. total time 0.937 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3676_DTM_50CM.bil'. total time 1.057 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3677_DTM_50CM.bil'. total time 1.008 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3678_DTM_50CM.bil'. total time 0.943 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3679_DTM_50CM.bil'. total time 1.042 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3775_DTM_50CM.bil'. total time 0.896 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3776_DTM_50CM.bil'. total time 1.297 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3777_DTM_50CM.bil'. total time 0.956 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3778_DTM_50CM.bil'. total time 0.965 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3779_DTM_50CM.bil'. total time 0.917 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3875_DTM_50CM.bil'. total time 0.914 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3876_DTM_50CM.bil'. total time 1.657 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3877_DTM_50CM.bil'. total time 1.084 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3879_DTM_50CM.bil'. total time 0.95 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3878_DTM_50CM.bil'. total time 0.99 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3975_DTM_50CM.bil'. total time 0.936 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3976_DTM_50CM.bil'. total time 0.919 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3977_DTM_50CM.bil'. total time 0.996 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3978_DTM_50CM.bil'. total time 0.989 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3979_DTM_50CM.bil'. total time 0.905 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3576_DTM_50CM.bil'. total time 0.957 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3578_DTM_50CM.bil'. total time 0.993 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3577_DTM_50CM.bil'. total time 1.017 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3579_DTM_50CM.bil'. total time 0.936 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3675_DTM_50CM.bil'. total time 0.937 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3676_DTM_50CM.bil'. total time 1.057 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3677_DTM_50CM.bil'. total time 1.008 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3678_DTM_50CM.bil'. total time 0.943 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3679_DTM_50CM.bil'. total time 1.042 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3775_DTM_50CM.bil'. total time 0.896 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3776_DTM_50CM.bil'. total time 1.297 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3777_DTM_50CM.bil'. total time 0.956 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3778_DTM_50CM.bil'. total time 0.965 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3779_DTM_50CM.bil'. total time 0.917 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3875_DTM_50CM.bil'. total time 0.914 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3876_DTM_50CM.bil'. total time 1.657 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3877_DTM_50CM.bil'. total time 1.084 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3879_DTM_50CM.bil'. total time 0.95 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3878_DTM_50CM.bil'. total time 0.99 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3975_DTM_50CM.bil'. total time 0.936 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3976_DTM_50CM.bil'. total time 0.919 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3977_DTM_50CM.bil'. total time 0.996 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3978_DTM_50CM.bil'. total time 0.989 sec.
done with 'LIDAR-DTM-50CM-TQ37ne\tq3979_DTM_50CM.bil'. total time 0.905 sec.
Regards,
Martin
Martin Isenburg
Jul 10, 2019, 4:48:07 AM7/10/19
to LAStools - efficient command line tools for LIDAR processing
Hello,
>> more DEM_dec.asc
ncols 500
nrows 500
xllcorner 1935000.000000
yllcorner 5667500.000000
cellsize 1.000000
NODATA_value -9999.0
487.98 487.78 487.58 487.23 [...]
https://github.com/LAStools/LAStools/commit/b9243a8c44bc221d1972d4cf66f91c4053cdb98e
In the latest version of lasdiff the rasters are declared identical:
>> lasdiff -i DEM.asc -i DEM_dec.asc
checking 'DEM.asc' against 'DEM_dec.asc'
headers are identical.
raw points are identical.
files are identical. both have 250000 points. took 1.149 secs.
Thanks for such immediate feedback, Susana. I got the following inquiry below from but she attached a 2 MB ASC file so I removed the message. However, after compression into RasterLAZ the file is only 221 KB so I have attached this one here for all of you to enjoy some RasterLAZ example. Also a lasinfo report is attached. You see
Susana's inquiry at the end of this message.
Her input raster had an impressive tenth of a millimeter precision for the elevation:
>> more DEM.asc
ncols 500
nrows 500
xllcorner 1935000
yllcorner 5667500
cellsize 1
NODATA_value -9999.0
487.9786 487.7788 487.5776 487.2283 [...]
>> more DEM.asc
ncols 500
nrows 500
xllcorner 1935000
yllcorner 5667500
cellsize 1
NODATA_value -9999.0
487.9786 487.7788 487.5776 487.2283 [...]
After the round-trip though DEMzip from ASC to RasterLAZ and back to ASC the DEM is now at a more appropriate centimeter resolution:
ncols 500
nrows 500
xllcorner 1935000.000000
yllcorner 5667500.000000
cellsize 1.000000
NODATA_value -9999.0
487.98 487.78 487.58 487.23 [...]
The rounding was done by DEMzip. She then compared the two rasters with her current version of lasdiff (190623 or older) and found some differences:
>> lasdiff -i DEM.asc -i DEM_dec.asc
checking 'DEM.asc' against 'DEM_dec.asc'
headers are identical.
z: 48893 48894
point 55 of 250000 is different
z: 49502 49503
point 86 of 250000 is different
z: 47133 47134
point 297 of 250000 is different
z: 46211 46212
point 349 of 250000 is different
z: 47542 47543
point 454 of 250000 is different
already 5 points are different ... shutting up.
1162 points are different.
both have 250000 points. took 1.213 secs.
>> lasdiff -i DEM.asc -i DEM_dec.asc
checking 'DEM.asc' against 'DEM_dec.asc'
headers are identical.
z: 48893 48894
point 55 of 250000 is different
z: 49502 49503
point 86 of 250000 is different
z: 47133 47134
point 297 of 250000 is different
z: 46211 46212
point 349 of 250000 is different
z: 47542 47543
point 454 of 250000 is different
already 5 points are different ... shutting up.
1162 points are different.
both have 250000 points. took 1.213 secs.
What happened? Turns out the on-the-fly quantization (*) code in LASlib was slightly different from that of DEMzip for values such as 488.9350 and they became 488.93 in LASlib but 488.94 in DEMzip. This has been rectified already yesterday and here are the changes in the LASlib code should you care:
(*) by default all ASC rasters read as points automatically get their elevations quantized to 2 decimal digits
(*) by default all ASC rasters read as points automatically get their elevations quantized to 2 decimal digits
https://github.com/LAStools/LAStools/commit/b9243a8c44bc221d1972d4cf66f91c4053cdb98e
In the latest version of lasdiff the rasters are declared identical:
>> lasdiff -i DEM.asc -i DEM_dec.asc
checking 'DEM.asc' against 'DEM_dec.asc'
headers are identical.
raw points are identical.
files are identical. both have 250000 points. took 1.149 secs.
Regards,
Martin
This is great, I have done a small test with the attached file.
:: example compression:
demzip.exe -i J:\DEM\*.asc ^
-epsg 2193 ^
-odir J:\DEM_compress ^
-olaz ^
-cores 30
:: example decompression:
demzip.exe -i J:\DEM_compress\*.laz ^
-odir J:\DEM_decompress ^
-oasc ^
-cores 30
:: check if the two rasters are identical
lasdiff -i J:\DEM\DEM.asc -i J:\DEM_decompress\DEM.asc
Is any way that the decompress DEM would be identical than the original DEM?
Reply all
Reply to author
Forward
0 new messages