WARNING: Trimble's LPMaster exports corrupt LAS FWF files
19 views
Skip to first unread message
Martin Isenburg
Mar 1, 2014, 10:20:24 PM3/1/14
to LAStools - efficient command line tools for LIDAR processing, The LAS room - a friendly place to discuss specifications of the LAS format, PulseWaves - no pulse left behind
Hello,
it was brought to my attention by Mohsen Azadbakht via the PulseWaves forum
it was brought to my attention by Mohsen Azadbakht via the PulseWaves forum
that Trimble's LPMaster seems to export corrupt LAS 1.4 FWF files as detailed in this discussion thread:
I advise you to insist on the use of a RIEGL or a Leica scanner if you currently tender for full waveform data deliveries in the LAS FWF format. That said, I absolutely can not endorse tendering full waveform delivery in the LAS FWF format. It is better to use PulseWaves for full waveform LiDAR and LAS for the discrete LiDAR.
Given the current format mess there is - in my opinion - only one optior for tendering *good* full waveform data: insists that the survey company uses a RIEGL scanner until the other hardware companies get their act together. I'll announce in the PulseWaves forum when that happens ...
Regards,
Martin @rapidlasso
--
http://rapidlasso.com - fast tools for waveform LiDARs
Martin Isenburg
Mar 15, 2014, 5:18:14 AM3/15/14
to pulse...@googlegroups.com, The LAS room - a friendly place to discuss specifications of the LAS format
Hello,
after consulting with Trimble I can confirm that the corruptness of LAS FWF output persists in both LAS 1.3 and LAS 1.4 exports in the latest version (LPMaster 5.6.2 released Dec. 20, 2013). There were "minor improvements" in the corruptness ... but nothing that makes the output useable in any shape or form.
Below the las2txt output for a small sample I obtained followed by the lasinfo output ...
Regards,
Martin @rapidlasso
http://rapidlasso.com - fast tools to wave your LiDARs
D:\lastools\bin>las2txt -i las500K.las -parse xyzrnWV -stdout | more
406344.056 5889035.190 68.352 1 1 1 0 240 17998.9 1.95139e-014 -1.18523e-015 -3.57792e-014 16 24 5 5 3 2 1 1 1 2 2 1 2 2 2 2 5 13 31 56 72 69 49 26 10 5
406343.121 5889035.178 68.423 1 1 1 240 240 17000.7 1.85308e-014 -1.12886e-015 -3.4056e-014 16 24 5 6 7 8 6 5 3 2 4 4 4 5 6 7 12 29 52 67 65 45 23 8 4 3
406342.215 5889035.165 68.446 1 1 1 480 240 18002.5 1.94242e-014 -1.18679e-015 -3.57809e-014 16 24 1 1 1 1 2 2 2 1 1 1 1 1 2 2 6 15 36 62 78 73 52 25 10 5
406341.287 5889035.153 68.504 1 1 1 720 240 17004.2 1.84457e-014 -1.13035e-015 -3.40579e-014 16 24 2 2 1 2 1 1 1 1 2 2 3 4 4 5 10 27 52 72 71 54 28 12 6 5
406340.415 5889035.137 68.468 1 1 1 960 240 15997 1.75522e-014 -1.07878e-015 -3.24837e-014 16 24 2 2 1 1 2 2 3 3 3 2 2 2 5 9 23 40 51 48 34 18 7 4 3 2
406339.485 5889035.126 68.542 1 1 1 1200 240 15006 1.67471e-014 -1.03235e-015 -3.10662e-014 16 24 5 4 2 2 2 4 4 4 3 1 3 4 8 16 27 34 33 24 13 6 3 2 3 3
406338.574 5889035.113 68.579 1 1 1 1440 240 48000.2 -3.71605e-014 2.29752e-015 6.9095e-014 16 24 3 2 3 2 3 3 3 3 4 3 2 2 4 6 9 10 10 8 6 4 3 2 2 2
406336.313 5889035.184 71.135 1 2 1 1680 240 17002.1 1.82043e-014 -1.12886e-015 -3.39277e-014 16 24 4 5 3 3 2 1 3 2 2 2 4 5 7 9 10 13 15 15 13 9 7 6 7 7
406337.672 5889035.099 68.603 2 2 1 1920 240 36002.1 2.14954e-013 -1.33294e-014 -4.00613e-013 16 24 4 5 3 3 2 1 3 2 2 2 4 5 7 9 10 13 15 15 13 9 7 6 7 7
406336.765 5889035.086 68.628 1 1 1 2160 240 17995 1.91413e-014 -1.19051e-015 -3.57582e-014 16 24 2 3 3 2 4 3 4 5 4 4 3 3 3 4 11 28 56 81 84 63 34 13 6 5
406312.998 5889035.969 98.786 1 2 1 2400 240 16997.8 1.70779e-014 -1.09107e-015 -3.25892e-014 16 24 0 1 2 2 3 2 1 0 1 1 3 2 2 2 5 10 16 23 22 17 9 6 3 4
406328.333 5889034.990 69.528 2 2 1 2640 240 14000.2 1.55692e-014 -9.94677e-016 -2.971e-014 16 24 2 2 2 2 1 1 1 1 2 2 2 9 21 34 39 33 20 8 3 2 1 1 2 2
406312.490 5889035.935 98.151 1 2 1 2880 240 16003.3 1.62742e-014 -1.04283e-015 -3.11293e-014 16 24 0 0 0 0 0 1 2 3 5 6 6 4 3 5 8 14 14 11 6 1 1 1 1 1
406327.413 5889034.979 69.611 2 2 1 3120 240 15001.9 1.62138e-014 -1.03896e-015 -3.10137e-014 16 24 0 0 0 0 0 0 0 0 1 2 1 2 6 15 22 23 17 9 3 1 1 0 0 0
406313.271 5889035.817 95.034 1 2 1 3360 240 42999.6 -6.78379e-014 4.36006e-015 1.30071e-013 16 24 0 0 0 0 0 1 1 0 0 0 0 2 5 8 10 10 9 6 4 2 1 1 0 0
406326.504 5889034.967 69.665 2 2 1 3600 240 13996.4 1.54898e-014 -9.95548e-016 -2.96995e-014 16 24 0 0 0 1 1 0 0 1 2 2 3 5 9 11 14 10 7 3 1 1 2 2 1 1
406311.783 5889035.845 96.256 1 2 1 3840 240 12999.7 1.4272e-014 -9.20063e-016 -2.74307e-014 16 24 0 0 0 1 1 2 1 1 1 1 3 9 18 25 24 20 11 6 4 4 7 11 12 11
406325.609 5889034.953 69.687 2 2 1 4080 240 17000 1.7687e-014 -1.1402e-015 -3.39939e-014 16 24 2 1 0 1 0 1 2 4 5 5 4 3 3 5 8 17 30 40 39 29 15 6 3 2
406311.538 5889035.793 95.123 1 2 1 4320 240 16998 1.70077e-014 -1.09968e-015 -3.27659e-014 16 24 2 2 2 2 2 2 1 0 0 1 1 2 2 7 12 21 30 33 28 19 10 6 5 5
406324.714 5889034.941 69.742 2 2 1 4560 240 16000 1.68333e-014 -1.08839e-015 -3.24297e-014 16 24 3 2 2 2 3 4 3 2 2 2 2 2 3 6 11 15 17 14 8 4 2 0 1 1
406323.876 5889034.925 69.673 1 1 1 4800 240 18001.8 1.84957e-014 -1.19947e-015 -3.57176e-014 16 24 4 3 3 2 3 3 2 2 2 3 5 5 5 5 9 19 34 48 49 38 22 9 3 3
406322.949 5889034.915 69.773 1 1 1 5040 240 16996.3 1.75557e-014 -1.14194e-015 -3.39837e-014 16 24 4 6 5 4 4 3 4 4 4 4 4 4 5 11 25 45 62 63 47 26 10 4 4 3
406322.043 5889034.903 69.837 1 1 1 5280 240 17005.3 1.75198e-014 -1.14303e-015 -3.39954e-014 16 24 3 2 2 0 1 2 2 2 2 2 3 3 3 5 12 26 45 58 55 39 21 9 6 5
406321.174 5889034.889 69.829 1 1 1 5520 240 15998.1 1.66692e-014 -1.09082e-015 -3.24228e-014 16 24 2 3 2 3 4 4 6 6 4 2 2 4 8 19 35 49 52 41 24 11 5 3 3 2
406309.510 5889035.584 90.871 1 2 1 5760 240 15003.6 1.54286e-014 -1.01268e-015 -3.0082e-014 16 24 2 1 1 1 1 0 1 1 2 3 3 4 6 8 13 16 14 9 5 3 2 2 3 3
406320.278 5889034.877 69.880 2 2 1 6000 240 16999.8 1.74301e-014 -1.14405e-015 -3.39844e-014 16 24 2 2 2 2 2 2 3 4 4 3 2 2 3 8 24 49 70 72 55 30 13 5 3 3
406310.284 5889035.463 87.705 1 2 1 6240 240 34994.6 1.26958e-013 -8.35828e-015 -2.48135e-013 16 24 2 3 3 3 3 3 3 3 3 3 3 4 6 10 12 10 7 4 3 1 1 0 1 2
406319.382 5889034.865 69.925 2 2 1 6480 240 15999.8 1.65882e-014 -1.09208e-015 -3.2421e-014 16 24 2 2 3 4 5 5 4 2 1 1 2 3 4 9 18 26 31 27 19 11 6 4 2 3
406318.481 5889034.853 69.980 1 1 1 6720 240 15001.6 1.58212e-014 -1.04475e-015 -3.0997e-014 16 24 3 2 3 2 2 2 3 3 3 3 2 3 9 24 45 60 58 42 22 8 4 3 2 3
406317.584 5889034.841 70.044 1 1 1 6960 240 17996.1 1.81722e-014 -1.2036e-015 -3.56886e-014 16 24 2 3 3 3 4 4 2 2 1 2 3 4 6 6 11 26 50 72 79 64 38 18 7 4
406316.713 5889034.827 70.049 1 1 1 7200 240 97997 -5.95067e-015 3.95325e-016 1.17149e-014 16 24 4 4 3 3 2 2 1 2 0 1 2 2 5 8 10 9 7 4 2 2 2 1 1 2
406310.055 5889035.199 81.470 1 2 1 7440 240 15993.3 1.61548e-014 -1.07649e-015 -3.1881e-014 16 24 2 2 2 2 2 2 2 3 3 3 3 4 7 12 22 31 34 29 20 10 6 4 3 2
406315.791 5889034.817 70.152 2 2 1 7680 240 100993 -5.65408e-015 3.76763e-016 1.11581e-014 16 24 2 2 2 2 2 2 2 3 3 3 3 4 7 12 22 31 34 29 20 10 6 4 3 2
406310.005 5889035.133 79.893 1 1 1 7920 240 16997 1.69331e-014 -1.13175e-015 -3.34977e-014 16 24 1 2 1 0 1 2 2 2 2 2 1 1 3 5 13 27 43 51 47 31 15 7 3 3
406310.030 5889035.060 78.148 1 1 1 8160 240 18006.3 1.77992e-014 -1.19325e-015 -3.52967e-014 16 24 3 1 1 2 2 3 3 4 3 3 2 2 2 3 7 18 35 53 60 52 34 17 8 4
406309.980 5889034.992 76.549 1 3 1 8400 240 14000.9 1.47974e-014 -9.95023e-016 -2.94154e-014 16 24 2 2 3 3 3 3 3 3 3 3 5 9 16 21 22 19 13 8 6 5 3 3 2 3
406312.364 5889034.832 71.811 2 3 1 8640 240 49000.9 -3.1517e-014 2.1193e-015 6.26519e-014 16 24 2 2 3 3 3 3 3 3 3 3 5 9 16 21 22 19 13 8 6 5 3 3 2 3
406313.127 5889034.781 70.295 3 3 1 8880 240 61000.9 -1.52717e-014 1.02692e-015 3.03583e-014 16 24 2 2 3 3 3 3 3 3 3 3 5 9 16 21 22 19 13 8 6 5 3 3 2 3
=========================
D:\lastools\bin>lasinfo -i lasFULL.las
reporting all LAS header entries:
file signature: 'LASF'
file source ID: 1
global_encoding: 4
project ID GUID data 1-4: 11041701 0 0 'BootNr'
version major.minor: 1.3
system identifier: 'H68_019-002 EXTRACTION'
generating software: 'Trimble LPMaster'
file creation day/year: 63/2014
header size: 235
offset to point data: 403
number var. length records: 2
point data format: 5
point data record length: 63
number of point records: 282039
number of points by return: 198267 71098 11742 890 40
scale factor x y z: 0.001 0.001 0.001
offset x y z: 500000 5889000 0
min x y z: 405526.562 5889022.104 52.068
max x y z: 406389.954 5889258.438 657.794
start of waveform data packet record: 0
variable length header record 1 of 2:
reserved 0
user ID 'LASF_Projection'
record ID 34735
length after header 32
description 'plane metric system'
GeoKeyDirectoryTag version 1.1.0 number of keys 3
key 1024 tiff_tag_location 0 count 1 value_offset 1 - GTModelTypeGeoKey: ModelTypeProjected
key 3072 tiff_tag_location 0 count 1 value_offset 0 - ProjectedCSTypeGeoKey: look-up for 0 not implemented
key 3076 tiff_tag_location 0 count 1 value_offset 9001 - ProjLinearUnitsGeoKey: Linear_Meter
variable length header record 2 of 2:
reserved 0
user ID 'LASF_Spec'
record ID 100
length after header 26
description 'WPD_1'
index 1 bits/sample 16 compression 0 samples 24 temporal 100 gain 1, offset 0
the header is followed by 2 user-defined bytes
reporting minimum and maximum for all LAS point record entries ...
X -94473437 -93610045
Y 22104 258438
Z 52068 657794
intensity 43 2296
edge_of_flight_line 0 1
scan_direction_flag 1 1
number_of_returns_of_given_pulse 1 6
return_number 1 6
classification 0 4
scan_angle_rank -30 30
user_data 0 0
point_source_ID 1 1
gps_time 37767.000452 37769.994810
Color R 0 0
G 0 0
B 0 0
Wavepacket Index 1 1
Offset 0 72622080
Size 240 1440
Location 11993.6 592997
Xt -1.77335e-012 1.77903e-012
Yt -7.84755e-014 1.68563e-013
Zt -9.41954e-013 3.17209e-012
WARNING: 1 points outside of header bounding box
WARNING: there are 2 points with return number 6
overview over number of returns of given pulse: 127169 118712 32556 3400 190 12 0
histogram of classification of points:
1532 Created, never classified (0)
181837 Ground (2)
98670 Medium Vegetation (4)
real max x larger than header max x by 0.000602
Martin Isenburg
May 13, 2014, 1:31:11 PM5/13/14
to pulse...@googlegroups.com, The LAS room - a friendly place to discuss specifications of the LAS format
Hello,
in the meantime I got word that Trimble has released a newer version of LPMaster (namely version 5.7.0) and I got a hold of a small LAS FWF export. They seemed to have done some work to improve it but the export is still corrupt (-> not specification conform). In fact it (hard-)crashed my lasview.exe program and gave me opportunity to write a fix that would give an error instead of crash. The latest problems have to do with the waveform packets that have the wrong wave packet descriptor indices. Unfortunately I had not checked for this with lasvalidate.exe ... another thing that is fixed now. Attached you find the latest lasinfo.exe and the latest lasvalidate.exe reports for the LAS FWF 1.3 export from the new LPMaster version 5.7.0 ... too bad that I do not have better news, but hopefully this will get fixed with the next 0.0.1 update.
Regards,
Martin @rapidlasso
--
http://rapidlasso.com - fast tools to find corrupt LiDARs
Reply all
Reply to author
Forward
0 new messages