error reading landsat 8 collection 2 L1T data

[Joseph McGlinchy]

Hello,

 

I am trying to use arcsi to apply atmospheric correction to a landsat 8 scene… it is collection 2 now, so I’m not sure if the metadata is different and is causing the error. But here’s my input and the corresponding output.

 

arcsi.py -s ls8 -p CLOUDS DOSAOTSGL STDSREF METADATA -o ./OutputsL8/ --stats --format KEA --tmpath ./tmp --dem ./neon_usgs_dem.tif --keepfileends stdsref.kea clouds.kea meta.json sat.kea toposhad.kea valid.kea -i ./LC08_L1TP_033032_20200913_20200919_02_T1/LC08_L1TP_033032_20200913_20200919_02_T1_MTL.txt

 

ARCSI 3.1.6 Copyright (C) 2017 Pete Bunting, Dan Clewley

This program comes with ABSOLUTELY NO WARRANTY.

This is free software, and you are welcome to redistribute it

under certain conditions; See website (http://www.rsgislib.org/arcsi).

Bugs are to be reported to rsgislib...@googlegroups.com.

 

WARNING: Output directory does not exist so creating it...

WARNING: The temp path specified does not exist, it is being created.

Start Time: 15:30:04, Tue Dec 12 2020.

Reading header file

Extracting Header Values

Input Header: './LC08_L1TP_033032_20200913_20200919_02_T1/LC08_L1TP_033032_20200913_20200919_02_T1_MTL.txt'

Error: 'FILE_NAME_BAND_QUALITY'

ARCSI took in less than a second to process the input image. Thank you for using ARCSI.

 

Any thoughts?

 

Thanks!

Joe

------------------------------------------------------------

Joe McGlinchy

Remote Sensing Scientist - CIRES Earth Lab

University of Colorado – Boulder

joseph.m...@colorado.edu / 330-338-8387

 

[jomc...@colorado.edu]

indeed it was the metadata parsing. I've replaced some lines in the arcsi/arcsisensorlandsat8.py file and it is up and running. I'm not sure it justifies a pull request, but i'm happy to submit one if that is helpful.

[Peter Bunting]

Hi,

I haven’t had chance to look at the collection 2 data yet but it is quite likely there are header differences. Happy to receive a pull request to see what you have found which needed changing but when I get chance to look at it I’ll have to update all the landsat sensors so might not merge your request. I’m afraid it’ll be into January before I have time to look at this issue.

Best wishes,

Pete

> --
> You received this message because you are subscribed to the Google Groups "RSGISLib Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to rsgislib-suppo...@googlegroups.com.
> To view this discussion on the web, visit https://groups.google.com/d/msgid/rsgislib-support/e9fca979-f896-4c72-b594-021c6c9c7685n%40googlegroups.com.

[jomc...@colorado.edu]

no problem, Pete! I've changed these lines in that python file to get it running on my end with Collection 2. If i get around to a pull request, you'll see it, but hopefully others will see this in the meantime if they search for it.

https://github.com/remotesensinginfo/arcsi/blob/e3985a2df8414388a702c50bd9c4514878670232/arcsilib/arcsisensorlandsat8.py#L299 to

self.bandQAFile = os.path.join(filesDIR, headerParams["FILE_NAME_QUALITY_L1_PIXEL"])

and

https://github.com/remotesensinginfo/arcsi/blob/e3985a2df8414388a702c50bd9c4514878670232/arcsilib/arcsisensorlandsat8.py#L389 (and 390) to

fileDateStr = headerParams["DATE_ACQUIRED"].strip()

fileDateStr += "T"

fileDateStr += headerParams["SCENE_CENTER_TIME"].replace('Z', '').split('.')[0]

Cheers,

Joe

[jomc...@colorado.edu]

i tried to push this to a branch i made on my end but i'm not authorized to do so. Copying here.

[Anthony Scarth]

Hi all,

Thanks for your investigations and fix, Joe. This has been useful to get working.

It seems that collection 1 will be retired on 1st Jan 2022 so it would probably be a good idea to get arcsi working with Collection 2 soon.

I've had success with updating LS 7 and 4/5 TM with similar patches and hope to test the rest of the sensors soon.

Pete, I'll put these new header keys in try/catch blocks to maintain backwards compatibility and send a pull request or link you my fork when ready.

Anthony