ARCSI - Atmospheric Correction according to the new metadata format (JSON) of RapidEye

159 views
Skip to first unread message

Rodrigo Pereira da Silva

unread,
May 3, 2016, 10:22:59 PM5/3/16
to RSGISLib Support
Hello Developers and Users,

First of all, congratulations Dr. Pete Bunting and all the developers' team, you've done an amazing job, I am a huge fan. 

I would like to know if someone has found a solution to use arcsi to apply atmospheric correction on RapidEye imagery. 
The python script was developed to get information from the metadata in xml format. Since July 2015, planet labs has released RapidEye's metadata in json file format.

I tried to use the metadata.json as input and I got the following message:

Reading header file

Error: not well-formed (invalid token): line 1, column 0

Processing took 0h 0m 0.02s. Thank you for using ARCSI.

And then I converted from json to xml with some packages like json, xml and dicttoxml. 
I tried to use the converted xml file, and then I got the following message:

Reading header file

Error: 'NoneType' object has no attribute 'find'

Processing took 0h 0m 0.21s. Thank you for using ARCSI.


I opened the deprecated xml file and the new json file to analyse.
The structure and amount of information is completely different.

Does anyone have found a solution for this issue?

Thank you very much for your attention!

Regards, 
Rodrigo Silva. 

Forestry Student. 



Pete Bunting [pfb]

unread,
May 4, 2016, 9:01:09 AM5/4/16
to Rodrigo Pereira da Silva, RSGISLib Support
Dear Rodrigo, 

I haven’t had any recent RapidEye imagery so I wasn’t aware of the change. It should be relatively easy to update ARCSI for the JSON header. Can you provide an example image which I could use to add support for this header format?

Best wishes, 

Pete

****************************************************
* Dr Pete Bunting
* Reader in Remote Sensing
* Earth Observation and Ecosystem Dynamics Group
* Department of Geography and Earth Sciences
* Aberystwyth University
* Aberystwyth
* Ceredigion
* SY23 3DB
* UK

* Ph: +44 (0) 1970 622615
* Mob: +44 (0) 7917 842743
* Email: p...@aber.ac.uk
* ORCID: http://orcid.org/0000-0002-7435-0148
****************************************************
"Please consider the environment before printing this email or any documents attached”

--
You received this message because you are subscribed to the Google Groups "RSGISLib Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email to rsgislib-suppo...@googlegroups.com.
To post to this group, send email to rsgislib...@googlegroups.com.
Visit this group at https://groups.google.com/group/rsgislib-support.
For more options, visit https://groups.google.com/d/optout.

Rodrigo Pereira da Silva

unread,
May 4, 2016, 11:49:15 AM5/4/16
to rsgislib...@googlegroups.com
Dear Dr. Pete Bunting,

Yes, I can provide the sample data that I have. 

You can use this link to download the rapideye imagery with the JSON format metadata: https://drive.google.com/open?id=0B2yzkZ0qRIsoYUJKeTdFc3dwMzA

You can use this link to download the rapideye imagery with the XML format metadata: https://drive.google.com/open?id=0B2yzkZ0qRIsoV2Nld2NScEloMEU

It would be interesting to have the tool for both metadata format (or to have two different tools, one for each format), once it is important to analyse changes through time. So far, planet labs and blackbridge release metadata in different formats, but some people say that in the future rapideye metadata will be only in JSON format. 

Thank you very much for your attention.

I will stay tuned. And once again, congratulations for your work. 

Regards,
Rodrigo. 

Pete Bunting [pfb]

unread,
May 13, 2016, 6:16:30 AM5/13/16
to Rodrigo Pereira da Silva, RSGISLib Support
Thanks Rodrigo, 

I have update ARCSI to support the RapidEye JSON headers. I have just updated the Mac OS X binaries on conda but I am travelling so I don’t have anything to update the linux builds with so I have asked Dan if he will do it when he has time. 

Let me know how you get on. 

Best wishes, 

Pete

****************************************************
* Dr Pete Bunting
* Reader in Remote Sensing
* Earth Observation and Ecosystem Dynamics Group
* Department of Geography and Earth Sciences
* Aberystwyth University
* Aberystwyth
* Ceredigion
* SY23 3DB
* UK

* Ph: +44 (0) 1970 622615
* Mob: +44 (0) 7917 842743
* Email: p...@aber.ac.uk
* ORCID: http://orcid.org/0000-0002-7435-0148
****************************************************
"Please consider the environment before printing this email or any documents attached”

On 4 May 2016, at 17:49, Rodrigo Pereira da Silva <rodrigofl...@gmail.com> wrote:

Dear Dr. Pete Bunting,

Yes, I can provide the sample data that I have. 

You can use this link to download the rapideye imagery with the JSON format metadata: https://drive.google.com/open?id=0B2yzkZ0qRIsoYUJKeTdFc3dwMzA

You can use this link to download the rapideye imagery with the XML format metadata: https://drive.google.com/open?id=0B2yzkZ0qRIsoV2Nld2NScEloMEU

It would be interesting to have the tool for both metadata format (or to have two different tools for each format), once it is important to analyse changes through time. So far, planet labs and blackbridge release metadata in different formats, but some people say that in the future rapideye metadata will be only in JSON format. 


Thank you very much for your attention.

I will stay tuned. And once again, congratulations for your work. 

Regards,
Rodrigo. 

Daniel Clewley

unread,
May 13, 2016, 8:19:42 AM5/13/16
to Pete Bunting, Rodrigo Pereira da Silva, RSGISLib Support
Hi Rodrigo,

I’ve updated the conda builds for Linux (Python 3.5). You can update your system using:

conda update -c osgeo arcsi

Thanks,

Dan

Rodrigo Pereira da Silva

unread,
May 16, 2016, 10:36:44 PM5/16/16
to RSGISLib Support
Thank you very much Pete and Dan!

It is working!

Congratulations for your work, You have made an amazing job for the scientific community. 
I hope one day I can meet you all in person. 

Thank you very much. 

Regards, 
Rodrigo. 
Reply all
Reply to author
Forward
0 new messages