Reading MTSAT2 gridded geoss format

339 views
Skip to first unread message

Ace Santos

unread,
Mar 9, 2016, 12:39:57 AM3/9/16
to pytroll
Hello,

I am a new user in this group. I found this pytroll group which may help in what I am trying to do, as we are trying to process geostationary satellite data. I am an undergraduate student aiming to utilize MTSAT2 data. Does anyone here have an idea on reading accessing digital numbers of MTSAT2 data from the Japan Meteorological Agency (JMA)?The gridded geoss format seems to have been converted by the Chiba University from the HRIT format, or whatever format they have received probably from the JMA. The data from Chiba Uiversity is found here:


I am trying to use the radiance,reflecvtiy and other useful constants and information(which I am assuming we can convert from the digital numbers once we accessed using also pytroll) from MTSAT2 satellite data to arrive at other physical attributes. I have seen some packages like mipp and mpop which seems to be a great help. Am I on the right track?

I am truly in need of anything that might help me in my research. Any assistance would be greatly appreciated. 

I apologize for any inconvenience. Thank you.




Ace Santos

unread,
Mar 9, 2016, 7:43:13 AM3/9/16
to pytroll
Hello again everyone,

Just in case nobody here has an idea on how to process with geoss format of MTSAT 2, I am planning on using Himawari 8 HSD(Himawari Standard Data) format. I am using HSD format because I don't know where can I access HRIT of Himawari 8 as of now. Anyways, this is my plan if this is the case. I am currently studying how to use python, pytroll and its packages mpip and mpop and I am also trying to backread the other topics in this group related to MTSAT/Himawari satellite series. But if anyone here can also give a quick headstart on how do I proceed first or anything that might help, please let me know. My goal is the same as I have mentioned in the first message. I have also just started getting familiar with python , as I am not really a programmer. It is just required of me to use of this so that I may be able to process geostationary satellite imagery so bear with my ignorance. I apologize for any inconvenience and if this may sound not polite to you guys, but I am really in need of help right now. Thank you in advance. 

Best regards,
Ace Santos
BS Geodetic Engineering - Undergraduate Student
Department of Geodetic Engineering
College of Engineering
University of the Philippines Diliman Campus

Martin Raspaud

unread,
Mar 9, 2016, 9:59:58 AM3/9/16
to pytroll
Hello,

The gridded data you were referring to is unknown to me, and I don't think we have a reader for it  in pytroll (yet ?). You're very welcome to develop one if you feel like it, just look at the tutorial on the pytroll web page on how to build a custom reader.

Regarding the HSD data, I think my colleague Adam has a reader for it somewhere, he might even have posted it on this list a while ago. I will ask him when I have the chance.

Best regards,
Martin

--
You received this message because you are subscribed to the Google Groups "pytroll" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pytroll+u...@googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
--
Martin Raspaud, PhD
Software engineer
SMHI, SE-60176

Dybbroe Adam

unread,
Mar 9, 2016, 10:49:24 AM3/9/16
to pyt...@googlegroups.com
Hi,

Yes, I have a prototype reader for the Himawari standard format. I can post the latest version, which has been corrected recently for a bug in the ir calibration. It has to wait till I am online again, so tomorrow. Don't hesitate reminding me.

Adam

Sent from my iPhone

Adam Dybbroe

unread,
Mar 9, 2016, 3:47:23 PM3/9/16
to pyt...@googlegroups.com, Adam.D...@smhi.se
Ace, and others,

So, here is the latest version of the AHI SF reader I have.
Thanks to Michael Cooke, UK Met Office, for correcting a bug in the
radiance to Tb calculations.

I haven't tested it myself recently. But I hope it can be of help to you!

What I would in your situation is take this code attached and make a
reader for mpop out of it.

-Adam


On 03/09/2016 04:49 PM, Dybbroe Adam wrote:
> Hi,
>
> Yes, I have a prototype reader for the Himawari standard format. I can
> post the latest version, which has been corrected recently for a bug in
> the ir calibration. It has to wait till I am online again, so tomorrow.
> Don't hesitate reminding me.
>
> Adam
>
> Sent from my iPhone
>
> On 9 mars 2016, at 16:00, Martin Raspaud <martin....@smhi.se
>> <mailto:pytroll+u...@googlegroups.com>.
>> For more options, visit https://groups.google.com/d/optout.
>>
>> --
>> Martin Raspaud, PhD
>> Software engineer
>> SMHI, SE-60176
>>
>> --
>> You received this message because you are subscribed to the Google
>> Groups "pytroll" group.
>> To unsubscribe from this group and stop receiving emails from it, send
>> an email to pytroll+u...@googlegroups.com
>> <mailto:pytroll+u...@googlegroups.com>.
>> For more options, visit https://groups.google.com/d/optout.


--
Adam Dybbroe,
Satellite Remote Sensing Scientist,
Numerical models and Remote Sensing,
Core Services, Swedish Meteorological and Hydrological Institute (SMHI)
www.pytroll.org
nwcsaf.smhi.se
www.smhi.se
ahisf_reader.py

Ace Santos

unread,
Mar 9, 2016, 5:57:31 PM3/9/16
to pytroll, Adam.D...@smhi.se
Hello again,

Thank you very much Sir Martin and Sir Adam for the assistance. I apologize for any inconvenience I may have brought you. This information will be truly be helpful to what I am doing I hope you don't mind if I ask some time again in the future about this code if I encounter any problem figuring how this works. 

Best regards,
Ace Santos
BS Geodetic Engineering - Undergraduate Student
Department of Geodetic Engineering
College of Engineering
University of the Philippines - Diliman Campus

Martin Raspaud

unread,
Mar 10, 2016, 1:28:07 AM3/10/16
to pytroll, Adam.D...@smhi.se

No problem Ace, feel free to ask more, that's what the list is for.

Best regards
Martin


--
You received this message because you are subscribed to the Google Groups "pytroll" group.
To unsubscribe from this group and stop receiving emails from it, send an email to pytroll+u...@googlegroups.com.

For more options, visit https://groups.google.com/d/optout.

Balthasar Indermuehle

unread,
Sep 22, 2016, 9:26:31 AM9/22/16
to pytroll, Adam.D...@smhi.se
Hi Martin,

I've downloaded the ahisf reader and tried loading a HSD file downloaded from JMA. Unfortunately it doesn't seem to work out of the box. It recognises the band number, but there looks to be something amiss with the header information, possibly in the file? Here's the error it returns:

Band number = 1
ahisf_reader.py:293: VisibleDeprecationWarning: converting an array with ndim > 0 to an index will result in an error in the future
  dtype = np.dtype([('counts', '<u2', (nlines, ncols))])
Traceback (most recent call last):
  File "ahisf_reader.py", line 431, in <module>
    SCENE.calibrate(['13'])
  File "ahisf_reader.py", line 321, in calibrate
    calibrate)
  File "ahisf_reader.py", line 369, in _ir_calibrate
    band_number = header['block5']['band_number'][0]
TypeError: 'NoneType' object has no attribute '__getitem__'



Balthasar Indermuehle

unread,
Sep 22, 2016, 9:38:25 AM9/22/16
to pytroll, Adam.D...@smhi.se
disregard - I was making some false assumptions. Seems to work now when the correct channel numbers are used to calculate corrections!
Reply all
Reply to author
Forward
0 new messages