Satpy 'true_color' composite issue

[Andy Prata]

Dear Pytroll Team

I have recently installed the satpy package; however, I’m running into trouble when I try to output himawari hsd data to png using the ‘true_color’ band combination. Here’s the code I’m using:

from satpy.scene import Scene

from datetime import datetime, timedelta

ppp_config_directory = "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/satpy-0.7.4-py2.7.egg/satpy/etc/"

path = "/Users/andyprata/Documents/python/himawari-8/hsd"

path_output = "/Users/andyprata/Documents/python/himawari-8/png/"

time_slot = datetime(2017, 11, 26, 23)

time_slot_str = time_slot.strftime("%Y%m%d%H%M")

fn_out = 'global_hima_'+time_slot_str

print "Processing: "+time_slot_str

global_scene = Scene(platform_name="Himawari-8",

                     sensor="ahi",

                     reader="ahi_hsd",

                     start_time=time_slot,

                     end_time=time_slot + timedelta(minutes=10),

                     base_dir=path,

                     ppp_config_dir=ppp_config_directory)

rgb_composite = 'true_color'

print "Loading composite: "+rgb_composite

global_scene.load([rgb_composite])

print "Saving file..."

global_scene.save_dataset(rgb_composite, path_output+fn_out+'_'+rgb_composite+'.png')

print "Done. File saved here: " + path_output+fn_out+'_'+rgb_composite+'.png'

And here’s output (and the error) I’m getting when I run the script (in iPython):

run plot_himawari_global.py

Processing: 201711262300

Loading composite: true_color

No handlers could be found for logger "satpy.scene"

Saving file...

Traceback (most recent call last):

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/IPython/core/interactiveshell.py", line 2481, in safe_execfile

self.compile if kw['shell_futures'] else None)

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/IPython/utils/py3compat.py", line 289, in execfile

    builtin_mod.execfile(filename, *where)

  File "/Users/andyprata/PycharmProjects/himawari/src/plot_himawari_global.py", line 26, in <module>

    print "Done. File saved here: " + path_output+fn_out+'_'+rgb_composite+'.png'

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/satpy-0.7.4-py2.7.egg/satpy/scene.py", line 622, in save_dataset

    writer.save_dataset(self[dataset_id],

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/satpy-0.7.4-py2.7.egg/satpy/scene.py", line 303, in __getitem__

    return self.datasets[key]

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/satpy-0.7.4-py2.7.egg/satpy/readers/__init__.py", line 182, in __getitem__

    raise KeyError("No dataset matching '{}' found".format(str(item)))

KeyError: "No dataset matching 'true_color' found"

Any help/advice would be much appreciated.

Thanks in advance

Andy 

[David Hoese]

Hi Andy,

Could you please try turning on debug log output and provide us with the
new output from running your script? Add `from satpy.utils import
debug_on; debug_on()` to the top of your script. Thanks.

Dave

> self.compile <http://self.compile> if kw['shell_futures'] else None)

> --
> You received this message because you are subscribed to the Google
> Groups "pytroll" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to pytroll+u...@googlegroups.com
> <mailto:pytroll+u...@googlegroups.com>.
> For more options, visit https://groups.google.com/d/optout.

[Andy Prata]

Hi David

Thanks for quick response. Here's the output:

Processing: 201711262300

[DEBUG: 2017-12-13 08:11:43 : satpy.scene] Setting 'PPP_CONFIG_DIR' to '/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/satpy-0.7.4-py2.7.egg/satpy/etc/'

[DEBUG: 2017-12-13 08:11:43 : satpy.readers] Reading ['/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/satpy-0.7.4-py2.7.egg/satpy/etc/readers/ahi_hsd.yaml', '/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/satpy-0.7.4-py2.7.egg/satpy/etc/readers/ahi_hsd.yaml', '/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/satpy-0.7.4-py2.7.egg/satpy/etc/readers/ahi_hsd.yaml']

Backend MacOSX is interactive backend. Turning interactive mode on.

/Applications/PyCharm CE.app/Contents/helpers/pydev/_pydev_bundle/pydev_import_hook.py:20: FutureWarning: The pandas.tslib module is deprecated and will be removed in a future version.

  module = self._system_import(name, *args, **kwargs)

[DEBUG: 2017-12-13 08:11:44 : satpy.readers.yaml_reader] Assigning to ahi_hsd: ['/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B12_FLDK_R20_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B12_FLDK_R20_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B12_FLDK_R20_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B12_FLDK_R20_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B12_FLDK_R20_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B12_FLDK_R20_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B12_FLDK_R20_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B12_FLDK_R20_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B12_FLDK_R20_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B12_FLDK_R20_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B13_FLDK_R20_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B13_FLDK_R20_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B13_FLDK_R20_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B13_FLDK_R20_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B13_FLDK_R20_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B13_FLDK_R20_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B13_FLDK_R20_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B13_FLDK_R20_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B13_FLDK_R20_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B13_FLDK_R20_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B10_FLDK_R20_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B10_FLDK_R20_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B10_FLDK_R20_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B10_FLDK_R20_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B10_FLDK_R20_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B10_FLDK_R20_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B10_FLDK_R20_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B10_FLDK_R20_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B10_FLDK_R20_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B10_FLDK_R20_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B11_FLDK_R20_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B11_FLDK_R20_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B11_FLDK_R20_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B11_FLDK_R20_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B11_FLDK_R20_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B11_FLDK_R20_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B11_FLDK_R20_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B11_FLDK_R20_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B11_FLDK_R20_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B11_FLDK_R20_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B16_FLDK_R20_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B16_FLDK_R20_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B16_FLDK_R20_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B16_FLDK_R20_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B16_FLDK_R20_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B16_FLDK_R20_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B16_FLDK_R20_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B16_FLDK_R20_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B16_FLDK_R20_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B16_FLDK_R20_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B03_FLDK_R05_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B03_FLDK_R05_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B03_FLDK_R05_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B03_FLDK_R05_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B03_FLDK_R05_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B03_FLDK_R05_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B03_FLDK_R05_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B03_FLDK_R05_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B03_FLDK_R05_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B03_FLDK_R05_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B14_FLDK_R20_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B14_FLDK_R20_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B14_FLDK_R20_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B14_FLDK_R20_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B14_FLDK_R20_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B14_FLDK_R20_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B14_FLDK_R20_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B14_FLDK_R20_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B14_FLDK_R20_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B14_FLDK_R20_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B04_FLDK_R10_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B04_FLDK_R10_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B04_FLDK_R10_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B04_FLDK_R10_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B04_FLDK_R10_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B04_FLDK_R10_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B04_FLDK_R10_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B04_FLDK_R10_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B04_FLDK_R10_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B04_FLDK_R10_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B02_FLDK_R10_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B02_FLDK_R10_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B02_FLDK_R10_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B02_FLDK_R10_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B02_FLDK_R10_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B02_FLDK_R10_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B02_FLDK_R10_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B02_FLDK_R10_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B02_FLDK_R10_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B02_FLDK_R10_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B09_FLDK_R20_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B09_FLDK_R20_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B09_FLDK_R20_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B09_FLDK_R20_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B09_FLDK_R20_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B09_FLDK_R20_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B09_FLDK_R20_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B09_FLDK_R20_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B09_FLDK_R20_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B09_FLDK_R20_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B07_FLDK_R20_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B07_FLDK_R20_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B07_FLDK_R20_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B07_FLDK_R20_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B07_FLDK_R20_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B07_FLDK_R20_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B07_FLDK_R20_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B07_FLDK_R20_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B07_FLDK_R20_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B07_FLDK_R20_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B08_FLDK_R20_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B08_FLDK_R20_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B08_FLDK_R20_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B08_FLDK_R20_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B08_FLDK_R20_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B08_FLDK_R20_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B08_FLDK_R20_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B08_FLDK_R20_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B08_FLDK_R20_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B08_FLDK_R20_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B06_FLDK_R20_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B06_FLDK_R20_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B06_FLDK_R20_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B06_FLDK_R20_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B06_FLDK_R20_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B06_FLDK_R20_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B06_FLDK_R20_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B06_FLDK_R20_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B06_FLDK_R20_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B06_FLDK_R20_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B05_FLDK_R20_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B05_FLDK_R20_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B05_FLDK_R20_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B05_FLDK_R20_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B05_FLDK_R20_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B05_FLDK_R20_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B05_FLDK_R20_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B05_FLDK_R20_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B05_FLDK_R20_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B05_FLDK_R20_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B01_FLDK_R10_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B01_FLDK_R10_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B01_FLDK_R10_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B01_FLDK_R10_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B01_FLDK_R10_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B01_FLDK_R10_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B01_FLDK_R10_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B01_FLDK_R10_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B01_FLDK_R10_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B01_FLDK_R10_S1010.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B15_FLDK_R20_S0110.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B15_FLDK_R20_S0210.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B15_FLDK_R20_S0310.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B15_FLDK_R20_S0410.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B15_FLDK_R20_S0510.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B15_FLDK_R20_S0610.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B15_FLDK_R20_S0710.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B15_FLDK_R20_S0810.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B15_FLDK_R20_S0910.DAT', '/Users/andyprata/Documents/python/himawari-8/hsd/HS_H08_20171126_2300_B15_FLDK_R20_S1010.DAT']

[DEBUG: 2017-12-13 08:11:45 : satpy.composites] Looking for composites config file ahi.yaml

[DEBUG: 2017-12-13 08:11:45 : satpy.composites] Looking for composites config file visir.yaml

[DEBUG: 2017-12-13 08:11:45 : satpy.node] Skipping optional satellite_azimuth_angle: Unknown dataset satellite_azimuth_angle

[DEBUG: 2017-12-13 08:11:45 : satpy.node] Skipping optional satellite_zenith_angle: Unknown dataset satellite_zenith_angle

[DEBUG: 2017-12-13 08:11:45 : satpy.node] Skipping optional solar_azimuth_angle: Unknown dataset solar_azimuth_angle

[DEBUG: 2017-12-13 08:11:45 : satpy.node] Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle

[DEBUG: 2017-12-13 08:11:45 : satpy.node] Skipping optional satellite_azimuth_angle: Unknown dataset satellite_azimuth_angle

[DEBUG: 2017-12-13 08:11:45 : satpy.node] Skipping optional satellite_zenith_angle: Unknown dataset satellite_zenith_angle

[DEBUG: 2017-12-13 08:11:45 : satpy.node] Skipping optional solar_azimuth_angle: Unknown dataset solar_azimuth_angle

[DEBUG: 2017-12-13 08:11:45 : satpy.node] Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle

[DEBUG: 2017-12-13 08:11:45 : satpy.node] Skipping optional satellite_azimuth_angle: Unknown dataset satellite_azimuth_angle

[DEBUG: 2017-12-13 08:11:45 : satpy.node] Skipping optional satellite_zenith_angle: Unknown dataset satellite_zenith_angle

[DEBUG: 2017-12-13 08:11:45 : satpy.node] Skipping optional solar_azimuth_angle: Unknown dataset solar_azimuth_angle

[DEBUG: 2017-12-13 08:11:45 : satpy.node] Skipping optional solar_zenith_angle: Unknown dataset solar_zenith_angle

[DEBUG: 2017-12-13 08:11:45 : ahi_hsd] Band number = 2

[DEBUG: 2017-12-13 08:11:45 : ahi_hsd] Time_interval: 2017-11-26 23:00:20.973500 - 2017-11-26 23:00:54.326313

Loading composite: true_color

[DEBUG: 2017-12-13 08:11:45 : ahi_hsd] Reading time 0:00:00.193627

[DEBUG: 2017-12-13 08:11:45 : ahi_hsd] Calibration time 0:00:00.110694

[DEBUG: 2017-12-13 08:11:45 : ahi_hsd] Band number = 2

[DEBUG: 2017-12-13 08:11:45 : ahi_hsd] Time_interval: 2017-11-26 23:00:54.326313 - 2017-11-26 23:01:41.013344

[DEBUG: 2017-12-13 08:11:45 : ahi_hsd] Reading time 0:00:00.155941

[DEBUG: 2017-12-13 08:11:45 : ahi_hsd] Calibration time 0:00:00.071942

[DEBUG: 2017-12-13 08:11:45 : ahi_hsd] Band number = 2

[DEBUG: 2017-12-13 08:11:45 : ahi_hsd] Time_interval: 2017-11-26 23:01:41.013344 - 2017-11-26 23:03:06.686808

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Reading time 0:00:00.113030

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Calibration time 0:00:00.073765

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Band number = 2

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Time_interval: 2017-11-26 23:02:38.281916 - 2017-11-26 23:04:04.554755

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Reading time 0:00:00.134401

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Calibration time 0:00:00.049030

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Band number = 2

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Time_interval: 2017-11-26 23:04:04.554755 - 2017-11-26 23:05:05.256775

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Reading time 0:00:00.173690

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Calibration time 0:00:00.043923

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Band number = 2

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Time_interval: 2017-11-26 23:05:05.256775 - 2017-11-26 23:06:03.798095

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Reading time 0:00:00.124230

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Calibration time 0:00:00.059091

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Band number = 2

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Time_interval: 2017-11-26 23:06:03.798095 - 2017-11-26 23:07:32.288376

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Reading time 0:00:00.164263

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Calibration time 0:00:00.047083

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Band number = 2

[DEBUG: 2017-12-13 08:11:46 : ahi_hsd] Time_interval: 2017-11-26 23:07:32.288376 - 2017-11-26 23:08:27.529436

[DEBUG: 2017-12-13 08:11:47 : ahi_hsd] Reading time 0:00:00.137452

[DEBUG: 2017-12-13 08:11:47 : ahi_hsd] Calibration time 0:00:00.044242

[DEBUG: 2017-12-13 08:11:47 : ahi_hsd] Band number = 2

[DEBUG: 2017-12-13 08:11:47 : ahi_hsd] Time_interval: 2017-11-26 23:08:27.529436 - 2017-11-26 23:09:06.932722

[DEBUG: 2017-12-13 08:11:47 : ahi_hsd] Reading time 0:00:00.205363

[DEBUG: 2017-12-13 08:11:47 : ahi_hsd] Calibration time 0:00:00.043556

[DEBUG: 2017-12-13 08:11:47 : ahi_hsd] Band number = 2

[DEBUG: 2017-12-13 08:11:47 : ahi_hsd] Time_interval: 2017-11-26 23:09:06.932722 - 2017-11-26 23:09:40.369401

[DEBUG: 2017-12-13 08:11:47 : ahi_hsd] Reading time 0:00:00.117313

[DEBUG: 2017-12-13 08:11:47 : ahi_hsd] Calibration time 0:00:00.038690

[DEBUG: 2017-12-13 08:11:47 : ahi_hsd] Band number = 3

[DEBUG: 2017-12-13 08:11:47 : ahi_hsd] Time_interval: 2017-11-26 23:00:20.463234 - 2017-11-26 23:00:53.818510

[DEBUG: 2017-12-13 08:11:48 : ahi_hsd] Reading time 0:00:00.652276

[DEBUG: 2017-12-13 08:11:48 : ahi_hsd] Calibration time 0:00:00.244677

[DEBUG: 2017-12-13 08:11:48 : ahi_hsd] Band number = 3

[DEBUG: 2017-12-13 08:11:48 : ahi_hsd] Time_interval: 2017-11-26 23:00:53.818510 - 2017-11-26 23:01:40.503078

[DEBUG: 2017-12-13 08:11:48 : ahi_hsd] Reading time 0:00:00.574517

[DEBUG: 2017-12-13 08:11:49 : ahi_hsd] Calibration time 0:00:00.245405

[DEBUG: 2017-12-13 08:11:49 : ahi_hsd] Band number = 3

[DEBUG: 2017-12-13 08:11:49 : ahi_hsd] Time_interval: 2017-11-26 23:01:40.503078 - 2017-11-26 23:03:06.179013

[DEBUG: 2017-12-13 08:11:49 : ahi_hsd] Reading time 0:00:00.556987

[DEBUG: 2017-12-13 08:11:49 : ahi_hsd] Calibration time 0:00:00.201938

[DEBUG: 2017-12-13 08:11:49 : ahi_hsd] Band number = 3

[DEBUG: 2017-12-13 08:11:49 : ahi_hsd] Time_interval: 2017-11-26 23:02:37.771647 - 2017-11-26 23:04:04.044488

[DEBUG: 2017-12-13 08:11:50 : ahi_hsd] Reading time 0:00:00.548964

[DEBUG: 2017-12-13 08:11:50 : ahi_hsd] Calibration time 0:00:00.216083

[DEBUG: 2017-12-13 08:11:50 : ahi_hsd] Band number = 3

[DEBUG: 2017-12-13 08:11:50 : ahi_hsd] Time_interval: 2017-11-26 23:04:04.044488 - 2017-11-26 23:05:04.746512

[DEBUG: 2017-12-13 08:11:51 : ahi_hsd] Reading time 0:00:00.558015

[DEBUG: 2017-12-13 08:11:51 : ahi_hsd] Calibration time 0:00:00.189608

[DEBUG: 2017-12-13 08:11:51 : ahi_hsd] Band number = 3

[DEBUG: 2017-12-13 08:11:51 : ahi_hsd] Time_interval: 2017-11-26 23:05:04.746512 - 2017-11-26 23:06:03.287826

[DEBUG: 2017-12-13 08:11:52 : ahi_hsd] Reading time 0:00:00.575057

[DEBUG: 2017-12-13 08:11:52 : ahi_hsd] Calibration time 0:00:00.198999

[DEBUG: 2017-12-13 08:11:52 : ahi_hsd] Band number = 3

[DEBUG: 2017-12-13 08:11:52 : ahi_hsd] Time_interval: 2017-11-26 23:06:03.287826 - 2017-11-26 23:07:31.778106

[DEBUG: 2017-12-13 08:11:52 : ahi_hsd] Reading time 0:00:00.575114

[DEBUG: 2017-12-13 08:11:53 : ahi_hsd] Calibration time 0:00:00.179162

[DEBUG: 2017-12-13 08:11:53 : ahi_hsd] Band number = 3

[DEBUG: 2017-12-13 08:11:53 : ahi_hsd] Time_interval: 2017-11-26 23:07:31.778106 - 2017-11-26 23:08:27.021637

[DEBUG: 2017-12-13 08:11:53 : ahi_hsd] Reading time 0:00:00.578907

[DEBUG: 2017-12-13 08:11:53 : ahi_hsd] Calibration time 0:00:00.206821

[DEBUG: 2017-12-13 08:11:53 : ahi_hsd] Band number = 3

[DEBUG: 2017-12-13 08:11:53 : ahi_hsd] Time_interval: 2017-11-26 23:08:27.021637 - 2017-11-26 23:09:06.424922

[DEBUG: 2017-12-13 08:11:54 : ahi_hsd] Reading time 0:00:00.588638

[DEBUG: 2017-12-13 08:11:54 : ahi_hsd] Calibration time 0:00:00.165141

[DEBUG: 2017-12-13 08:11:54 : ahi_hsd] Band number = 3

[DEBUG: 2017-12-13 08:11:54 : ahi_hsd] Time_interval: 2017-11-26 23:09:06.424922 - 2017-11-26 23:09:39.859132

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Reading time 0:00:00.614795

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Calibration time 0:00:00.203909

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Band number = 4

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Time_interval: 2017-11-26 23:00:20.125002 - 2017-11-26 23:00:53.477816

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Reading time 0:00:00.129300

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Calibration time 0:00:00.062226

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Band number = 4

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Time_interval: 2017-11-26 23:00:53.477816 - 2017-11-26 23:01:40.164846

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Reading time 0:00:00.182081

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Calibration time 0:00:00.057716

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Band number = 4

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Time_interval: 2017-11-26 23:01:40.164846 - 2017-11-26 23:03:05.838311

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Reading time 0:00:00.108243

[DEBUG: 2017-12-13 08:11:55 : ahi_hsd] Calibration time 0:00:00.062033

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Band number = 4

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Time_interval: 2017-11-26 23:02:37.433418 - 2017-11-26 23:04:03.706260

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Reading time 0:00:00.139882

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Calibration time 0:00:00.060323

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Band number = 4

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Time_interval: 2017-11-26 23:04:03.706260 - 2017-11-26 23:05:04.408279

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Reading time 0:00:00.144229

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Calibration time 0:00:00.050220

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Band number = 4

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Time_interval: 2017-11-26 23:05:04.408279 - 2017-11-26 23:06:02.949598

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Reading time 0:00:00.174111

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Calibration time 0:00:00.048299

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Band number = 4

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Time_interval: 2017-11-26 23:06:02.949598 - 2017-11-26 23:07:31.439878

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Reading time 0:00:00.121558

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Calibration time 0:00:00.046551

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Band number = 4

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Time_interval: 2017-11-26 23:07:31.439878 - 2017-11-26 23:08:26.680939

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Reading time 0:00:00.159227

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Calibration time 0:00:00.045203

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Band number = 4

[DEBUG: 2017-12-13 08:11:56 : ahi_hsd] Time_interval: 2017-11-26 23:08:26.680939 - 2017-11-26 23:09:06.084225

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Reading time 0:00:00.163449

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Calibration time 0:00:00.057529

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Band number = 4

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Time_interval: 2017-11-26 23:09:06.084225 - 2017-11-26 23:09:39.520903

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Reading time 0:00:00.135433

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Calibration time 0:00:00.048864

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Band number = 1

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Time_interval: 2017-11-26 23:00:20.724374 - 2017-11-26 23:00:54.077188

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Reading time 0:00:00.181968

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Calibration time 0:00:00.047884

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Band number = 1

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Time_interval: 2017-11-26 23:00:54.077188 - 2017-11-26 23:01:40.764218

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Reading time 0:00:00.123175

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Calibration time 0:00:00.046694

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Band number = 1

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Time_interval: 2017-11-26 23:01:40.764218 - 2017-11-26 23:03:06.437685

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Reading time 0:00:00.146148

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Calibration time 0:00:00.046075

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Band number = 1

[DEBUG: 2017-12-13 08:11:57 : ahi_hsd] Time_interval: 2017-11-26 23:02:38.032790 - 2017-11-26 23:04:04.305629

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Reading time 0:00:00.172460

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Calibration time 0:00:00.059793

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Band number = 1

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Time_interval: 2017-11-26 23:04:04.305629 - 2017-11-26 23:05:05.007653

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Reading time 0:00:00.102585

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Calibration time 0:00:00.041060

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Band number = 1

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Time_interval: 2017-11-26 23:05:05.007653 - 2017-11-26 23:06:03.548969

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Reading time 0:00:00.152382

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Calibration time 0:00:00.042064

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Band number = 1

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Time_interval: 2017-11-26 23:06:03.548969 - 2017-11-26 23:07:32.039250

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Reading time 0:00:00.181912

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Calibration time 0:00:00.041424

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Band number = 1

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Time_interval: 2017-11-26 23:07:32.039250 - 2017-11-26 23:08:27.280314

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Reading time 0:00:00.105040

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Calibration time 0:00:00.040657

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Band number = 1

[DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Time_interval: 2017-11-26 23:08:27.280314 - 2017-11-26 23:09:06.683596

[DEBUG: 2017-12-13 08:11:59 : ahi_hsd] Reading time 0:00:00.187443

[DEBUG: 2017-12-13 08:11:59 : ahi_hsd] Calibration time 0:00:00.039965

[DEBUG: 2017-12-13 08:11:59 : ahi_hsd] Band number = 1

[DEBUG: 2017-12-13 08:11:59 : ahi_hsd] Time_interval: 2017-11-26 23:09:06.683596 - 2017-11-26 23:09:40.120275

[DEBUG: 2017-12-13 08:11:59 : ahi_hsd] Reading time 0:00:00.124128

[DEBUG: 2017-12-13 08:11:59 : ahi_hsd] Calibration time 0:00:00.042704

[INFO: 2017-12-13 08:11:59 : satpy.composites.ahi] Reducing datasize by a factor 2.

[DEBUG: 2017-12-13 08:11:59 : satpy.composites] Applying sun zen correction

[DEBUG: 2017-12-13 08:11:59 : satpy.composites] Computing sun zenith angles.

[DEBUG: 2017-12-13 08:12:36 : satpy.composites] Apply the standard sun-zenith correction [1/cos(sunz)]

[DEBUG: 2017-12-13 08:12:47 : satpy.composites] Sun-zenith correction applied. Computation time:  48.1 (sec)

[INFO: 2017-12-13 08:12:47 : satpy.composites.ahi] Reducing datasize by a factor 2.

[DEBUG: 2017-12-13 08:12:47 : satpy.composites] Applying sun zen correction

[DEBUG: 2017-12-13 08:12:47 : satpy.composites] Computing sun zenith angles.

[DEBUG: 2017-12-13 08:12:55 : satpy.composites] Apply the standard sun-zenith correction [1/cos(sunz)]

[DEBUG: 2017-12-13 08:12:57 : satpy.composites] Sun-zenith correction applied. Computation time:  10.3 (sec)

[WARNING: 2017-12-13 08:12:58 : satpy.scene] Delaying generation of DatasetID(name=None, wavelength=0.65, resolution=None, polarization=None, calibration=None, modifiers=('reducer2', 'sunz_corrected', 'rayleigh_corrected')) because of incompatible areas

[WARNING: 2017-12-13 08:12:58 : satpy.scene] Delaying generation of DatasetID(name='true_color', wavelength=None, resolution=None, polarization=None, calibration=None, modifiers=None) because of dependency's delayed generation: DatasetID(name=None, wavelength=0.65, resolution=None, polarization=None, calibration=None, modifiers=('reducer2', 'sunz_corrected', 'rayleigh_corrected'))

[WARNING: 2017-12-13 08:12:58 : satpy.scene] Missing prerequisite for 'DatasetID(name='true_color', wavelength=None, resolution=None, polarization=None, calibration=None, modifiers=None)': 'DatasetID(name=None, wavelength=0.65, resolution=None, polarization=None, calibration=None, modifiers=('reducer2', 'sunz_corrected', 'rayleigh_corrected'))'

[INFO: 2017-12-13 08:12:58 : satpy.composites.ahi] Boosting vegetation on green band

[DEBUG: 2017-12-13 08:13:01 : satpy.composites] Applying sun zen correction

[DEBUG: 2017-12-13 08:13:01 : satpy.composites] Computing sun zenith angles.

[DEBUG: 2017-12-13 08:13:39 : satpy.composites] Apply the standard sun-zenith correction [1/cos(sunz)]

[DEBUG: 2017-12-13 08:13:49 : satpy.composites] Sun-zenith correction applied. Computation time:  48.7 (sec)

[WARNING: 2017-12-13 08:13:49 : satpy.scene] Delaying generation of DatasetID(name=None, wavelength=0.65, resolution=None, polarization=None, calibration=None, modifiers=('reducer2', 'sunz_corrected', 'rayleigh_corrected')) because of incompatible areas

[WARNING: 2017-12-13 08:13:49 : satpy.scene] Delaying generation of DatasetID(name=None, wavelength=0.51, resolution=None, polarization=None, calibration=None, modifiers=('vegetation_corrected', 'sunz_corrected', 'rayleigh_corrected')) because of incompatible areas

[DEBUG: 2017-12-13 08:13:49 : satpy.composites] Applying sun zen correction

[DEBUG: 2017-12-13 08:13:49 : satpy.composites] Interpolating coszen calculations for higher resolution band

[DEBUG: 2017-12-13 08:13:54 : satpy.composites] Apply the standard sun-zenith correction [1/cos(sunz)]

[DEBUG: 2017-12-13 08:14:07 : satpy.composites] Sun-zenith correction applied. Computation time:  18.1 (sec)

[WARNING: 2017-12-13 08:14:07 : satpy.scene] Delaying generation of DatasetID(name=None, wavelength=0.46, resolution=None, polarization=None, calibration=None, modifiers=('sunz_corrected', 'rayleigh_corrected')) because of incompatible areas

[WARNING: 2017-12-13 08:14:07 : satpy.scene] The following datasets were not created: DatasetID(name='true_color', wavelength=None, resolution=None, polarization=None, calibration=None, modifiers=None)

Saving file...

Traceback (most recent call last):

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/IPython/core/interactiveshell.py", line 2481, in safe_execfile

    self.compile if kw['shell_futures'] else None)

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/IPython/utils/py3compat.py", line 289, in execfile

    builtin_mod.execfile(filename, *where)

  File "/Users/andyprata/PycharmProjects/himawari/src/plot_himawari_global.py", line 38, in <module>

    global_scene.save_dataset(rgb_composite, path_output+fn_out+'_'+rgb_composite+'.png')

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/satpy-0.7.4-py2.7.egg/satpy/scene.py", line 622, in save_dataset

    writer.save_dataset(self[dataset_id],

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/satpy-0.7.4-py2.7.egg/satpy/scene.py", line 303, in __getitem__

    return self.datasets[key]

  File "/opt/local/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/site-packages/satpy-0.7.4-py2.7.egg/satpy/readers/__init__.py", line 182, in __getitem__

    raise KeyError("No dataset matching '{}' found".format(str(item)))

KeyError: "No dataset matching 'true_color' found"

[David Hoese]

Hi Andy,

I'm wondering if your HSD files have different resolutions than what we expect. The true color compositor makes some assumptions about the resolution of each of the input datasets and this could be causing an issue. You can see in the log output references to "reducer2" and other components that are trying to make the input bands the same size by reducing the resolution of the input bands. This was a quick hack when first developed to get RGB composites quickly and has worked for most of us up until now.

If your bands are not the typical full resolutions (1km, 1km, 500m, 1km, 2km, etc) then a quick workaround may be to do the following after the `.load` call:

local_scene = global_scene.resample(global_scene['B03'].info['area'])

After this there *should* be a `true_color` dataset available in `local_scene`. If this doesn't work let me know and we'll have to figure out a long term solution. Thanks for your patience.

Dave

> > an email to pytroll+u...@googlegroups.com <javascript:>
> > <mailto:pytroll+u...@googlegroups.com <javascript:>>.

> > For more options, visit https://groups.google.com/d/optout

> <https://groups.google.com/d/optout>.

[Andy Prata]

Hi Dave

I tried the workaround and everything ran smoothly. However, the true colour output file doesn't look right. I've reduced its size (using Imagemagik) and attached it as a jpg.

I've also attached the 'true_color_raw' output (which does look right) for the same data for comparison. Finally, I've attached the debug output as well in a txt file.

I don't suppose you have some test hsd files that I could try? Currently, I download the himawari hsd data from the jaxa ftp site (ftp.ptree.jaxa.jp).

Cheers

Andy

>      >...

[Adam Dybbroe]

Andy and Dave,

Could you have a look at the notebook example here:

https://github.com/pytroll/pytroll-examples/blob/master/satpy/ahi_true_color_pyspectral.ipynb

This is using the "reducedsize" rgb.

I saw that I had adapted the ahi.yaml here locally, but I have verified
the notebook now with the latest version from monday: v0.7.5

I will check a bit more on the other rgb-recipe that fails for you.

-Adam

On 12/12/2017 11:43 PM, Andy Prata wrote:
> Hi Dave
>
> I tried the workaround and everything ran smoothly. However, the true
> colour output file doesn't look right. I've reduced its size (using
> Imagemagik) and attached it as a jpg.
>
> I've also attached the 'true_color_raw' output (which does look right)
> for the same data for comparison. Finally, I've attached the debug
> output as well in a txt file.
>
> I don't suppose you have some test hsd files that I could try?
> Currently, I download the himawari hsd data from the jaxa ftp site

> (ftp.ptree.jaxa.jp <http://ftp.ptree.jaxa.jp>).

> --
> You received this message because you are subscribed to the Google
> Groups "pytroll" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to pytroll+u...@googlegroups.com
> <mailto:pytroll+u...@googlegroups.com>.
> For more options, visit https://groups.google.com/d/optout.

--
Adam Dybbroe,
Satellite Remote Sensing Scientist,
Numerical models and Remote Sensing,
Core Services, Swedish Meteorological and Hydrological Institute (SMHI)
www.pytroll.org
nwcsaf.smhi.se
www.smhi.se

[Andy Prata]

Hi Adam

Thanks for the response. I have installed the new version of satpy (0.7.5) and re-ran my script using 'true_color_reducedsize' for the rgb_composite string. Note: I also needed to comment out Dave's workaround, which is this line: local_scene = global_scene.resample(global_scene['B03'].info['area']) for the code to run without errors.

I've attached the output. It looks basically the same as before and quite different compared to the output of your jupyter noteboook example. I've also attached the new debug output.

Let me know if there's any other way I can test the code. Maybe you can point me to the hsd data that's used in the jupyter notebook for example?

Thanks for the help on this.

Cheers

Andy

>     "/opt/local/Library/Frameworks/Python.framework/Versions/2...

[Balthasar Indermuehle]

Hmm... your output shows a tremendous green excess. But mine look normal? https://weather.inside.net/sat/data/VIS_FD_2017-12-14_00-40-00_tn.png

I'm using   img = get_enhanced_image(scn['true_color_nosunz_norayleigh'])

Cheers

- Balthasar

--

You received this message because you are subscribed to the Google Groups "pytroll" group.

To unsubscribe from this group and stop receiving emails from it, send an email to pytroll+unsubscribe@googlegroups.com.

[Adam Dybbroe]

Hi Andy,

I am really sorry, I actually had a few small local adaptations that had
forgotten. So, I can indeed reproduce your poor looking RGB. I made a PR
and now it is merged. So, could you try again? Do a pull from the latest
develop on github.

Concerning the high resolution true color, this is another issue. You
are very welcome submitting an issue on satpy for that!

Best regards
Adam

[Andy Prata]

Hi Adam

Thanks for updating the code. The 'true_color_reducedsize' composite now works as expected (see attached).

I will add an issue to the satpy github for the high resolution 'true_color' composite. Although I'm not too familiar with the satpy code, I assume it would be a similar issue to the 'true_color_reducedsize' because when I use the 'true_color' composite I get an RGB with that greenish hue (maybe it's something to do with linear stretch vs. cira stretch?).

Thanks again

Andy

>      >      > [DEBUG: 2017-12-13 08:11:58 : ahi_hsd] Time_interval:...

[Adam Dybbroe]

Andy,

Sorry, again. I overlooked Dave's workaround, so didn't pay much
attention to the full resolution true color.

But, I assume you will get a compatible result if you replace "stretch"
by "cira_stretch" in the "true_color_ahi_default" setting in the
generic.yaml file under satpy/etc/enhancements/:

true_color_ahi_default:
standard_name: true_color_ahi
operations:
- name: cira_stretch

Can you just test that?


-Adam

[Adam Dybbroe]

Andy,

I must be tired. The yaml code section of relevance should look like this:

true_color_ahi_default:
standard_name: true_color_ahi
operations:
- name: cira_stretch

method: !!python/name:satpy.enhancements.cira_stretch

Good night!
-Adam

[Andy Prata]

Hi Adam

I tried your change and it now works! Thanks! For anyone that runs into this issue the change to generic.yaml was:

Original:

  true_color_ahi_default:

    standard_name: true_color_ahi

    operations:

    - name: stretch

      method: *stretchfun

      kwargs: {stretch: linear}

Updated:

  true_color_ahi_default:

    standard_name: true_color_ahi

    operations:

    - name: cira_stretch

      method: !!python/name:satpy.enhancements.cira_stretch

Cheers!

Andy

>>      >      >      > [DEBUG: 2017-12-13 08:11:45 : satp...