Please try ccc-gistemp release 0.6.0

4 views
Skip to first unread message

David Jones

unread,
Oct 25, 2010, 4:58:23 AM10/25/10
to ccc-giste...@googlegroups.com
I've just uploaded a new release of ccc-gistemp:

http://code.google.com/p/ccc-gistemp/downloads/detail?name=ccc-gistemp-0.6.0.tar.gz

Reports of success/failure using it would be most welcome.

I'm about to write a blog article describing the release.

Cheers,
drj

Greg Freemyer

unread,
Oct 27, 2010, 4:11:24 PM10/27/10
to ccc-giste...@googlegroups.com

David,

This is my first attempt to run ccc, but v0.6.0 did not work for me.
It could easily by I don't have python installed correctly, etc. (I'm
not a python programmer.)

This is linux opensuse 11.3 (the latest) with the default python for
the distro (python 2.6).

====
> python tool/run.py
/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/code/giss_data.py:188:
UserWarning: Could not load v2 GHCN metadata file: input/v2.inv
(format, path))

MISSING: input/antarc1.list
MISSING: input/antarc1.txt
MISSING: input/antarc2.list
MISSING: input/antarc2.txt
MISSING: input/antarc3.list
MISSING: input/antarc3.txt
MISSING: input/t_hohenpeissenberg_200306.txt_as_received_July17_2003
MISSING: input/ushcn2.tbl
MISSING: input/ushcnV2_cmb.tbl
MISSING: input/mcdw.tbl
MISSING: input/ushcn2.tbl
MISSING: input/sumofday.tbl
MISSING: input/v2.inv
MISSING: input/oisstv2_mod4.clim.gz
MISSING: input/v2.mean
MISSING: input/ushcnv2
MISSING: input/SBBX.HadR2
Attempting to fetch missing files: antarc1.list antarc1.txt
antarc2.list antarc2.txt antarc3.list antarc3.txt
t_hohenpeissenberg_200306.txt_as_received_July17_2003 ushcn2.tbl
ushcnV2_cmb.tbl mcdw.tbl ushcn2.tbl sumofday.tbl v2.inv
oisstv2_mod4.clim.gz v2.mean ushcnv2 SBBX.HadR2
GISTEMP_sources.tar.gz
http://data.giss.nasa.gov/gistemp/sources/GISTEMP_sources.tar.gz
1804926/1804926 [100%]
Extracting members from
http://data.giss.nasa.gov/gistemp/sources/GISTEMP_sources.tar.gz ...
... antarc1.list from GISTEMP_sources/STEP0/input_files/antarc1.list.
... antarc1.txt from GISTEMP_sources/STEP0/input_files/antarc1.txt.
... antarc2.list from GISTEMP_sources/STEP0/input_files/antarc2.list.
... antarc2.txt from GISTEMP_sources/STEP0/input_files/antarc2.txt.
... antarc3.list from GISTEMP_sources/STEP0/input_files/antarc3.list.
... antarc3.txt from GISTEMP_sources/STEP0/input_files/antarc3.txt.
... ushcn2.tbl from GISTEMP_sources/STEP0/input_files/ushcn2.tbl.
... t_hohenpeissenberg_200306.txt_as_received_July17_2003 from
GISTEMP_sources/STEP0/input_files/t_hohenpeissenberg_200306.txt_as_received_July17_2003.
... ushcnV2_cmb.tbl from GISTEMP_sources/STEP0/input_files/ushcnV2_cmb.tbl.
... mcdw.tbl from GISTEMP_sources/STEP1/input_files/mcdw.tbl.
... sumofday.tbl from GISTEMP_sources/STEP1/input_files/sumofday.tbl.
... v2.inv from GISTEMP_sources/STEP1/input_files/v2.inv.
... oisstv2_mod4.clim.gz from
GISTEMP_sources/STEP4_5/input_files/oisstv2_mod4.clim.gz.
... finished extracting
SBBX.HadR2 ftp://data.giss.nasa.gov/pub/gistemp/SBBX.HadR2
34260584/34260584 [100%]
ushcnv2.gz ftp://ftp.ncdc.noaa.gov/pub/data/ushcn/v2/monthly/9641C_201010_F52.avg.gz
3942452/3942452 [100%]
v2.mean.zip ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/v2/zipd/v2.mean.zip
11209428/11209428 [100%]
Extracting members from
ftp://ftp.ncdc.noaa.gov/pub/data/ghcn/v2/zipd/v2.mean.zip ...
... finished extracting
OK: Fetching missing files looks like it worked
... creating directory log
... creating directory result
... creating directory work
====> STEPS 0, 1, 2, 3, 4, 5 ====
No more recent sea-surface data files.

Load GHCN records
Load USHCN records
(Reading average temperature)
Load SCAR records
Correct the GHCN Hohenpeissenberg record.
Adjust USHCN records
1 USHCN records had no GHCN counterpart.
Traceback (most recent call last):
File "tool/run.py", line 280, in <module>
sys.exit(main())
File "tool/run.py", line 261, in main
data = step_fn[step](data)
File "tool/run.py", line 104, in run_step5
result = step5.step5(data)
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/code/step5.py", line
443, in step5
return annzon(zoned_averages)
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/code/step5.py", line
320, in annzon
(tdata, twt) = zoned_averages.next()
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/code/step5.py", line
183, in zonav
boxed_data.next())
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/tool/giss_io.py", line
1241, in step5_bx_output
for record in data:
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/code/step5.py", line
69, in SBBXtoBX
landweight,landsub,oceansub = zip(*itertools.islice(data, nsubbox))
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/tool/giss_io.py", line
1261, in step5_mask_output
for datum in data:
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/code/step5.py", line
415, in ensure_weight
for _,land,ocean in data:
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/tool/giss_io.py", line
1170, in step5_input
for land, ocean in data:
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/tool/giss_io.py", line
1204, in ensure_landocean
for series in data:
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/tool/giss_io.py", line
1147, in step4_output
for land,ocean in data:
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/tool/giss_io.py", line
1020, in step3_output
for thing in data:
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/code/step3.py", line
296, in step3
for box in box_source:
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/code/step3.py", line
162, in iter_subbox_grid
station_records = list(station_records)
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/tool/giss_io.py", line
1004, in step2_output
for thing in data:
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/code/step2.py", line
687, in step2
for record in adjusted:
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/code/step2.py", line
67, in urban_adjustments
rural_stations, urban_stations, all = annotate_records(record_stream)
File "/home/gaf/ccc-gistemp/ccc-gistemp-0.6.0/code/step2.py", line
124, in annotate_records
station = record.station
AttributeError: 'Series' object has no attribute 'station'
===

David Jones

unread,
Oct 28, 2010, 3:26:05 AM10/28/10
to ccc-giste...@googlegroups.com

On 27 Oct 2010, at 21:11, Greg Freemyer wrote:

> On Mon, Oct 25, 2010 at 4:58 AM, David Jones <d...@pobox.com> wrote:
>> I've just uploaded a new release of ccc-gistemp:
>>
>> http://code.google.com/p/ccc-gistemp/downloads/detail?name=ccc-
>> gistemp-0.6.0.tar.gz
>>
>> Reports of success/failure using it would be most welcome.
>>
>> I'm about to write a blog article describing the release.
>>
>> Cheers,
>> drj
>
> David,
>
> This is my first attempt to run ccc, but v0.6.0 did not work for me.
> It could easily by I don't have python installed correctly, etc. (I'm
> not a python programmer.)
>
> This is linux opensuse 11.3 (the latest) with the default python for
> the distro (python 2.6).

Aha, a bug!

Thanks for the note of failure Greg, it's not your fault at all, it's
a bug in ccc-gistemp.

It should in fact work if you simply try "python tool/run.py" again
in the same directory.

The bug is that it expects to find the file input/v2.inv when you
first run it, but this file isn't present until it's been
downloaded. Now that you've run it and it has downloaded this file,
running it again should work. I created Issue 88: http://
code.google.com/p/ccc-gistemp/issues/detail?id=88

Thanks again!
David Jones

Greg Freemyer

unread,
Oct 28, 2010, 7:53:12 PM10/28/10
to ccc-giste...@googlegroups.com
On Thu, Oct 28, 2010 at 3:26 AM, David Jones <d...@climatecode.org> wrote:

On 27 Oct 2010, at 21:11, Greg Freemyer wrote:

On Mon, Oct 25, 2010 at 4:58 AM, David Jones <d...@pobox.com> wrote:
I've just uploaded a new release of ccc-gistemp:

http://code.google.com/p/ccc-gistemp/downloads/detail?name=ccc-gistemp-0.6.0.tar.gz

Reports of success/failure using it would be most welcome.

I'm about to write a blog article describing the release.

Cheers,
 drj

David,

This is my first attempt to run ccc, but v0.6.0 did not work for me.
It could easily by I don't have python installed correctly, etc.  (I'm
not a python programmer.)

This is linux opensuse 11.3 (the latest) with the default python for
the distro  (python 2.6).

Aha, a bug!

Thanks for the note of failure Greg, it's not your fault at all, it's a bug in ccc-gistemp.

It should in fact work if you simply try "python tool/run.py" again in the same directory.



Correct.  I even got the graph to pop up in firefox.

Thanks for all your work
Greg

David Jones

unread,
Oct 29, 2010, 6:29:49 AM10/29/10
to ccc-giste...@googlegroups.com
I've fixed this bug and made a new release:
http://code.google.com/p/ccc-gistemp/downloads/detail?name=ccc-gistemp-0.6.1.tar.gz

drj

On 29 October 2010 00:53, Greg Freemyer <greg.f...@gmail.com> wrote:
>
> On Thu, Oct 28, 2010 at 3:26 AM, David Jones <d...@climatecode.org> wrote:
>>
>> On 27 Oct 2010, at 21:11, Greg Freemyer wrote:
>>>
>>> This is my first attempt to run ccc, but v0.6.0 did not work for me.
>>> It could easily by I don't have python installed correctly, etc.  (I'm
>>> not a python programmer.)
>>

>> Aha, a bug!

John Keyes

unread,
Oct 29, 2010, 8:37:13 AM10/29/10
to ccc-giste...@googlegroups.com
Just downloaded and giving it a spin now.

-John

> --
> You received this message because you are subscribed to the Google Groups "CCC GISTEMP discussion" group.
> To post to this group, send email to ccc-giste...@googlegroups.com.
> To unsubscribe from this group, send email to ccc-gistemp-dis...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/ccc-gistemp-discuss?hl=en.
>
>

John Keyes

unread,
Oct 29, 2010, 10:05:10 AM10/29/10
to ccc-giste...@googlegroups.com
Ran: python tool/run.py
Result: http://goo.gl/3Q4i

-John

David Jones

unread,
Oct 29, 2010, 10:11:00 AM10/29/10
to ccc-giste...@googlegroups.com
On 29 October 2010 15:05, John Keyes <john...@gmail.com> wrote:
> Ran:  python tool/run.py
> Result: http://goo.gl/3Q4i

Excellent, thanks for that.

It's always reassuring to have at least one report of a successul run.

drj

John Keyes

unread,
Oct 29, 2010, 10:16:42 AM10/29/10
to ccc-giste...@googlegroups.com

You're welcome. Setup was OS X 10.6.4 Python 2.6.4.

I tried with Python 3.2a2 initially but noticed it won't run due to
syntax errors.

-John

Reply all
Reply to author
Forward
0 new messages