Nova.astrometry.net may be unavailable or intemittent

[Dustin Lang]

We are experiencing some hardware problems on the server that runs nova.astrometry.net .  It is running right now but may go down without notice.  We're working on it...
Thanks for your patience.
--dustin

[sxc...@gmail.com]

Hi Dustin,

Any further word on when the web server might be back up?

Thanks!

Sean

[Dustin Lang]

It looks like it might be a fatal problem on the server's motherboard.  I will try to bring up a replacement server this weekend.

cheers,
--dstn

[sxc...@gmail.com]

Dustin,

Thanks for the update - I appreciate all your hard work.

Sean

[Dustin Lang]

I'm in the process of bringing up a replacement nova.astrometry.net server.

It is running right now and nearly everything seems ok -- the GALEX overlay plots don't work, but other than that, so far so good.

Please let me know if you experience any problems.

Until things get stabilized, be warned that images you submit *may* disappear; I'll do my best to preserve everything, but no guarantees.

cheers,
dustin

[Mark Striebeck]

Hi Dustin,

Not sure if this is related to the current issues:

1. I tried to upload several fits files and always get the following error:

...get_or_create_image(df)
  File "process_submissions.py", line 483, in get_or_create_image
    img = create_source_list(df)
  File "process_submissions.py", line 566, in create_source_list
    raise e
TypeError: cannot perform reduce with flexible type

2. When trying to download a "new-image.fits" file, I get the following exception:

image2pnm.py failed: out jpg , err jpegtopnm: WRITING PPM FILE *** buffer overflow detected ***: pnmtofits terminated ======= Backtrace: ========= /lib/x86_64-linux-gnu/libc.so.6(__fortify_fail+0x37)[0x7f25fc2bc817] /lib/x86_64-linux-gnu/libc.so.6(+0x109710)[0x7f25fc2bb710] /lib/x86_64-linux-gnu/libc.so.6(+0x108b79)[0x7f25fc2bab79] /lib/x86_64-linux-gnu/libc.so.6(_IO_default_xsputn+0xdd)[0x7f25fc22e13d] /lib/x86_64-linux-gnu/libc.so.6(_IO_vfprintf+0x1ae7)[0x7f25fc1fc4a7] /lib/x86_64-linux-gnu/libc.so.6(__vsprintf_chk+0x94)[0x7f25fc2bac14] /lib/x86_64-linux-gnu/libc.so.6(__sprintf_chk+0x7d)[0x7f25fc2bab5d] pnmtofits[0x400c17] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xed)[0x7f25fc1d376d] pnmtofits[0x401251] ======= Memory map: ======== 00400000-00402000 r-xp 00000000 08:01 1863532 /usr/bin/pnmtofits 00601000-00602000 r--p 00001000 08:01 1863532 /usr/bin/pnmtofits 00602000-00603000 rw-p 00002000 08:01 1863532 /usr/bin/pnmtofits 0067a000-0069b000 rw-p 00000000 00:00 0 [heap] 7f25f3225000-7f25f323a000 r-xp 00000000 08:01 6553906 /lib/x86_64-linux-gnu/libgcc_s.so.1 7f25f323a000-7f25f3439000 ---p 00015000 08:01 6553906 /lib/x86_64-linux-gnu/libgcc_s.so.1 7f25f3439000-7f25f343a000 r--p 00014000 08:01 6553906 /lib/x86_64-linux-gnu/libgcc_s.so.1 7f25f343a000-7f25f343b000 rw-p 00015000 08:01 6553906 /lib/x86_64-linux-gnu/libgcc_s.so.1 7f25f343b000-7f25fc1b2000 rw-p 00000000 00:00 0 7f25fc1b2000-7f25fc367000 r-xp 00000000 08:01 6609017 /lib/x86_64-linux-gnu/libc-2.15.so 7f25fc367000-7f25fc566000 ---p 001b5000 08:01 6609017 /lib/x86_64-linux-gnu/libc-2.15.so 7f25fc566000-7f25fc56a000 r--p 001b4000 08:01 6609017 /lib/x86_64-linux-gnu/libc-2.15.so 7f25fc56a000-7f25fc56c000 rw-p 001b8000 08:01 6609017 /lib/x86_64-linux-gnu/libc-2.15.so 7f25fc56c000-7f25fc571000 rw-p 00000000 00:00 0 7f25fc571000-7f25fc58f000 r-xp 00000000 08:01 1855647 /usr/lib/libnetpbm.so.10.0 7f25fc58f000-7f25fc78f000 ---p 0001e000 08:01 1855647 /usr/lib/libnetpbm.so.10.0 7f25fc78f000-7f25fc790000 r--p 0001e000 08:01 1855647 /usr/lib/libnetpbm.so.10.0 7f25fc790000-7f25fc794000 rw-p 0001f000 08:01 1855647 /usr/lib/libnetpbm.so.10.0 7f25fc794000-7f25fc7b6000 r-xp 00000000 08:01 6609031 /lib/x86_64-linux-gnu/ld-2.15.so 7f25fc996000-7f25fc999000 rw-p 00000000 00:00 0 7f25fc9b2000-7f25fc9b6000 rw-p 00000000 00:00 0 7f25fc9b6000-7f25fc9b7000 r--p 00022000 08:01 6609031 /lib/x86_64-linux-gnu/ld-2.15.so 7f25fc9b7000-7f25fc9b9000 rw-p 00023000 08:01 6609031 /lib/x86_64-linux-gnu/ld-2.15.so 7ffffb766000-7ffffb787000 rw-p 00000000 00:00 0 [stack] 7ffffb7ff000-7ffffb800000 r-xp 00000000 00:00 0 [vdso] ffffffffff600000-ffffffffff601000 r-xp 00000000 00:00 0 [vsyscall] Aborted (core dumped)

      MarkS

[Dustin Lang]

Thanks for your note -- problem 1 was due to a pyfits version issue.  Problem 2 was due to a pnmtofits issue.

Both fixed, I think.  Keep your comments coming!

cheers,
dustin

[Hans Moritz Günther]

Hi Dustin,


just to let you know:
I tried astronomy.net today for the first time. From this forum it seems that the same problem came up the last few days already.

This is what I get;

...get_or_create_image(df)
  File "process_submissions.py", line 483, in get_or_create_image
    img = create_source_list(df)
  File "process_submissions.py", line 567, in create_source_list
    raise e
TypeError: cannot perform reduce with flexible type

Here is the job info:

Submission 42741

Submitter:	anonymous (1)
Date Submitted:	2013-06-03T16:51:56Z
Filename:	h_long_YSO.49.3_coadd.fits

Moritz

[Dustin Lang]

Thanks -- that error message is terrible, but basically the problem arises because your FITS file is not valid.  Fitsverify says:


1 Header-Data Units in this file.
 
=================== HDU 1: Primary Array ===================
 
*** Error:   Keyword #333, RA: Bad numerical value "16:26:18.20".
*** Error:   Keyword #334, DEC: Bad numerical value "-24:23:01.1".
*** Error:   Keyword #6, EXTEND: value = True is not a logical constant. The
             value is entered as a string.
*** Error:   Keyword #37, DATE-OBS: (from CFITSIO error stack:)
             input date string has illegal format:
             2010/4/11 09:54:26
            
*** Warning: Keyword #37, DATE-OBS 2010/4/11 09:54:26 intends to mean year 2001?
*** Error:   Keyword #7, EQUINOX: value = 2000.0 is not a floating point
             number. The value is entered as a string.
*** Error:   Keyword #306, WCSAXES: value = 2 is not an integer. The value is
             entered as a string.
*** Error:   Keyword #306, WCSAXES: value = 2 is not an integer. The value is
             entered as a string.
*** Error:   Keyword #12, CRPIX1: value = 256.5 is not a floating point number.
             The value is entered as a string.
*** Error:   Keyword #18, CRPIX2: value = 256.5 is not a floating point number.
             The value is entered as a string.
*** Error:   Keyword #11, CRVAL1: value = 246.575665277 is not a floating point
             number. The value is entered as a string.
*** Error:   Keyword #17, CRVAL2: value = -24.383507925 is not a floating point
             number. The value is entered as a string.
*** Error:   Keyword #307, LONPOLE: value = 180.0 is not a floating point
             number. The value is entered as a string.
*** Error:   Keyword #308, LATPOLE: value = 0.0 is not a floating point number.
             The value is entered as a string.
*** Error:   Keyword #13, CD1_1: value = -0.000273802414821 is not a floating
             point number. The value is entered as a string.
*** Error:   Keyword #14, CD1_2: value = 1.29355518069e-06 is not a floating
             point number. The value is entered as a string.
*** Error:   Keyword #19, CD2_1: value = 3.26381041177e-06 is not a floating
             point number. The value is entered as a string.
*** Error:   Keyword #20, CD2_2: value = 0.000278768897708 is not a floating
             point number. The value is entered as a string.
 

Try fixing those issues and see if it works.

cheers,
dustin

[Hans Moritz Günther]

Hi Dustin,

thanks a lot for your incredibly fast reply!!!

I removed the offending fits keywords and fitsverify now confirms the fils as clean:

 
               ftverify 4.16 (CFITSIO V3.320)              
               ------------------------------              
 
HEASARC conventions are being checked.
 
File: test.fits

1 Header-Data Units in this file.
 
=================== HDU 1: Primary Array ===================
 

 7 header keywords
 
 32-bit floating point pixels,  2 axes (512 x 512),
 
++++++++++++++++++++++ Error Summary  ++++++++++++++++++++++
 
 HDU#  Name (version)       Type             Warnings  Errors
 1                          Primary Array    0         0    
 
**** Verification found 0 warning(s) and 0 error(s). ****


but I still get the same error on upload of the fixed file:

Submission 42760

Submitter:	anonymous (1)
Date Submitted:	2013-06-03T17:48:23Z
Filename:	test.fits

...get_or_create_image(df)
  File "process_submissions.py", line 483, in get_or_create_image
    img = create_source_list(df)
  File "process_submissions.py", line 567, in create_source_list
    raise e
TypeError: cannot perform reduce with flexible type

Do you have any advice how I can fix that?

Thanks,
Moritz

[Dustin Lang]

Hmm, I'm not sure why it failed again; when I tried re-running it it worked, and when I resubmitted it it worked (well, it ran, and failed).

Here's the failure:
http://nova.astrometry.net/user_images/53989

I looked at the source extraction image and noticed that the red circles were slightly off-center in your sources (which look saturated, maybe?).  My all-purpose solution to that is increase the downsampling -- at 4 I get a correct solution:

http://nova.astrometry.net/user_images/53992

Could you please try resubmitting your image(s) and check that it works, or report the failure?  I restarted the server-side processing since your report and the log for your original submission got overwritten.

thanks,
dustin

[Hans Moritz Günther]

Hi Dustin,

I resubmitted that image a few hours ago, but it's still in the queue.
I'll check back tomorrow and I'll let you know how it goes.

Moritz

Submission 42965

This page will automatically refresh every 10 seconds. Stop

Submitter:	anonymous (1)
Date Submitted:	2013-06-04T12:11:37Z
Filename:	test.fits

Upload Settings
Parity:	try both simultaneously
Scale Units:	width of the field (in degrees)
Scale Type:	bounds
Scale Lower Bound:	0.05
Scale Upper Bound:	0.2
Star Positional Error:	10.0 pixels
Limits:	RA, Dec - (246.0, -24.0) radius - 2.0
Downsample Factor:	2
CRPIX:	center

Go to results page Job 62946: Processing... Queued: 2013-06-04 12:11:39 Source extraction image (fullsize) Log file tail [-] (full) None Log file 2

[Hans Moritz Günther]

Hi Dustin,

the processing is done:
It failed because it did not identify a match - That's OK, I'll try a different binning or see if I can process my image differently before I upload it.

Thanks for solving the technical problem!

Moritz