Unable to reach any application, packets being lost in google infrastructure

[WeatherPhilip]

This is weird. I can no longer reach any appspot.com application. The
TCP SYN packets never get answered!

A traceroute shows:

traceroute to shell.appspot.com (74.125.93.141), 30 hops max, 40 byte
packets
1 * * *
2 ge-2-33-ur01.maynard.ma.boston.comcast.net (68.87.156.129) 16.565
ms 14.609 ms 14.864 ms
3 be-53-crs01.needham.ma.boston.comcast.net (68.85.162.109) 14.427
ms 15.886 ms 13.920 ms
4 pos-0-0-0-0-ar99.chartford.ct.hartford.comcast.net (68.85.162.70)
15.861 ms 13.896 ms 15.875 ms
5 pos-2-4-0-0-cr01.newyork.ny.ibone.comcast.net (68.86.90.61)
19.201 ms 17.887 ms 17.016 ms
6 xe-10-2-0.edge1.NewYork2.Level3.net (4.78.169.49) 18.865 ms
18.427 ms 16.928 ms
7 vlan51.ebr1.NewYork2.Level3.net (4.69.138.222) 17.495 ms 19.028
ms 16.998 ms
8 ae-3-3.ebr2.Washington1.Level3.net (4.69.132.89) 25.050 ms
23.015 ms 23.971 ms
9 ae-82-82.csw3.Washington1.Level3.net (4.69.134.154) 28.534 ms
26.568 ms 24.599 ms
10 ae-2-79.edge1.Washington1.Level3.net (4.68.17.80) 20.834 ms
ae-3-89.edge1.Washington1.Level3.net (4.68.17.144) 18.592 ms
ae-1-69.edge1.Washington1.Level3.net (4.68.17.16) 20.260 ms
11 GOOGLE-INC.edge1.Washington1.Level3.net (4.79.228.38) 24.314 ms
GOOGLE-INC.edge1.Washington1.Level3.net (4.79.22.38) 20.339 ms GOOGLE-
INC.edge1.Washington1.Level3.net (4.79.228.38) 21.295 ms
12 209.85.240.136 22.858 ms 23.414 ms 23.273 ms
13 209.85.248.75 40.459 ms 38.476 ms 44.948 ms
14 209.85.254.237 37.444 ms 209.85.254.235 38.432 ms 49.984 ms
15 64.233.175.14 49.967 ms 48.712 ms 216.239.47.34 54.186 ms
16 * * *
17 * * *
18 * * *
19 * * *


so it looks as though the packets make it into Google's
infrastructure.

My applications show no significant drop-off in traffic, so this isn't
a widespread outage.

I checked the status page, and there are a bunch of 'investigating'
marks, but these seem to be to do with latency rather than not
responding at all. Maybe it will all clear up.....

There ought to be a better way to report issues.

Philip

[Peter Recore]

I'm having the same problem. I am in the boston area too, if that
matters. though I am using Sprint instead of comcast as an ISP.

On Jun 13, 9:51 am, WeatherPhilip <philip-goo...@gladstonefamily.net>
wrote:

[Peter Recore]

one more data point - i can access appspot.com pages fine through my
work network (also boston based)

[Peter Recore]

I can now access app engine sites again.
As of yesterday though, my buddy with Verizon FIOS, also in the boston
area, could not accesss them either.

[Peter Recore]

looks i spoke too soon. I'm back to being unable to reach
appgallery.appspot.com

[WeatherPhilip]

The status page shows that they are have serious problems, but I guess
that they don't work over the weekend. Maybe someone will come in on
Monday morning and take a look at it. I wonder how the people who pay
for service deal with this type of issue.

Actually, since one of my apps will (as of June 22nd) no long be a
free app (it transfers more than 1GB per day), I can tell you that
this type of service is not what you expect when you are paying for
it.

Philip

[WeatherPhilip]

Well, it appears that they have (finally) fixed the problem after a
day and a half. The comment in the status blog is:

> We have determined that this spike did not affect the performance
> or uptime of applications. If you feel we have incorrectly diagnosed
> this issue please inform us by posting in our developer forum.

Well -- it seems clear that whoever wrote this (or chose the standard
answer) did not bother to look in the forum to see that people had
reported that the entire service was broken for some set of people.

Were we just lucky that someone came in on a Sunday?

Philip


On Jun 14, 11:51 am, WeatherPhilip <philip-goo...@gladstonefamily.net>
wrote:

[Andrew Ziem]

On Jun 14, 8:25 am, Peter Recore <peterrec...@gmail.com> wrote:
> looks i spoke too soon.  I'm back to being unable to reach
> appgallery.appspot.com

Since yesterday I also can't access *.appspot.com from home in
Colorado via Qwest, but I can through my work VPN. However I can
access http://www.babyloggr.com/ which is listed on the AppGallery
home page.


Andrew

[Peter Recore]

I found the following update on the app engine status page:

UPDATE: Further investigation shows that some networking
infrastructure (separate from App Engine) has experienced issues
throughout the weekend, resulting in some packet loss. The situation
is resolved now, but we are investigating the full extent of customer-
facing packet loss. We will update when more information becomes
available.

On Jun 14, 11:27 am, "Andrew Z." <ahz...@gmail.com> wrote:
> On Jun 14, 8:25 am, Peter Recore <peterrec...@gmail.com> wrote:
>
> > looks i spoke too soon.  I'm back to being unable to reach
> > appgallery.appspot.com
>
> Since yesterday I also can't access *.appspot.com from home in
> Colorado via Qwest, but I can through my work VPN.  However I can

> accesshttp://www.babyloggr.com/which is listed on the AppGallery
> home page.
>
> Andrew