Crawl GWT APP - Google bot

118 views
Skip to first unread message

Marek A

unread,
Jul 17, 2015, 9:52:42 AM7/17/15
to google-we...@googlegroups.com
since 2014 google bot can read/crawl dynamic pages. But when I run fetch as google in search console, i get empty page (GWT doesn't start - one page app in GWT). I think the main reason of this problem is Google bot User Agent header, GWT can't recognize them and doesn't start. Do you know some solution or workaround for this issue. How to create GWT app crawlable without  html snapshot?

Michael Joyner

unread,
Jul 17, 2015, 11:41:27 AM7/17/15
to google-we...@googlegroups.com
You need to stick the following into your main GWT xml file:

<!-- Fallback User Agent for use by CRAWLERS -->
     <set-property-fallback name="user.agent" value="gecko1_8" />




On 07/17/2015 08:55 AM, Marek A wrote:
since 2014 google bot can read/crawl dynamic pages. But when I run fetch as google in search console, i get empty page (GWT doesn't start - one page app in GWT). I think the main reason of this problem is Google bot User Agent header, GWT can't recognize them and doesn't start. Do you know some solution or workaround for this issue. How to create GWT app crawlable without  html snapshot?
--
You received this message because you are subscribed to the Google Groups "Google Web Toolkit" group.
To unsubscribe from this group and stop receiving emails from it, send an email to google-web-tool...@googlegroups.com.
To post to this group, send email to google-we...@googlegroups.com.
Visit this group at http://groups.google.com/group/google-web-toolkit.
For more options, visit https://groups.google.com/d/optout.

Marek A

unread,
Jul 20, 2015, 12:02:56 PM7/20/15
to google-we...@googlegroups.com
it doesn't work with GWT 2.6 for me

Michael Joyner

unread,
Jul 20, 2015, 3:06:39 PM7/20/15
to google-we...@googlegroups.com
Sorry,

That's for GWT 2.7

I don't know what do to for GWT 2.6

-Mike


On 07/20/2015 12:02 PM, Marek A wrote:

Jens

unread,
Jul 20, 2015, 3:19:54 PM7/20/15
to google-we...@googlegroups.com

I don't know what do to for GWT 2.6

Easy, upgrading to 2.7 ;) 

-- J.

Marek A

unread,
Jul 20, 2015, 5:41:42 PM7/20/15
to google-we...@googlegroups.com
I think I found solution:
<extend-property name="user.agent" values="unknown" fallback-value="gecko1_8" />

--
You received this message because you are subscribed to a topic in the Google Groups "Google Web Toolkit" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/google-web-toolkit/B3d4i-f-ekI/unsubscribe.
To unsubscribe from this group and all its topics, send an email to google-web-tool...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages