GSA Pattern to match URL

[Zeeshan Iqbal]

i am using Google GSA and my url which i need to match is :

http://www.mydomain.com/testmatch/matchid=33/machinstanceid=12/matchf=2/head/articlenumber=122/index.html

where only red marked items will change but the other items of the url will remains same, any idea how can of regular expression?

[Rohan Kumbhar]

Please try following pattern, it should work!!

Thanks,
Rohan
regexp:^http://www\\.mydomain\\.com/testmatch/matchid=[0-9]+/machinstanceid=[0-9]+/matchf=[0-9]+/head/articlenumber=[0-9]+/index.html$

[Jeremy Garreau]

Weird, mine got deleted oO

[Zeeshan Iqbal]

Thanks for helpful reply guys, Now it is crawling my pages but it is only crawling the results on index.html only - But i had some paging on this index.html page which have further results, any idea why it is not going on those pages??

--
You received this message because you are subscribed to a topic in the Google Groups "Google Search Appliance/Google Mini" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/Google-Search-Appliance-Help/kTcSAT1nkv4/unsubscribe?hl=en.
To unsubscribe from this group and all its topics, send an email to Google-Search-Applia...@googlegroups.com.
To post to this group, send email to Google-Search-...@googlegroups.com.
Visit this group at http://groups.google.com/group/Google-Search-Appliance-Help?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

--
Xeshan Iqbal
http://www.solutionext.co.uk

[Mathias Bierl]

Maybe the paging is made via JavaScript.

Am Montag, 29. April 2013 10:56:14 UTC+2 schrieb Zeeshan Iqbal:

Thanks for helpful reply guys, Now it is crawling my pages but it is only crawling the results on index.html only - But i had some paging on this index.html page which have further results, any idea why it is not going on those pages??

On Fri, Apr 26, 2013 at 7:41 AM, Jeremy Garreau <jer...@nrx.eu> wrote:

Weird, mine got deleted oO

Le vendredi 26 avril 2013 07:52:45 UTC+2, Rohan Kumbhar a écrit :

Please try following pattern, it should work!!

Thanks,
Rohan
regexp:^http://www\\.mydomain\\.com/testmatch/matchid=[0-9]+/machinstanceid=[0-9]+/matchf=[0-9]+/head/articlenumber=[0-9]+/index.html$

On Wednesday, 24 April 2013 22:11:04 UTC+5:30, Zeeshan Iqbal wrote:

i am using Google GSA and my url which i need to match is :

http://www.mydomain.com/testmatch/matchid=33/machinstanceid=12/matchf=2/head/articlenumber=122/index.html

where only red marked items will change but the other items of the url will remains same, any idea how can of regular expression?

--
You received this message because you are subscribed to a topic in the Google Groups "Google Search Appliance/Google Mini" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/Google-Search-Appliance-Help/kTcSAT1nkv4/unsubscribe?hl=en.

To unsubscribe from this group and all its topics, send an email to Google-Search-Appliance-Help+unsub...@googlegroups.com.

To post to this group, send email to Google-Search-...@googlegroups.com.
Visit this group at http://groups.google.com/group/Google-Search-Appliance-Help?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Zeeshan Iqbal]

No it is simple a (href) links of next pages 

To unsubscribe from this group and all its topics, send an email to Google-Search-Applia...@googlegroups.com.

To post to this group, send email to Google-Search-...@googlegroups.com.
Visit this group at http://groups.google.com/group/Google-Search-Appliance-Help?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Zeeshan Iqbal]

mydomain.com/gsasearch/news/index.html [main page]

mydomain.com/gsasearch/news/index,pag=1.htmk [pagging pages] i.e. my htmk is specific to my cms file act as a dynamic page

and my start clawling patern is "mydomain.com/news/list.html"

and follow and crawl only pattern is : regexpIgnoreCase:http://www\\.mydomain\\.com/news/

[Mathias Bierl]

Do you have a matching pattern in the following field ?

To unsubscribe from this group and all its topics, send an email to Google-Search-Appliance-Help+unsubs...@googlegroups.com.

To post to this group, send email to Google-Search-...@googlegroups.com.

Visit this group at http://groups.google.com/group/Google-Search-Appliance-Help?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

--
Xeshan Iqbal
http://www.solutionext.co.uk

--
You received this message because you are subscribed to a topic in the Google Groups "Google Search Appliance/Google Mini" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/Google-Search-Appliance-Help/kTcSAT1nkv4/unsubscribe?hl=en.
To unsubscribe from this group and all its topics, send an email to Google-Search-Appliance-Help+unsub...@googlegroups.com.
To post to this group, send email to Google-Search-...@googlegroups.com.
Visit this group at http://groups.google.com/group/Google-Search-Appliance-Help?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

--
Xeshan Iqbal
http://www.solutionext.co.uk

--
Xeshan Iqbal
http://www.solutionext.co.uk

[Zeeshan Iqbal]

yes i do

To unsubscribe from this group and all its topics, send an email to Google-Search-Applia...@googlegroups.com.

To post to this group, send email to Google-Search-...@googlegroups.com.
Visit this group at http://groups.google.com/group/Google-Search-Appliance-Help?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Mathias Bierl]

If I look at your examples then you patterns includes the www but your URLs does not.

So maybe this is the problem

[Zeeshan Iqbal]

I am really sorry i missed that www with the url as it also contains the www

To unsubscribe from this group and all its topics, send an email to Google-Search-Applia...@googlegroups.com.

To post to this group, send email to Google-Search-...@googlegroups.com.
Visit this group at http://groups.google.com/group/Google-Search-Appliance-Help?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.
 
 

[Zeeshan Iqbal]

Thanks everybody, i think i manage to solve the issue and it is because my starting pattern was previously

mydomain.com/gsasearch/news/index.html

which does not match with the paging pages as it ends with differnent page type, so in order to solve this is just remove the last part and make it :

mydomain.com/gsasearch/news/

and now it is crawling everything except the one i mentioned in the not crawled pattern :)

[Mathias Bierl]

The starting pattern is not important for this, but the following pattern.

Did you change it there too ?

Xeshan Iqbal
http://www.solutionext.co.uk

[Zeeshan Iqbal]

no it was same as above

To unsubscribe from this group and all its topics, send an email to Google-Search-Applia...@googlegroups.com.

To post to this group, send email to Google-Search-...@googlegroups.com.
Visit this group at http://groups.google.com/group/Google-Search-Appliance-Help?hl=en.
For more options, visit https://groups.google.com/groups/opt_out.