hi service like www.xml-sitemaps.com

0 views
Skip to first unread message

jack me

unread,
Jul 1, 2009, 5:58:19 AM7/1/09
to dotnetdevelopment
hi,

how can we make service like www.xml-sitemaps.com  in asp.net 2.0

how we can trace the all pages of any website.

I have tried not not getting proper answer.


Processor Devil

unread,
Jul 1, 2009, 6:19:57 AM7/1/09
to DotNetDe...@googlegroups.com
It is easy. Make some app which will read html source from webpage, use some regular expressions to get out the links and with the links call recursively the subroutine to get more and more links (or files, etc, anything you wish)

2009/7/1 jack me <reach...@gmail.com>

Cerebrus

unread,
Jul 1, 2009, 12:16:43 PM7/1/09
to DotNetDevelopment, VB.NET, C# .NET, ADO.NET, ASP.NET, XML, XML Web Services,.NET Remoting
IOW, a mini-spider.

jack me

unread,
Jul 2, 2009, 12:30:40 AM7/2/09
to DotNetDe...@googlegroups.com
i did not get the right point. I understand i have to make a mini spider.
But how
can i have any link or anything which may be right solution.

jack me

unread,
Aug 10, 2009, 11:43:16 PM8/10/09
to DotNetDe...@googlegroups.com
Hi Cerebrus, Processor devil,

I have checked some code which can search the all static webpages. But i want to know that how i can detect the urls generated at run time. Like if page contains the query string or some thing else. how i may detect that. Page detects but same page having different query strings not detects.

regards,

Processor Devil

unread,
Aug 11, 2009, 3:15:20 AM8/11/09
to DotNetDe...@googlegroups.com
well.... open your web browser, open some page and view html source code...
You will find link there, it looks like <a href="some_address">something</a>, because of that I told you that you should use regular patterns. It will find you every link (index.htm, index.php, or index.php?id=16, whatever).

2009/8/11 jack me <reach...@gmail.com>
Reply all
Reply to author
Forward
0 new messages