Question regarding Pagerank.

[RP]

Using crawler (doc-Ids)its easy to keep a count of the out going links from a url? But how is it possible to determine the amount of links pointed to given url(incoming).

[Wesley May]

You can simply have a dictionary that maps URLs to the count of edges coming in, so something like count["google.com"] = 5. You'll have to go through your list of URLs to build this mapping. It doesn't suffice to just look at one website, because of course you can't see the number of links coming in.

[RP]

. So we compare the list of all urls(depth=1) formulated by the crawler of a single URL and  and check whether they have any common matches with another URL in the url.txt., comparing Doc_ids.

[Wesley May]

Yes, that sounds good.