How can we get the page rank in each year?

[zhan su]

I know we have created a host-level or domain-level web graph. how can I know the page rank of a  group of websites in 2018? I have an alternative method, I can download the whole page rank dataset(65G unzip) and create a table using Athea, and then use SQL to search the websites. It there any other good method?

[Greg Lindahl]

On Tue, Sep 05, 2023 at 06:59:09AM -0700, zhan su wrote:
> I know we have created a host-level or domain-level web graph. how can I
> know the page rank of a group of websites in 2018?

The web graph data contains host level information; you can look up a
hostname in each such web graph over time.

To access this data, see

https://commoncrawl.org/search?query=web+graph

and here's a blog post about the most recent data:

https://commoncrawl.org/blog/host-and-domain-level-web-graphs-sep-nov-jan-2022-2023

-- greg