ISP to ASN map file

[con...@vaibhavbajpai.com]

Hello,

We would like to use the ISP to ASN mapping available in [1] as part of our research.

It would be nice to know how the data within [1] is populated. Can somebody 

please explain the methodology used behind the scenes?

[1] https://console.developers.google.com/m/cloudstorage/b/m-lab/o/isp_to_asns_map.txt

Best Regards, 

Steffie and Vaibhav

-----------------------------------------------------
Vaibhav Bajpai

Research I, Room 91
Computer Networks and Distributed Systems  (CNDS) Lab
School of Engineering and Sciences
Jacobs University Bremen, Germany

www.vaibhavbajpai.com

[Michael Lynch]

Hi Steffie and Vaibhav,

The mapping is created by rearranging the data from Potaroo so that it maps ISP name -> AS number(s). Our wiki page for Public Data Explorer describes how this fits into our process. Please let us know if you have any further questions.

Thanks,

Michael

--
You received this message because you are subscribed to the Google Groups "discuss" group.
To unsubscribe from this group and stop receiving emails from it, send an email to discuss+u...@measurementlab.net.
To post to this group, send email to dis...@measurementlab.net.
Visit this group at http://groups.google.com/a/measurementlab.net/group/discuss/.

[Bajpai, Vaibhav]

Hello Michael,

> On 04 Sep 2014, at 16:45, Michael Lynch <mtl...@google.com> wrote:
>
> Hi Steffie and Vaibhav,
>
> The mapping is created by rearranging the data from Potaroo so
> that it maps ISP name -> AS number(s). Our wiki page for Public
> Data Explorer describes how this fits into our process. Please
> let us know if you have any further questions.

Thanks for a quick response.

From the wiki [1] page:

ISP:

- Every test is assigned to the AS (Autonomous System) that originates the
client IP address.

- All the ASes are aggregated into ISPs, according to the AS names
published at [bgp.potaroo.net/cidr/autnums.html]. This file lists all
the ISPs visualized in the charts and, for each ISP, it lists all the
ASes that are assigned to the ISP.

Given the entire list of ASNs also include research and academic networks,
backbone networks, et al. we were wondering how do you specifically filter
out ISPs from the ASN list: bgp.potaroo.net/cidr/autnums.html

[1] https://code.google.com/p/m-lab/wiki/PDEChartsNDT#Dimensions

Best, Vaibhav

[Michael Lynch]

Hi Vaibhav,

We only include results in the PDE datasets if we have at least 200 results per unit of aggregation. Our aggregation is as follows:

Aggregate the results of the query by month, geography (city, region, country and world-wide) and ISP.

At each level of aggregation, locations with fewer than 200 distinct client IP addresses are not included in the charts.

https://code.google.com/p/m-lab/wiki/PDEChartsNDT#Introduction

For smaller ASNs such as research and academic network, they generally don't meet the threshold of 200 distinct IPs per aggregation unit (i.e. we see fewer than 200 results per academic network per month). The isp_to_asns_map.txt includes only the ISPs that were included in the PDE dataset, so this is why you don't see these smaller networks in the map.

The exclusion of these results only occurs on PDE, so if you accessed the data through BigStore or BigQuery, you will see results from these research and academic networks, but we don't publish a mapping of IP addresses to AS numbers or ISP names for the BigStore or BigQuery datasets.

Thanks,

Michael

[Evan Wright]

Vaibhav,
There's another IP->ASN data source that may be of interest. At CERT we
mirror the routeviews datasets, and share some of our routing-related
analysis at this site:
http://routeviews-mirror.cert.org/

The "Historical Pmaps" section may particularly interest you.
In case you've got questions about the data manipulation (e.g.
construction of the datasets), I've cc'd Timur, the project lead for
this effort.

Thanks,

--
Evan C. Wright
Network Security Analyst
CERT/CC Threat Discovery
Software Engineering Institute (SEI)
Carnegie Mellon University