How to download latest Safebrowser List

[msdev...@gmail.com]

Hi,

I am looking to run analytics and see if any domains that our users are going to domains that are on the safebrowser list. Since there will be a lot of queries, I'd like to download the list and run them locally. I was looking at the documentation for v4 and it's not clear to me how to set up the local database so that you can fetch the list. I have the safebrowsing Go package installed and ran the test - it seems to be working but am not sure how to move forward from there. I guess I'm a little confused about how to set up this up, fetch the data, and when I would use the proxy server redirector. Do I need to create a sqlite db? And to fetch do I use something like: 

curl -XPOST https://safebrowsing.googleapis.com/v4/threatListUpdates:fetch?key=MY_API_KEY -d

{
  "client": {
    "clientId":       "name",
    "clientVersion":  "1.5.2"
  },
  "listUpdateRequests": [{
    "threatType":      "MALWARE",
    "platformType":    "WINDOWS",
    "threatEntryType": "URL",
    "state":           "",
    }
  }]
}

At this time I don't want to run with contraints. My apologies for the basic question, I've never worked with safebrowsing before and I'd really like to learn.

Thanks,

Jenn

[msdev...@gmail.com]

Quick update - I was able to get the POST request to come back with the json of the hash prefixes. Can anyone shed some light on how to set up and load this into a database so that each prefix is it's own entry?

Thanks,

Jenn

[Alex Wozniak]

Hi Jenn,

I would encourage you to look at our open source client implementation on Github. You can either use that or use it as a guide for implementing your own client.

https://github.com/google/safebrowsing

Alex

[theycal...@gmail.com]

Hi Jenn. I think we're about at the same point in the process. Have you made any progress since your last post? I don't really have anything to help you with, but my recent post is the most recent one in this group. Maybe there's something there that's helpful, doubt it, but happy to exchange ideas on this.

fubar

[TG]

Anyone figure it out? I'm trying to fetch the offline list for Cpanel modsec but I cannot figure out a way of doing it. I don't know why it's so hard to fetch the file. 

I'm trying to do this...

https://developers.google.com/safe-browsing/v4/local-databases