Bing Scraper

32 views
Skip to first unread message

yassir karroum

unread,
Aug 17, 2016, 10:28:26 AM8/17/16
to beautifulsoup
Hello,

I created a Bing Scrapper (it is named Google Scrapper but using Google gives very poor results), it us BeautifulSoup to scrape the results without a limit.
It also use tor to change the ip to bypass the protections made by bing.

It is really easy to use :

$ python3 google_scraper.py --help

Usage: python3 google-scraper [OPTION] ... [FILE] {QUERY}
A python script who can fetch the results from famous search engine like google bing and startpage. Options : QUERY :the search query ex : program, site:.ma, inurl:index.php, etc. --searchEngine=SEARCH ENGINE The search Engine : Google, Bing, StartPage --begin=X --number=Y --fileout=FILE The output location.

the source code is available at github : https://github.com/ukarroum/google-scraper

hope you like it !

Reply all
Reply to author
Forward
0 new messages