|All requests||>||Retrieve search results from Google||>||Request new recommendation||>||Featured requests||>||No recommendations|
by muhammad daqqa - 6 years ago (2014-11-03)
My problem is that Google API of Custom Search have limitation in using there API, like get just 32 results for every query, and perform maybe maximum 100 queries per day.
So I need script that retrieve search results from Google without limitation and store the results in a database in the server.
I am not sure if it is a good idea to develop a system based on scraping Google search results because it seems Google does not want you to do that.
So over time they may implement further changes that make current scraping solutions stop working.
Anyway, there are several good classes for scraping Google search results. This one is ready to route requests via proxy servers.
1. by muhammad daqqa - 6 years ago (2014-11-05) Reply
Hi Manuel Lemos, Thanks a lot for your answer, I will check the link. I need this script for my final project,because I will need to retrieve results that relevant to my keywords stored in my DB, and after that I will do analyses to the results I got from any search engine to recommends to users about similar web sites relevant to there favorites websites.
I you knew how to do something like that, tell me please. I'm already searched a lot in Google to do this project, but there is no good material. If I will find something relevant I will post it here.
Best regards, Muhammad Daqqa