search bot

[Colin-Roberts]

is it possible to make a php script or bot or cron job that searches say hockey on google or w.e and copys the 3 feilds (name,description,url) and then inserts it into a mysql database?
or something like that so i dont have to manually add sites to my search engine.

[Vixt]

is it possible to make a php script or bot or cron job that searches say hockey on google or w.e and copys the 3 feilds (name,description,url) and then inserts it into a mysql database?
or something like that so i dont have to manually add sites to my search engine.
Isnt that stealing?

Make a script so people can add their own site.

[Colin-Roberts]

there is one already and it aint stealing google doesnt own any of those sites.

[Luckyrare]

If your going to do that you may aswell just when someone searches something it adds 100 google results to your database. Could be done.

[Xelp]

is it possible to make a php script or bot or cron job that searches say hockey on google or w.e and copys the 3 feilds (name,description,url) and then inserts it into a mysql database?
or something like that so i dont have to manually add sites to my search engine.

Can i have ur scripty?

[willing 2 pay u with a domain and hosting]

[Colin-Roberts]

na looking for money..
and lucky rare could you explain how plz?

[Luckyrare]

na looking for money..
and lucky rare could you explain how plz?

This is one way of doing it, get google contents using file_get_contents on file http://www.google.co.uk/search?q=*search here* then using eregi to get the urls, descriptions, titles and so on. Just have a play.

[Colin-Roberts]

kk got most of what you mean figured out but whats eregi?

[Colin-Roberts]

cant edit sry i searched google and sort off under stand what eregi does so i include say http://www.google.ca/search?hl=en&q=colin then i tryed to insert the feilds (new feild being separted by a space but it didnt work) using part of nets hang man script but it didnt work atall, so im back to file_get_contents and echoing it if i could just figure out how to seperate the feilds then i could write the mysql part.

[Mentor]

Kinda a compleate waste of time, Go to the Google Dev Site and get a Developers key, then u can use the Search API to get the data direrectly for use for what ever you want. Far easyer o.0

[Colin-Roberts]

lol far more boring.. i'd rather do this.. (ye im ****ing bored)

[Mentor]

yar, but if you do it the dev key way, your server will be less likly to get its ip banned by the google network for bandwidth abuse.

[Colin-Roberts]

lol oww well ill just have to ask lucky rare to explain more.

[Luckyrare]

www.php.net/eregi


If you are going to use googles results, people may aswell stick with google. You could just make it so people can add there webpage in one url so they dont have to enter the form and just use $_GET. This would be google because people could modify their blogs to intergrate this very easily. Anyway have fun. And I agree with mentor on the subject with google bandwidth.

[Colin-Roberts]

lol ok i'll might have a better idea of doing something anyway..