Page 1 of 2 12 LastLast
Results 1 to 10 of 15

Thread: search bot

  1. #1
    Join Date
    Feb 2006
    Location
    Ontario Canada
    Posts
    4,587
    Tokens
    0

    Latest Awards:

    Default search bot

    is it possible to make a php script or bot or cron job that searches say hockey on google or w.e and copys the 3 feilds (name,description,url) and then inserts it into a mysql database?
    or something like that so i dont have to manually add sites to my search engine.

    .:.:#14:.:. .:.: Impossible Is Nothing :.:. .:.: 845 Rep:.:.
    .:.: Stand up for what is right, even if you stand alone:.:.


  2. #2
    Join Date
    Sep 2006
    Location
    Doncaster, UK
    Posts
    574
    Tokens
    0

    Default

    Quote Originally Posted by Soccer-Pro View Post
    is it possible to make a php script or bot or cron job that searches say hockey on google or w.e and copys the 3 feilds (name,description,url) and then inserts it into a mysql database?
    or something like that so i dont have to manually add sites to my search engine.
    Isnt that stealing?

    Make a script so people can add their own site.
    Cheesecake.

  3. #3
    Join Date
    Feb 2006
    Location
    Ontario Canada
    Posts
    4,587
    Tokens
    0

    Latest Awards:

    Default

    there is one already and it aint stealing google doesnt own any of those sites.
    Last edited by Colin-Roberts; 06-09-2006 at 09:10 PM.

    .:.:#14:.:. .:.: Impossible Is Nothing :.:. .:.: 845 Rep:.:.
    .:.: Stand up for what is right, even if you stand alone:.:.


  4. #4
    Join Date
    Mar 2005
    Location
    Leeds
    Posts
    3,423
    Tokens
    0

    Latest Awards:

    Default

    If your going to do that you may aswell just when someone searches something it adds 100 google results to your database. Could be done.

  5. #5
    Join Date
    Jul 2006
    Posts
    293
    Tokens
    0

    Default

    Quote Originally Posted by Soccer-Pro View Post
    is it possible to make a php script or bot or cron job that searches say hockey on google or w.e and copys the 3 feilds (name,description,url) and then inserts it into a mysql database?
    or something like that so i dont have to manually add sites to my search engine.
    Can i have ur scripty?

    [willing 2 pay u with a domain and hosting]

  6. #6
    Join Date
    Feb 2006
    Location
    Ontario Canada
    Posts
    4,587
    Tokens
    0

    Latest Awards:

    Default

    na looking for money..
    and lucky rare could you explain how plz?
    Last edited by Colin-Roberts; 07-09-2006 at 11:04 AM.

    .:.:#14:.:. .:.: Impossible Is Nothing :.:. .:.: 845 Rep:.:.
    .:.: Stand up for what is right, even if you stand alone:.:.


  7. #7
    Join Date
    Mar 2005
    Location
    Leeds
    Posts
    3,423
    Tokens
    0

    Latest Awards:

    Default

    Quote Originally Posted by Soccer-Pro View Post
    na looking for money..
    and lucky rare could you explain how plz?
    This is one way of doing it, get google contents using file_get_contents on file http://www.google.co.uk/search?q=*search here* then using eregi to get the urls, descriptions, titles and so on. Just have a play.
    Last edited by Luckyrare; 07-09-2006 at 01:45 PM.

  8. #8
    Join Date
    Feb 2006
    Location
    Ontario Canada
    Posts
    4,587
    Tokens
    0

    Latest Awards:

    Default

    kk got most of what you mean figured out but whats eregi?

    .:.:#14:.:. .:.: Impossible Is Nothing :.:. .:.: 845 Rep:.:.
    .:.: Stand up for what is right, even if you stand alone:.:.


  9. #9
    Join Date
    Feb 2006
    Location
    Ontario Canada
    Posts
    4,587
    Tokens
    0

    Latest Awards:

    Default

    cant edit sry i searched google and sort off under stand what eregi does so i include say http://www.google.ca/search?hl=en&q=colin then i tryed to insert the feilds (new feild being separted by a space but it didnt work) using part of nets hang man script but it didnt work atall, so im back to file_get_contents and echoing it if i could just figure out how to seperate the feilds then i could write the mysql part.

    .:.:#14:.:. .:.: Impossible Is Nothing :.:. .:.: 845 Rep:.:.
    .:.: Stand up for what is right, even if you stand alone:.:.


  10. #10
    Join Date
    Aug 2004
    Location
    UK
    Posts
    11,283
    Tokens
    2,031

    Latest Awards:

    Default

    Kinda a compleate waste of time, Go to the Google Dev Site and get a Developers key, then u can use the Search API to get the data direrectly for use for what ever you want. Far easyer o.0

Page 1 of 2 12 LastLast

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •