Hello and welcome to our community! Is this your first visit?
Register
Enjoy an ad free experience by logging in. Not a member yet? Register.
Results 1 to 2 of 2
  1. #1
    Senior Coder Nightfire's Avatar
    Join Date
    Jun 2002
    Posts
    4,265
    Thanks
    6
    Thanked 48 Times in 48 Posts

    Search engine bots

    I've been creating a search engine for a while, doint bits and bobs on it when I get time, but I'm thinking of creating a search engine bot for it. The thing is, I don't really know what a bot is. I understand it crawls pages, gets the info and then puts all the info into the db, but how? What is a bot created from? How does it read the text? How much info does it take in from each page?

    I don't really know which forum this belongs in either, is it server side programming or some kind of program which runs on the server?

    Can you help find tutorials on how to create a bot?

    So many questions, so little time Wish I'd stop thinking of new ideas and just finish the prgram off

  • #2
    Regular Coder Feyd's Avatar
    Join Date
    May 2002
    Location
    Los Angeles, CA Maxim: Subvert Society
    Posts
    403
    Thanks
    0
    Thanked 0 Times in 0 Posts
    Last edited by Feyd; 11-12-2002 at 10:07 PM.
    Moderator, Perl/CGI Forum
    shadowstorm.net - subvert society


  •  

    Posting Permissions

    • You may not post new threads
    • You may not post replies
    • You may not post attachments
    • You may not edit your posts
    •