Thread: who has made simple searching engine?

  1. #1
    Registered User
    Join Date
    Aug 2006

    Unhappy who has made simple searching engine?

    now im making a searching engine for 30G data of the BBS of my school,disregarding complex sorting function.

    the way how this programme works is obvious and i made it,which works well and fast.however how to make the index file fast,becomes a very hard difficulty.

    on a 3GHzCPU,1G Mem PC,its very hard to make a index file fast(in a few hours) for a 10G data,which will be obvious if u think about it a little more.

    any one has made this thing before?could you give me some tips?


  2. #2
    and the hat of int overfl Salem's Avatar
    Join Date
    Aug 2001
    The edge of the known universe
    Creating the index file is something which only happens once, or at regularly scheduled intervals.

    It's the looking things up in the index which has to happen quickly.

    How do you think google manages to search X billion web pages in <1 second - very good indexes and saved popular searches I would imagine.
    If you dance barefoot on the broken glass of undefined behaviour, you've got to expect the occasional cut.
    If at first you don't succeed, try writing your phone number on the exam paper.

  3. #3
    (?<!re)tired Mario F.'s Avatar
    Join Date
    May 2006
    All index "files" I developed where for websites page searches. It always involved a database to store the indexed strings. Unless you can come up with a faster way to access indexed data, then I suggest you think database.
    Originally Posted by brewbuck:
    Reimplementing a large system in another language to get a 25% performance boost is nonsense. It would be cheaper to just get a computer which is 25% faster.

Popular pages Recent additions subscribe to a feed

Similar Threads

  1. little problem with a simple shell program i made.
    By keira in forum Linux Programming
    Replies: 2
    Last Post: 02-26-2008, 11:42 PM
  2. Ultra chess engine contest
    By yodacpp in forum Projects and Job Recruitment
    Replies: 8
    Last Post: 11-21-2004, 07:58 AM
  3. DirectX engine nearing completion
    By VirtualAce in forum Game Programming
    Replies: 2
    Last Post: 01-12-2004, 05:07 PM
  4. Game structure, any thoughts?
    By Vorok in forum Game Programming
    Replies: 2
    Last Post: 06-07-2003, 01:47 PM
  5. Very simple question, problem in my Code.
    By Vber in forum C Programming
    Replies: 7
    Last Post: 11-16-2002, 03:57 PM