Mini Google Intranet based Search Engine

[Pankaj Garg]

I have a Search Engine Project . It is an intranet based application . I will have 30 servers , where i will search into the files for the particular keywords . Each server may have it's own server speed (server1 = 100 mbps , server2 = 150 mbbs ......and so on server30 = 10 mbps) . While searching to those servers which have low speed , can have the possibility to become inaccessible , in case of congestion , so how should I take into the search consideration in this case , should they be given low priority , as compared to servers having high speed . I mean , search will be done , but they will be prioritized in the order of their speed . There are few case that can take place, like , the speed is slow at the particular server , so should time slicing be done to search the keyword on all servers.(server 1 = 2 seconds , server 2 = 2 seconds ,..... and so on till 30 servers).if i found any server inaccessible or it is currently shut down , in that case after the completion of search on all servers , search will be made again on those servers , which were not available.this looping for search into the inaccessible server will be made 2-3 times.The most important thing is operatng system can be platform independent (it can be microsoft windows , unix , linux etc) . The file can be of any extention. Now my question is , which aspects I need to concentrate on , while doing the programming . The platform is ASP.net database is sql server.

If you have an apple & I have an apple and we exchange our apples, then each of us will still have only one apple but if you have an idea & I have an idea and we exchange our ideas, then each of us will have two ideas!

[Christian Graus]

Building a good index, and searching it accurately. The other main issue you have is making sure the servers work well together. Not sure what you're asking, really......

Christian Graus Please read this if you don't understand the answer I've given you "also I don't think "TranslateOneToTwoBillion OneHundredAndFortySevenMillion FourHundredAndEightyThreeThousand SixHundredAndFortySeven()" is a very good choice for a function name" - SpacixOne ( offering help to someone who really needed it ) ( spaces added for the benefit of people running at < 1280x1024 )

[MHASSANF]

maybe these are useful : http://iswc2006.semanticweb.org/items/Harth2006dq.pdf[^] http://www.informatics.indiana.edu/fil/Papers/crawling.pdf[^]