How to design a web spider

[Fired Fish Gmail]

I want to program a web spider to search the resource from web by a URL? How to judge the resource, such as JPG, mp3?

[Mycroft Holmes]

Fired.Fish.Gmail wrote:

I want to program a web spider

Do a little basic research and you will find an article here on CP that may help you clickety[^]

Never underestimate the power of human stupidity RAH

[Fired Fish Gmail]

I downlaod the aspseek, but I find it is too big and donot know where is the rearch function. I only want to know how to search the resource from a url