How to Set IsCrawler To True?

[Nagaraj Muthuchamy]

Hi, I need to set the my webrequest as it is originating from a search engine crawler. So, The server side code can have "true" value for IsCrawler Propety. I am using WebRequest Class to Make the Request. Please, I have been searching this for a month. Thanks, Nagaraj

Programmer (ror)

[N a v a n e e t h]

Nagaraj Muthuchamy wrote:

I need to set the my webrequest as it is originating from a search engine crawler.

You can cast the WebRequest.Create to a HttpWebRequest object and set the UserAgent property similar to a crawler sets. This[^] paper explains how a crawler is identified. Read this and follow the same format.

Navaneeth How to use google | Ask smart questions