Extract data from another site.

AmitGajjar

are you using same code given in the link ?

Thanks -Amit Gajjar (MinterProject)

anubhaw gupta

Hey thanks. Actually i got it. What i was missing was that i wasnt prefixing "http://" before. but it's ok now. but there's a diff issue now. I have a page say "http://ev~.in/.../..../~.jsp" It's showing error that "

A potentially dangerous Request.Form value was detected from the client (txtdest="<!doctype html><html...").

Description: Request Validation has detected a potentially dangerous client input value, and processing of the request has been aborted. This value may indicate an attempt to compromise the security of your application, such as a cross-site scripting attack. To allow pages to override application request validation settings, set the requestValidationMode attribute in the httpRuntime configuration section to requestValidationMode="2.0". Example: <httpRuntime requestValidationMode="2.0" />. After setting this value, you can then disable request validation by setting validateRequest="false" in the Page directive or in the <pages> configuration section. However, it is strongly recommended that your application explicitly check all inputs in this case. For more information, see http://go.microsoft.com/fwlink/?LinkId=153133.

" I guess we cant bypass that. right? What my main aim is that i have table under tht page (i have to login too) which shows attendance. I just want to extract the attendance thing. Is it possible?

AmitGajjar

check http://forums.asp.net/t/1634650.aspx[^] discussion.

Thanks -Amit Gajjar (MinterProject)

anubhaw gupta

Really sorry for bugging you. But the "unvalidated" is showing error. it says it doesnt contain a definition for unvalidated.

AmitGajjar

Use above section in config file.

Thanks -Amit Gajjar (MinterProject)

anubhaw gupta

Thanks. It still showing tht problem. tried tweaking things up but aint working. Will try more. :)

AmitGajjar

there are lots of discussion on similar error. you can try one of the solution and let me know, in case you have any issue. best luck

Thanks -Amit Gajjar (MinterProject)

anubhaw gupta

I got that. One more question. Suppose i want to get the html of facebook.com. it'll give me that. but once i login,it will still give the old i.e the default html code. how to get the new changed code?

AmitGajjar

never tried with facebook or such a big sites but for security reason they may have restricted such request. but try with storing session information and crawl all the links on the page.

Thanks -Amit Gajjar (MinterProject)

anubhaw gupta

Thanks a lot. :)