Extract data from another site.

anubhaw gupta

Actually i have a doubt. I was thinking to make some tool but the problem is that it needs to extract some data which is in datagrid in some other site. Is it possible to extract those data from that site and store it in,say,textbox in my site. :doh:

-ANUBHAW-

AmitGajjar

Yes, that is possible. All web pages are actually an html pages. And your grid data will be in the html Table. so you need to read the html table data. Here[^] is the sample code to read site as an html. best of luck :)

Thanks -Amit Gajjar (MinterProject)

anubhaw gupta

Thanks for that. Really Appreciate that but am getting a problem. Error says: "Could not find file 'C:\Program Files (x86)\Common Files\Microsoft Shared\DevServer\10.0\www.google.com'." Am not getting that what's the problem.

AmitGajjar

are you using same code given in the link ?

Thanks -Amit Gajjar (MinterProject)

anubhaw gupta

Hey thanks. Actually i got it. What i was missing was that i wasnt prefixing "http://" before. but it's ok now. but there's a diff issue now. I have a page say "http://ev~.in/.../..../~.jsp" It's showing error that "

A potentially dangerous Request.Form value was detected from the client (txtdest="<!doctype html><html...").

Description: Request Validation has detected a potentially dangerous client input value, and processing of the request has been aborted. This value may indicate an attempt to compromise the security of your application, such as a cross-site scripting attack. To allow pages to override application request validation settings, set the requestValidationMode attribute in the httpRuntime configuration section to requestValidationMode="2.0". Example: <httpRuntime requestValidationMode="2.0" />. After setting this value, you can then disable request validation by setting validateRequest="false" in the Page directive or in the <pages> configuration section. However, it is strongly recommended that your application explicitly check all inputs in this case. For more information, see http://go.microsoft.com/fwlink/?LinkId=153133.

" I guess we cant bypass that. right? What my main aim is that i have table under tht page (i have to login too) which shows attendance. I just want to extract the attendance thing. Is it possible?

AmitGajjar

check http://forums.asp.net/t/1634650.aspx[^] discussion.

Thanks -Amit Gajjar (MinterProject)

anubhaw gupta

Really sorry for bugging you. But the "unvalidated" is showing error. it says it doesnt contain a definition for unvalidated.

AmitGajjar

Use above section in config file.

Thanks -Amit Gajjar (MinterProject)

anubhaw gupta

Thanks. It still showing tht problem. tried tweaking things up but aint working. Will try more. :)

AmitGajjar

there are lots of discussion on similar error. you can try one of the solution and let me know, in case you have any issue. best luck

Thanks -Amit Gajjar (MinterProject)

anubhaw gupta

I got that. One more question. Suppose i want to get the html of facebook.com. it'll give me that. but once i login,it will still give the old i.e the default html code. how to get the new changed code?

AmitGajjar

never tried with facebook or such a big sites but for security reason they may have restricted such request. but try with storing session information and crawl all the links on the page.

Thanks -Amit Gajjar (MinterProject)

anubhaw gupta

Thanks a lot. :)