Extracting info from a remote web site
-
HELP I am writing a vb.net app to log in to a remote web site, sift through the menu href links and extract useful information. I have the program connecting to the remote url, loading the page into a string, parsing the string and forming an array of url's containing the information pages. This part works well. Unfortunately the second level pages require a login process which redirects to a login asp page, posts username and password values to the server and sets cookies on the local machine. My code returns an exception - the remote server returns a (404) not found" on the I am having trouble finding example code for getting around basic problems: - detecting whether it has been redirected - posting the username/password values to the login page - handling the server's cookie Any suggestions???? :eek:
-
HELP I am writing a vb.net app to log in to a remote web site, sift through the menu href links and extract useful information. I have the program connecting to the remote url, loading the page into a string, parsing the string and forming an array of url's containing the information pages. This part works well. Unfortunately the second level pages require a login process which redirects to a login asp page, posts username and password values to the server and sets cookies on the local machine. My code returns an exception - the remote server returns a (404) not found" on the I am having trouble finding example code for getting around basic problems: - detecting whether it has been redirected - posting the username/password values to the login page - handling the server's cookie Any suggestions???? :eek:
Maybe I can help... I worked on a MSNP9 implementation and used HTTPS authentication, maybe it will not differ much from what you want to do... Send your code and I'll see what I can do greetz ;-) *Niels Penneman*
Software/Dev Site
Personal Site