reading web page
-
how to read next page of the same URL the URL of the page contain many pages i read the first page using URL(url).openStream() but it just reading the first page for example this site i read the first page how can i read the second culture.gov.uk/news/news_stories/6832.aspx
You could set up a wired script, forcing the Server to hand over all it's pages - or the script cuts off the power! :wtf: Or you use the weblinks to retrieve the data like the rest of us would do (well - most of us...). Weblinks start with "< a ...>" and do end with "". regards, Torsten
I never finish anyth...
modified on Wednesday, December 15, 2010 2:30 AM
-
You could set up a wired script, forcing the Server to hand over all it's pages - or the script cuts off the power! :wtf: Or you use the weblinks to retrieve the data like the rest of us would do (well - most of us...). Weblinks start with "< a ...>" and do end with "". regards, Torsten
I never finish anyth...
modified on Wednesday, December 15, 2010 2:30 AM
-
damn - I can't think of a single webpage explaining how a HTML Link looks like... :confused: Where is the problem? Don't you know how to program in general? Or are you just a student trying to get a non regular homework done without invest? regards, Torsten
I never finish anyth...
-
Try searching for "java web crawler". That will show you some examples that do something similar.
-
damn - I can't think of a single webpage explaining how a HTML Link looks like... :confused: Where is the problem? Don't you know how to program in general? Or are you just a student trying to get a non regular homework done without invest? regards, Torsten
I never finish anyth...
i am not asking about the links the page use java scripts so i want to ask about handling the Java script i my program to go to next page the JavaScript is as the following
a href="javascript: __doPostBack('ctl00$PlaceHolderMain$g_781eb52f_faa9_4d59_9cae_2baec06ac484','dvt_firstrow={11};dvt_startposition={Paged=TRUE&p_Created_x0020_Date=11%2f10%2f2009%206%3a06%3a47%20AM&p_ID=257}');"><img border="0" alt="Next" src="/_layouts/images/next.gif"></a>
-
i am not asking about the links the page use java scripts so i want to ask about handling the Java script i my program to go to next page the JavaScript is as the following
a href="javascript: __doPostBack('ctl00$PlaceHolderMain$g_781eb52f_faa9_4d59_9cae_2baec06ac484','dvt_firstrow={11};dvt_startposition={Paged=TRUE&p_Created_x0020_Date=11%2f10%2f2009%206%3a06%3a47%20AM&p_ID=257}');"><img border="0" alt="Next" src="/_layouts/images/next.gif"></a>
This is a JS command. On clicking that link, there is some action to be done. __doPostBack(args) seems to be a command from some Web2.0-Page. Where is it from? Facebook? Twitter? A CMS should always send plain text-links like posted/linked before. These are links you can observe. regards, Torsten
I never finish anyth...
-
This is a JS command. On clicking that link, there is some action to be done. __doPostBack(args) seems to be a command from some Web2.0-Page. Where is it from? Facebook? Twitter? A CMS should always send plain text-links like posted/linked before. These are links you can observe. regards, Torsten
I never finish anyth...
-
actually i want to extract all the links from web page but the page contain many pages using Java script with the same URL i try to use HtmlUnit but it give me error the link is from university web site
-
You can extract links to pages - not some wired submit-actions. Have you checked Davids suggestion? There is a tutorial on this on one of those good old sun-servers: Clickedy regards, Torsten
I never finish anyth...
-
yes i try to search a bout web crawling but non of them handle the JavaScript do you have other suggests or library that can help