Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
  1. Home
  2. General Programming
  3. Java
  4. reading web page

reading web page

Scheduled Pinned Locked Moved Java
tutorialquestionannouncement
11 Posts 3 Posters 0 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • A Offline
    A Offline
    asha_s
    wrote on last edited by
    #1

    how to read next page of the same URL the URL of the page contain many pages i read the first page using URL(url).openStream() but it just reading the first page for example this site i read the first page how can i read the second culture.gov.uk/news/news_stories/6832.aspx

    T 1 Reply Last reply
    0
    • A asha_s

      how to read next page of the same URL the URL of the page contain many pages i read the first page using URL(url).openStream() but it just reading the first page for example this site i read the first page how can i read the second culture.gov.uk/news/news_stories/6832.aspx

      T Offline
      T Offline
      TorstenH
      wrote on last edited by
      #2

      You could set up a wired script, forcing the Server to hand over all it's pages - or the script cuts off the power! :wtf: Or you use the weblinks to retrieve the data like the rest of us would do (well - most of us...). Weblinks start with "< a ...>" and do end with "". regards, Torsten

      I never finish anyth...

      modified on Wednesday, December 15, 2010 2:30 AM

      A 1 Reply Last reply
      0
      • T TorstenH

        You could set up a wired script, forcing the Server to hand over all it's pages - or the script cuts off the power! :wtf: Or you use the weblinks to retrieve the data like the rest of us would do (well - most of us...). Weblinks start with "< a ...>" and do end with "". regards, Torsten

        I never finish anyth...

        modified on Wednesday, December 15, 2010 2:30 AM

        A Offline
        A Offline
        asha_s
        wrote on last edited by
        #3

        Can you give me example

        T D 2 Replies Last reply
        0
        • A asha_s

          Can you give me example

          T Offline
          T Offline
          TorstenH
          wrote on last edited by
          #4

          damn - I can't think of a single webpage explaining how a HTML Link looks like... :confused: Where is the problem? Don't you know how to program in general? Or are you just a student trying to get a non regular homework done without invest? regards, Torsten

          I never finish anyth...

          A 1 Reply Last reply
          0
          • A asha_s

            Can you give me example

            D Offline
            D Offline
            David Skelly
            wrote on last edited by
            #5

            Try searching for "java web crawler". That will show you some examples that do something similar.

            1 Reply Last reply
            0
            • T TorstenH

              damn - I can't think of a single webpage explaining how a HTML Link looks like... :confused: Where is the problem? Don't you know how to program in general? Or are you just a student trying to get a non regular homework done without invest? regards, Torsten

              I never finish anyth...

              A Offline
              A Offline
              asha_s
              wrote on last edited by
              #6

              i am not asking about the links the page use java scripts so i want to ask about handling the Java script i my program to go to next page the JavaScript is as the following

              a href="javascript: __doPostBack('ctl00$PlaceHolderMain$g_781eb52f_faa9_4d59_9cae_2baec06ac484','dvt_firstrow={11};dvt_startposition={Paged=TRUE&p_Created_x0020_Date=11%2f10%2f2009%206%3a06%3a47%20AM&p_ID=257}');"><img border="0" alt="Next" src="/_layouts/images/next.gif"></a>

              T 1 Reply Last reply
              0
              • A asha_s

                i am not asking about the links the page use java scripts so i want to ask about handling the Java script i my program to go to next page the JavaScript is as the following

                a href="javascript: __doPostBack('ctl00$PlaceHolderMain$g_781eb52f_faa9_4d59_9cae_2baec06ac484','dvt_firstrow={11};dvt_startposition={Paged=TRUE&p_Created_x0020_Date=11%2f10%2f2009%206%3a06%3a47%20AM&p_ID=257}');"><img border="0" alt="Next" src="/_layouts/images/next.gif"></a>

                T Offline
                T Offline
                TorstenH
                wrote on last edited by
                #7

                This is a JS command. On clicking that link, there is some action to be done. __doPostBack(args) seems to be a command from some Web2.0-Page. Where is it from? Facebook? Twitter? A CMS should always send plain text-links like posted/linked before. These are links you can observe. regards, Torsten

                I never finish anyth...

                A 1 Reply Last reply
                0
                • T TorstenH

                  This is a JS command. On clicking that link, there is some action to be done. __doPostBack(args) seems to be a command from some Web2.0-Page. Where is it from? Facebook? Twitter? A CMS should always send plain text-links like posted/linked before. These are links you can observe. regards, Torsten

                  I never finish anyth...

                  A Offline
                  A Offline
                  asha_s
                  wrote on last edited by
                  #8

                  actually i want to extract all the links from web page but the page contain many pages using Java script with the same URL i try to use HtmlUnit but it give me error the link is from university web site

                  T 1 Reply Last reply
                  0
                  • A asha_s

                    actually i want to extract all the links from web page but the page contain many pages using Java script with the same URL i try to use HtmlUnit but it give me error the link is from university web site

                    T Offline
                    T Offline
                    TorstenH
                    wrote on last edited by
                    #9

                    You can extract links to pages - not some wired submit-actions. Have you checked Davids suggestion? There is a tutorial on this on one of those good old sun-servers: Clickedy regards, Torsten

                    I never finish anyth...

                    A 1 Reply Last reply
                    0
                    • T TorstenH

                      You can extract links to pages - not some wired submit-actions. Have you checked Davids suggestion? There is a tutorial on this on one of those good old sun-servers: Clickedy regards, Torsten

                      I never finish anyth...

                      A Offline
                      A Offline
                      asha_s
                      wrote on last edited by
                      #10

                      yes i try to search a bout web crawling but non of them handle the JavaScript do you have other suggests or library that can help

                      T 1 Reply Last reply
                      0
                      • A asha_s

                        yes i try to search a bout web crawling but non of them handle the JavaScript do you have other suggests or library that can help

                        T Offline
                        T Offline
                        TorstenH
                        wrote on last edited by
                        #11

                        no. do your own search. regards, Torsten

                        I never finish anyth...

                        1 Reply Last reply
                        0
                        Reply
                        • Reply as topic
                        Log in to reply
                        • Oldest to Newest
                        • Newest to Oldest
                        • Most Votes


                        • Login

                        • Don't have an account? Register

                        • Login or register to search.
                        • First post
                          Last post
                        0
                        • Categories
                        • Recent
                        • Tags
                        • Popular
                        • World
                        • Users
                        • Groups