Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
  1. Home
  2. General Programming
  3. C#
  4. getting data over website

getting data over website

Scheduled Pinned Locked Moved C#
comtutorialquestion
13 Posts 5 Posters 0 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • E Offline
    E Offline
    Erdinc27
    wrote on last edited by
    #1

    hey guys..i want develop a program which will connect a website and it will save the some results in it..i found an example for it but there the developer import a dll to use some facebook features in his project..but in the site i want my program to connect has not such dll..so how i can get that results over the site ??

    vemedya.com

    P L S 3 Replies Last reply
    0
    • E Erdinc27

      hey guys..i want develop a program which will connect a website and it will save the some results in it..i found an example for it but there the developer import a dll to use some facebook features in his project..but in the site i want my program to connect has not such dll..so how i can get that results over the site ??

      vemedya.com

      P Offline
      P Offline
      Pete OHanlon
      wrote on last edited by
      #2

      It really depends on what site you are trying to get data from, but if it was a general purpose site, you could consider using screen scraping.

      I have CDO, it's OCD with the letters in the right order; just as they ruddy well should be

      Forgive your enemies - it messes with their heads

      My blog | My articles | MoXAML PowerToys | Onyx

      E L 2 Replies Last reply
      0
      • P Pete OHanlon

        It really depends on what site you are trying to get data from, but if it was a general purpose site, you could consider using screen scraping.

        I have CDO, it's OCD with the letters in the right order; just as they ruddy well should be

        Forgive your enemies - it messes with their heads

        My blog | My articles | MoXAML PowerToys | Onyx

        E Offline
        E Offline
        Erdinc27
        wrote on last edited by
        #3

        i will try to get it from a lottery site the results of the lottery i mean but it is not open source site..so how i can get it from the site ? and what u mean screen scraping ?

        vemedya.com

        P 1 Reply Last reply
        0
        • E Erdinc27

          i will try to get it from a lottery site the results of the lottery i mean but it is not open source site..so how i can get it from the site ? and what u mean screen scraping ?

          vemedya.com

          P Offline
          P Offline
          Pete OHanlon
          wrote on last edited by
          #4

          What does Google tell you about screen scraping? Now that I've given you a hint as to what topic to look for, it's time for you to hone your researching chops.

          I have CDO, it's OCD with the letters in the right order; just as they ruddy well should be

          Forgive your enemies - it messes with their heads

          My blog | My articles | MoXAML PowerToys | Onyx

          1 Reply Last reply
          0
          • E Erdinc27

            hey guys..i want develop a program which will connect a website and it will save the some results in it..i found an example for it but there the developer import a dll to use some facebook features in his project..but in the site i want my program to connect has not such dll..so how i can get that results over the site ??

            vemedya.com

            L Offline
            L Offline
            Lutoslaw
            wrote on last edited by
            #5

            Take a look at XPath. XPath allows you to query a specific fragment of a document which contains data you need (e.g. lottery results). However, the .NET Framework XPath is not appropriate for HTML since it is not tolerant for errors. Real HTML pages contain a lot of errors and usually they are not valid XML documents. Use a free Html Agility Pack[^]

            Greetings - Jacek

            J 1 Reply Last reply
            0
            • P Pete OHanlon

              It really depends on what site you are trying to get data from, but if it was a general purpose site, you could consider using screen scraping.

              I have CDO, it's OCD with the letters in the right order; just as they ruddy well should be

              Forgive your enemies - it messes with their heads

              My blog | My articles | MoXAML PowerToys | Onyx

              L Offline
              L Offline
              Lutoslaw
              wrote on last edited by
              #6

              I disagree that screen scraping would be a good solution for quering a web site, especially if you have access to a HTML content. I would take it as a last choice and only if I had nothing but a screen, which I can barely imagine.

              Greetings - Jacek

              P 1 Reply Last reply
              0
              • L Lutoslaw

                I disagree that screen scraping would be a good solution for quering a web site, especially if you have access to a HTML content. I would take it as a last choice and only if I had nothing but a screen, which I can barely imagine.

                Greetings - Jacek

                P Offline
                P Offline
                Pete OHanlon
                wrote on last edited by
                #7

                Screen scraping is also a term used to describe scraping content from a website, especially as he has already said he doesn't have an API available, and that there's no guarantee that the site is XHTML compliant.

                I have CDO, it's OCD with the letters in the right order; just as they ruddy well should be

                Forgive your enemies - it messes with their heads

                My blog | My articles | MoXAML PowerToys | Onyx

                L 1 Reply Last reply
                0
                • P Pete OHanlon

                  Screen scraping is also a term used to describe scraping content from a website, especially as he has already said he doesn't have an API available, and that there's no guarantee that the site is XHTML compliant.

                  I have CDO, it's OCD with the letters in the right order; just as they ruddy well should be

                  Forgive your enemies - it messes with their heads

                  My blog | My articles | MoXAML PowerToys | Onyx

                  L Offline
                  L Offline
                  Lutoslaw
                  wrote on last edited by
                  #8

                  I hate to argue on terminology, but I suppose you meant web scrapping[^]. The site does not really have to be XHTML compilant to query it (e.g. when using the library I mentioned in my another post). Ehm, whatever. Have a nice day/night or whatever currently is present in your time zone. :)

                  Greetings - Jacek

                  P 1 Reply Last reply
                  0
                  • L Lutoslaw

                    Take a look at XPath. XPath allows you to query a specific fragment of a document which contains data you need (e.g. lottery results). However, the .NET Framework XPath is not appropriate for HTML since it is not tolerant for errors. Real HTML pages contain a lot of errors and usually they are not valid XML documents. Use a free Html Agility Pack[^]

                    Greetings - Jacek

                    J Offline
                    J Offline
                    J4amieC
                    wrote on last edited by
                    #9

                    I use HtmlAgilityPack quite extensively as part of an automated testing framework (think; make HTTP request, get HTML response, check expectations using XPath). I found out yesterday, much to my chargrin, that it does not properly support attribute syntax. //someElement/@someAttribute should return someAttribute, it actually returns someElement - making it totally non xpath compliant. Bit of a bugger IMO.

                    L 1 Reply Last reply
                    0
                    • J J4amieC

                      I use HtmlAgilityPack quite extensively as part of an automated testing framework (think; make HTTP request, get HTML response, check expectations using XPath). I found out yesterday, much to my chargrin, that it does not properly support attribute syntax. //someElement/@someAttribute should return someAttribute, it actually returns someElement - making it totally non xpath compliant. Bit of a bugger IMO.

                      L Offline
                      L Offline
                      Lutoslaw
                      wrote on last edited by
                      #10

                      As a conclusion, should I avoid HtmlAgilityPack till now or we can live with the issue described?

                      Greetings - Jacek

                      1 Reply Last reply
                      0
                      • L Lutoslaw

                        I hate to argue on terminology, but I suppose you meant web scrapping[^]. The site does not really have to be XHTML compilant to query it (e.g. when using the library I mentioned in my another post). Ehm, whatever. Have a nice day/night or whatever currently is present in your time zone. :)

                        Greetings - Jacek

                        P Offline
                        P Offline
                        Pete OHanlon
                        wrote on last edited by
                        #11

                        Jacek Gajek wrote:

                        I suppose you meant web scrapping[^].

                        I stand (well sit actually) corrected. I've run into problems attempting scraping with Html Agility Pack in the past, so have tended to avoid it. Newer versions might have improved it somewhat. Have a 5 to correct whoever 2 voted it.

                        I have CDO, it's OCD with the letters in the right order; just as they ruddy well should be

                        Forgive your enemies - it messes with their heads

                        My blog | My articles | MoXAML PowerToys | Onyx

                        L 1 Reply Last reply
                        0
                        • P Pete OHanlon

                          Jacek Gajek wrote:

                          I suppose you meant web scrapping[^].

                          I stand (well sit actually) corrected. I've run into problems attempting scraping with Html Agility Pack in the past, so have tended to avoid it. Newer versions might have improved it somewhat. Have a 5 to correct whoever 2 voted it.

                          I have CDO, it's OCD with the letters in the right order; just as they ruddy well should be

                          Forgive your enemies - it messes with their heads

                          My blog | My articles | MoXAML PowerToys | Onyx

                          L Offline
                          L Offline
                          Lutoslaw
                          wrote on last edited by
                          #12

                          Pete O'Hanlon wrote:

                          Have a 5 to correct whoever 2 voted it.

                          Thanks. It looks like you have a devoted fan who cannot stand watching you being corrected.

                          Greetings - Jacek

                          1 Reply Last reply
                          0
                          • E Erdinc27

                            hey guys..i want develop a program which will connect a website and it will save the some results in it..i found an example for it but there the developer import a dll to use some facebook features in his project..but in the site i want my program to connect has not such dll..so how i can get that results over the site ??

                            vemedya.com

                            S Offline
                            S Offline
                            SantokhSingh
                            wrote on last edited by
                            #13

                            R/Sir hello i wanna attached a biomatric software with my login page so plz send me coding for it. God says i will very thanksfull for this. ************* sbajwa1@yahoo.in santokh singh

                            1 Reply Last reply
                            0
                            Reply
                            • Reply as topic
                            Log in to reply
                            • Oldest to Newest
                            • Newest to Oldest
                            • Most Votes


                            • Login

                            • Don't have an account? Register

                            • Login or register to search.
                            • First post
                              Last post
                            0
                            • Categories
                            • Recent
                            • Tags
                            • Popular
                            • World
                            • Users
                            • Groups