Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
  1. Home
  2. General Programming
  3. Visual Basic
  4. 'Out Of Memory Exception' during Data Access

'Out Of Memory Exception' during Data Access

Scheduled Pinned Locked Moved Visual Basic
helpdatabaseperformance
6 Posts 3 Posters 0 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • M Offline
    M Offline
    mayhem_rules
    wrote on last edited by
    #1

    Hi, I am querying a DB and I want to get the data (Around 1 crore records) in a dataset. then I want to perform other operations on the data in the dataset. However, the process does not complete correctly. The program displays an 'Out Of Memory Exception' and the process is terminated. Can anyone suggest how this issue can be overcome. Thnx for any help. With Best Regards, Mayur

    V D 2 Replies Last reply
    0
    • M mayhem_rules

      Hi, I am querying a DB and I want to get the data (Around 1 crore records) in a dataset. then I want to perform other operations on the data in the dataset. However, the process does not complete correctly. The program displays an 'Out Of Memory Exception' and the process is terminated. Can anyone suggest how this issue can be overcome. Thnx for any help. With Best Regards, Mayur

      V Offline
      V Offline
      Vasudevan Deepak Kumar
      wrote on last edited by
      #2

      Mayur, A closest discussion thread for your problem in hand: http://forums.oracle.com/forums/message.jspa?messageID=904915[^] Vasudevan Deepak Kumar Personal Web: http://www.lavanyadeepak.tk/ I Blog At: http://www.dotnetjunkies.com/weblog/deepak/
      http://deepakvasudevan.blogspot.com/
      http://deepak.blogdrive.com/

      M 1 Reply Last reply
      0
      • V Vasudevan Deepak Kumar

        Mayur, A closest discussion thread for your problem in hand: http://forums.oracle.com/forums/message.jspa?messageID=904915[^] Vasudevan Deepak Kumar Personal Web: http://www.lavanyadeepak.tk/ I Blog At: http://www.dotnetjunkies.com/weblog/deepak/
        http://deepakvasudevan.blogspot.com/
        http://deepak.blogdrive.com/

        M Offline
        M Offline
        mayhem_rules
        wrote on last edited by
        #3

        Thnx Deepak. I am using Vb.NEGT with MS Access. Do you mean to say that I need to use OledbDataReader to retrieve the data? With Best Regards, Mayur

        1 Reply Last reply
        0
        • M mayhem_rules

          Hi, I am querying a DB and I want to get the data (Around 1 crore records) in a dataset. then I want to perform other operations on the data in the dataset. However, the process does not complete correctly. The program displays an 'Out Of Memory Exception' and the process is terminated. Can anyone suggest how this issue can be overcome. Thnx for any help. With Best Regards, Mayur

          D Offline
          D Offline
          Dave Kreskowiak
          wrote on last edited by
          #4

          How many records are you reading??? Are you sure to need them all in memory at the same time, or can you get away with only reading a few at a time, while doing your processing. And, yes, with an Access database, you have to use the OleDb database classes. RageInTheMachine9532 "...a pungent, ghastly, stinky piece of cheese!" -- The Roaming Gnome

          M 1 Reply Last reply
          0
          • D Dave Kreskowiak

            How many records are you reading??? Are you sure to need them all in memory at the same time, or can you get away with only reading a few at a time, while doing your processing. And, yes, with an Access database, you have to use the OleDb database classes. RageInTheMachine9532 "...a pungent, ghastly, stinky piece of cheese!" -- The Roaming Gnome

            M Offline
            M Offline
            mayhem_rules
            wrote on last edited by
            #5

            Hi, I am trying to get the entire data into the dataset and then let the user query this dataset as per his needs. What is happening currently is that every query is being run directly on the database. I want to avoid this. With Best Regards, Mayur

            D 1 Reply Last reply
            0
            • M mayhem_rules

              Hi, I am trying to get the entire data into the dataset and then let the user query this dataset as per his needs. What is happening currently is that every query is being run directly on the database. I want to avoid this. With Best Regards, Mayur

              D Offline
              D Offline
              Dave Kreskowiak
              wrote on last edited by
              #6

              I take it that you're loading 1 Million records? You're MUCH better off leaving the data in the database and just running the queries against that. The .NET Framework objects are not designed to handle that much data and are not nearly as efficient at searching through it as the database engine is. The traffic you send and, more importantly, receive to/from the SQL Server (or whatever) will be FAR less than retrieving that mountain of records. RageInTheMachine9532 "...a pungent, ghastly, stinky piece of cheese!" -- The Roaming Gnome

              1 Reply Last reply
              0
              Reply
              • Reply as topic
              Log in to reply
              • Oldest to Newest
              • Newest to Oldest
              • Most Votes


              • Login

              • Don't have an account? Register

              • Login or register to search.
              • First post
                Last post
              0
              • Categories
              • Recent
              • Tags
              • Popular
              • World
              • Users
              • Groups