Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
  1. Home
  2. Database & SysAdmin
  3. Database
  4. In-memory database with acid transactions and high availability

In-memory database with acid transactions and high availability

Scheduled Pinned Locked Moved Database
databasequestionjavaapachesysadmin
8 Posts 5 Posters 2 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • M Offline
    M Offline
    Mathieu Seillier
    wrote on last edited by
    #1

    Hi, I have a question about choosing an in-memory database. Within a Java application, we need to use an in-memory database. This is a requirement of our customer : for reasons of privacy and personal data processing, he does not want the data to be stored on disk but only in memory. However, we also need a relational database because we need to store multiple information having relationships between them, we need to manage ACID transactions and we also need to store binary data (like photos). Finally, we also need high availability, if a server falls, another server must be able to respond and therefore have the same data (always in memory). What do you think is the best database that would meet these constraints? I took a look with popular relational in-memory databases : HSQLDB does not seems to have redundancy feature, H2 seems to have redundancy if used as a database server but not if used as an embedded in-memory DB, and some people told me that Apache Derby was slower Thanks for your help

    M L M 5 Replies Last reply
    0
    • M Mathieu Seillier

      Hi, I have a question about choosing an in-memory database. Within a Java application, we need to use an in-memory database. This is a requirement of our customer : for reasons of privacy and personal data processing, he does not want the data to be stored on disk but only in memory. However, we also need a relational database because we need to store multiple information having relationships between them, we need to manage ACID transactions and we also need to store binary data (like photos). Finally, we also need high availability, if a server falls, another server must be able to respond and therefore have the same data (always in memory). What do you think is the best database that would meet these constraints? I took a look with popular relational in-memory databases : HSQLDB does not seems to have redundancy feature, H2 seems to have redundancy if used as a database server but not if used as an embedded in-memory DB, and some people told me that Apache Derby was slower Thanks for your help

      M Offline
      M Offline
      Mycroft Holmes
      wrote on last edited by
      #2

      Mathieu Seillier wrote:

      for reasons of privacy and personal data processing, he does not want the data to be stored on disk but only in memory.

      Caveat - I'm not up on in memory DBs but it sounds like your client has been fed some really good kool-aid. I'd be astonished is in memory improved your security above a well set up and encrypted relational DB. You had also better have a reasonably small user base if you are storing a DB of images in memory or a hell of a lot of memory. What about DR and backups or are they expecting never to have a problem with their primary servers.

      Never underestimate the power of human stupidity - RAH I'm old. I know stuff - JSOP

      1 Reply Last reply
      0
      • M Mathieu Seillier

        Hi, I have a question about choosing an in-memory database. Within a Java application, we need to use an in-memory database. This is a requirement of our customer : for reasons of privacy and personal data processing, he does not want the data to be stored on disk but only in memory. However, we also need a relational database because we need to store multiple information having relationships between them, we need to manage ACID transactions and we also need to store binary data (like photos). Finally, we also need high availability, if a server falls, another server must be able to respond and therefore have the same data (always in memory). What do you think is the best database that would meet these constraints? I took a look with popular relational in-memory databases : HSQLDB does not seems to have redundancy feature, H2 seems to have redundancy if used as a database server but not if used as an embedded in-memory DB, and some people told me that Apache Derby was slower Thanks for your help

        L Offline
        L Offline
        Lost User
        wrote on last edited by
        #3

        SQLite can handle in memory databases, but that will certainly limit the amount of data that can be processed. And what happens when the application ends, where does the data go then? There are far better ways of securing data than this idea.

        1 Reply Last reply
        0
        • M Mathieu Seillier

          Hi, I have a question about choosing an in-memory database. Within a Java application, we need to use an in-memory database. This is a requirement of our customer : for reasons of privacy and personal data processing, he does not want the data to be stored on disk but only in memory. However, we also need a relational database because we need to store multiple information having relationships between them, we need to manage ACID transactions and we also need to store binary data (like photos). Finally, we also need high availability, if a server falls, another server must be able to respond and therefore have the same data (always in memory). What do you think is the best database that would meet these constraints? I took a look with popular relational in-memory databases : HSQLDB does not seems to have redundancy feature, H2 seems to have redundancy if used as a database server but not if used as an embedded in-memory DB, and some people told me that Apache Derby was slower Thanks for your help

          M Offline
          M Offline
          Meysam Toluie
          wrote on last edited by
          #4

          The reason they ask for In-Memory OLTP is Quach. If the Durability is SCHEMA_AND_DATA then a copy of memory exists on disk. In-Memory is not a security solution. I suggest you, to listen to their needs and plan a suitable solution. Ask them, as many as question you need to realize what they really want. Some time they can't explain the real things, that they are worry about.

          SignatureNotFoundException

          OriginalGriffO 1 Reply Last reply
          0
          • M Mathieu Seillier

            Hi, I have a question about choosing an in-memory database. Within a Java application, we need to use an in-memory database. This is a requirement of our customer : for reasons of privacy and personal data processing, he does not want the data to be stored on disk but only in memory. However, we also need a relational database because we need to store multiple information having relationships between them, we need to manage ACID transactions and we also need to store binary data (like photos). Finally, we also need high availability, if a server falls, another server must be able to respond and therefore have the same data (always in memory). What do you think is the best database that would meet these constraints? I took a look with popular relational in-memory databases : HSQLDB does not seems to have redundancy feature, H2 seems to have redundancy if used as a database server but not if used as an embedded in-memory DB, and some people told me that Apache Derby was slower Thanks for your help

            M Offline
            M Offline
            Meysam Toluie
            wrote on last edited by
            #5

            The reason they ask for In-Memory OLTP is Quach. If the Durability is SCHEMA_AND_DATA then a copy of memory exists on disk. In-Memory is not a security solution. I suggest you, to listen to their needs and plan a suitable solution. Ask them, as many as question you need to realize what they really want. Some time they can't explain the real things, that they are worry about.

            SignatureNotFoundException

            1 Reply Last reply
            0
            • M Mathieu Seillier

              Hi, I have a question about choosing an in-memory database. Within a Java application, we need to use an in-memory database. This is a requirement of our customer : for reasons of privacy and personal data processing, he does not want the data to be stored on disk but only in memory. However, we also need a relational database because we need to store multiple information having relationships between them, we need to manage ACID transactions and we also need to store binary data (like photos). Finally, we also need high availability, if a server falls, another server must be able to respond and therefore have the same data (always in memory). What do you think is the best database that would meet these constraints? I took a look with popular relational in-memory databases : HSQLDB does not seems to have redundancy feature, H2 seems to have redundancy if used as a database server but not if used as an embedded in-memory DB, and some people told me that Apache Derby was slower Thanks for your help

              M Offline
              M Offline
              Meysam Toluie
              wrote on last edited by
              #6

              The reason they ask for In-Memory OLTP is Quach. If the Durability is SCHEMA_AND_DATA then a copy of memory exists on disk. In-Memory is not a security solution. I suggest you, to listen to their needs and plan a suitable solution. Ask them, as many as question you need to realize what they really want. Some time they can't explain the real things, that they are worry about.

              SignatureNotFoundException

              1 Reply Last reply
              0
              • M Meysam Toluie

                The reason they ask for In-Memory OLTP is Quach. If the Durability is SCHEMA_AND_DATA then a copy of memory exists on disk. In-Memory is not a security solution. I suggest you, to listen to their needs and plan a suitable solution. Ask them, as many as question you need to realize what they really want. Some time they can't explain the real things, that they are worry about.

                SignatureNotFoundException

                OriginalGriffO Offline
                OriginalGriffO Offline
                OriginalGriff
                wrote on last edited by
                #7

                Please don't repost if your comment does not appear immediately: all of these went to moderation and required a human being to review them for publication. In order to prevent you being kicked off as a spammer, all three had to be accepted, and then I have to clean up the spares. Have a little patience, please! I've deleted the other versions.

                "I have no idea what I did, but I'm taking full credit for it." - ThisOldTony "Common sense is so rare these days, it should be classified as a super power" - Random T-shirt AntiTwitter: @DalekDave is now a follower!

                "I have no idea what I did, but I'm taking full credit for it." - ThisOldTony
                "Common sense is so rare these days, it should be classified as a super power" - Random T-shirt

                M 1 Reply Last reply
                0
                • OriginalGriffO OriginalGriff

                  Please don't repost if your comment does not appear immediately: all of these went to moderation and required a human being to review them for publication. In order to prevent you being kicked off as a spammer, all three had to be accepted, and then I have to clean up the spares. Have a little patience, please! I've deleted the other versions.

                  "I have no idea what I did, but I'm taking full credit for it." - ThisOldTony "Common sense is so rare these days, it should be classified as a super power" - Random T-shirt AntiTwitter: @DalekDave is now a follower!

                  M Offline
                  M Offline
                  Meysam Toluie
                  wrote on last edited by
                  #8

                  Thank you for the clean up. I didn't repost. It was a bug. When I pressed the Post bottom, then no action happens. after a while I try again. I think because of my poor internet connection that happens.

                  SignatureNotFoundException

                  1 Reply Last reply
                  0
                  Reply
                  • Reply as topic
                  Log in to reply
                  • Oldest to Newest
                  • Newest to Oldest
                  • Most Votes


                  • Login

                  • Don't have an account? Register

                  • Login or register to search.
                  • First post
                    Last post
                  0
                  • Categories
                  • Recent
                  • Tags
                  • Popular
                  • World
                  • Users
                  • Groups