Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
  1. Home
  2. Database & SysAdmin
  3. Database
  4. The Best Free Database for real-time data storing and querying

The Best Free Database for real-time data storing and querying

Scheduled Pinned Locked Moved Database
questioncssdatabasepostgresqlhelp
12 Posts 5 Posters 0 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • U Offline
    U Offline
    User 13293914
    wrote on last edited by
    #1

    I need a real-time database for inserting at least 500fields per second. (I have been selected TimeScaleDB (Postgresql Extension) for my purpose, currently). So, the matrix of the table will be 500(Fields)x86400(Rows).

    This means that for a 500 double-precision field it will be around 500*8bytes=4000bytes which for 86400rows it will be 345,600,000bytes (345.6M).

    I know a software which it is recording the same structure of data and the final daily volume of its database is only 84M~85M. Its Extension is *.tag so, i think it is a DataFlex database. It is not a free database and i also never used it.

    Question:

    1- Which free database is the best to use for real-time data storing and querying (at the moment of storing) based on your experience or knowledge?

    2- Is there any database to have such a volume or even less for this size of data?

    Thank you for your Help.

    V M L 4 Replies Last reply
    0
    • U User 13293914

      I need a real-time database for inserting at least 500fields per second. (I have been selected TimeScaleDB (Postgresql Extension) for my purpose, currently). So, the matrix of the table will be 500(Fields)x86400(Rows).

      This means that for a 500 double-precision field it will be around 500*8bytes=4000bytes which for 86400rows it will be 345,600,000bytes (345.6M).

      I know a software which it is recording the same structure of data and the final daily volume of its database is only 84M~85M. Its Extension is *.tag so, i think it is a DataFlex database. It is not a free database and i also never used it.

      Question:

      1- Which free database is the best to use for real-time data storing and querying (at the moment of storing) based on your experience or knowledge?

      2- Is there any database to have such a volume or even less for this size of data?

      Thank you for your Help.

      V Offline
      V Offline
      Victor Nijegorodov
      wrote on last edited by
      #2

      How about [SQL Server Express - Wikipedia](https://en.wikipedia.org/wiki/SQL\_Server\_Express) ?

      U 2 Replies Last reply
      0
      • V Victor Nijegorodov

        How about [SQL Server Express - Wikipedia](https://en.wikipedia.org/wiki/SQL\_Server\_Express) ?

        U Offline
        U Offline
        User 13293914
        wrote on last edited by
        #3

        I think the it size will be the same as postgresql, isn't it?

        1 Reply Last reply
        0
        • V Victor Nijegorodov

          How about [SQL Server Express - Wikipedia](https://en.wikipedia.org/wiki/SQL\_Server\_Express) ?

          U Offline
          U Offline
          User 13293914
          wrote on last edited by
          #4

          But Its Volume Will Be The Same As PostgreSQL!

          L 1 Reply Last reply
          0
          • U User 13293914

            But Its Volume Will Be The Same As PostgreSQL!

            L Offline
            L Offline
            Lost User
            wrote on last edited by
            #5

            Why are you concerned about sizes? Disk space is cheap.

            U 1 Reply Last reply
            0
            • L Lost User

              Why are you concerned about sizes? Disk space is cheap.

              U Offline
              U Offline
              User 13293914
              wrote on last edited by
              #6

              For one year the size will be 120GB for Postgresql but for the mentioned DBS will be only 30GB. it is a great difference (one fourth).

              J 1 Reply Last reply
              0
              • U User 13293914

                For one year the size will be 120GB for Postgresql but for the mentioned DBS will be only 30GB. it is a great difference (one fourth).

                J Offline
                J Offline
                Jorgen Andersson
                wrote on last edited by
                #7

                That would mean the other database is storing the data compressed. That's obviously something you can do in many databases, but it might add performance issues.

                Wrong is evil and must be defeated. - Jeff Ello Never stop dreaming - Freddie Kruger

                U 1 Reply Last reply
                0
                • U User 13293914

                  I need a real-time database for inserting at least 500fields per second. (I have been selected TimeScaleDB (Postgresql Extension) for my purpose, currently). So, the matrix of the table will be 500(Fields)x86400(Rows).

                  This means that for a 500 double-precision field it will be around 500*8bytes=4000bytes which for 86400rows it will be 345,600,000bytes (345.6M).

                  I know a software which it is recording the same structure of data and the final daily volume of its database is only 84M~85M. Its Extension is *.tag so, i think it is a DataFlex database. It is not a free database and i also never used it.

                  Question:

                  1- Which free database is the best to use for real-time data storing and querying (at the moment of storing) based on your experience or knowledge?

                  2- Is there any database to have such a volume or even less for this size of data?

                  Thank you for your Help.

                  M Offline
                  M Offline
                  Mycroft Holmes
                  wrote on last edited by
                  #8

                  What is wrong with MySQL[^]

                  Never underestimate the power of human stupidity - RAH I'm old. I know stuff - JSOP

                  U 1 Reply Last reply
                  0
                  • J Jorgen Andersson

                    That would mean the other database is storing the data compressed. That's obviously something you can do in many databases, but it might add performance issues.

                    Wrong is evil and must be defeated. - Jeff Ello Never stop dreaming - Freddie Kruger

                    U Offline
                    U Offline
                    User 13293914
                    wrote on last edited by
                    #9

                    thank you for your guid

                    1 Reply Last reply
                    0
                    • M Mycroft Holmes

                      What is wrong with MySQL[^]

                      Never underestimate the power of human stupidity - RAH I'm old. I know stuff - JSOP

                      U Offline
                      U Offline
                      User 13293914
                      wrote on last edited by
                      #10

                      thank you for your offer

                      1 Reply Last reply
                      0
                      • U User 13293914

                        I need a real-time database for inserting at least 500fields per second. (I have been selected TimeScaleDB (Postgresql Extension) for my purpose, currently). So, the matrix of the table will be 500(Fields)x86400(Rows).

                        This means that for a 500 double-precision field it will be around 500*8bytes=4000bytes which for 86400rows it will be 345,600,000bytes (345.6M).

                        I know a software which it is recording the same structure of data and the final daily volume of its database is only 84M~85M. Its Extension is *.tag so, i think it is a DataFlex database. It is not a free database and i also never used it.

                        Question:

                        1- Which free database is the best to use for real-time data storing and querying (at the moment of storing) based on your experience or knowledge?

                        2- Is there any database to have such a volume or even less for this size of data?

                        Thank you for your Help.

                        L Offline
                        L Offline
                        Lost User
                        wrote on last edited by
                        #11

                        There are various ways to "compress" (and structure) redundant database data. "Size" doesn't tell much of a story. And you don't generally "query" real-time data; plot it, maybe; record it, certainly; usually to a binary file that later gets translated and loaded (to a database) for information purposes.

                        It was only in wine that he laid down no limit for himself, but he did not allow himself to be confused by it. ― Confucian Analects: Rules of Confucius about his food

                        1 Reply Last reply
                        0
                        • U User 13293914

                          I need a real-time database for inserting at least 500fields per second. (I have been selected TimeScaleDB (Postgresql Extension) for my purpose, currently). So, the matrix of the table will be 500(Fields)x86400(Rows).

                          This means that for a 500 double-precision field it will be around 500*8bytes=4000bytes which for 86400rows it will be 345,600,000bytes (345.6M).

                          I know a software which it is recording the same structure of data and the final daily volume of its database is only 84M~85M. Its Extension is *.tag so, i think it is a DataFlex database. It is not a free database and i also never used it.

                          Question:

                          1- Which free database is the best to use for real-time data storing and querying (at the moment of storing) based on your experience or knowledge?

                          2- Is there any database to have such a volume or even less for this size of data?

                          Thank you for your Help.

                          L Offline
                          L Offline
                          Lost User
                          wrote on last edited by
                          #12

                          Member 13325846 wrote:

                          1- Which free database is the best to use for real-time data storing and querying (at the moment of storing) based on your experience or knowledge?

                          SQLite, in memory database storage would be my choice. Stores db in memory, instead of disk. SQL Server has the same option. ..but both not real time, just really, really fast. Anything on Windows is not guaranteed real time, by technolgy. If you need real time, reseach QNX or the likes.

                          Bastard Programmer from Hell :suss: "If you just follow the bacon Eddy, wherever it leads you, then you won't have to think about politics." -- Some Bell.

                          1 Reply Last reply
                          0
                          Reply
                          • Reply as topic
                          Log in to reply
                          • Oldest to Newest
                          • Newest to Oldest
                          • Most Votes


                          • Login

                          • Don't have an account? Register

                          • Login or register to search.
                          • First post
                            Last post
                          0
                          • Categories
                          • Recent
                          • Tags
                          • Popular
                          • World
                          • Users
                          • Groups