Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
CODE PROJECT For Those Who Code
  • Home
  • Articles
  • FAQ
Community
  1. Home
  2. The Lounge
  3. How Do I Write A Data Management System? PLEASE HELP!

How Do I Write A Data Management System? PLEASE HELP!

Scheduled Pinned Locked Moved The Lounge
questioncomhelpannouncement
40 Posts 16 Posters 16 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • E El Corazon

    wondering how far from or over the kid sister rule we are... I never had a kid sister.... Well, I could say he could try marriage, then it's don't look, don't touch. ;) but I do recognize mine was the exception, not the rule. _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

    C Offline
    C Offline
    Christian Graus
    wrote on last edited by
    #18

    Jeffry J. Brickley wrote: wondering how far from or over the kid sister rule we are... I never had a kid sister.... I do, but she's a bit of a tart, so... Jeffry J. Brickley wrote: but I do recognize mine was the exception, not the rule. Depends on how long you were married. My life was like that between the conception of the first child and the birth of the second ( 4 years ). Christian Graus - Microsoft MVP - C++

    D E PJ ArendsP 3 Replies Last reply
    0
    • C Christian Graus

      Jeffry J. Brickley wrote: wondering how far from or over the kid sister rule we are... I never had a kid sister.... I do, but she's a bit of a tart, so... Jeffry J. Brickley wrote: but I do recognize mine was the exception, not the rule. Depends on how long you were married. My life was like that between the conception of the first child and the birth of the second ( 4 years ). Christian Graus - Microsoft MVP - C++

      D Offline
      D Offline
      David Stone
      wrote on last edited by
      #19

      How are things going with the missus now, CG?


      [Cheshire] I can't afford those plastic things to cover the electric sockets so I just draw bunny faces on the electric outlets to scare the kids away from them... [RLtim] Newsflash! Kids aren't afraid of bunnies. [Cheshire] Oh they will be... -Bash.org

      C 1 Reply Last reply
      0
      • D David Stone

        How are things going with the missus now, CG?


        [Cheshire] I can't afford those plastic things to cover the electric sockets so I just draw bunny faces on the electric outlets to scare the kids away from them... [RLtim] Newsflash! Kids aren't afraid of bunnies. [Cheshire] Oh they will be... -Bash.org

        C Offline
        C Offline
        Christian Graus
        wrote on last edited by
        #20

        Swimmingly, thanks. I'm not sure why, but it's feast or famine at my place, there doesn't appear to be an average position. Christian Graus - Microsoft MVP - C++

        1 Reply Last reply
        0
        • M Marc Clifton

          I hope you can all help me! I need to write a data management system to manage 30 terabytes of data that is being generated nightly! Yes, there's quite a night life where I live, I guess! Here's[^] a link describing this project! (My professor wants it done by the end of the semister, BTW) But hey, I get to play with a cool 3000M pixel camera!!! :-D Marc My website Traceract

          PJ ArendsP Offline
          PJ ArendsP Offline
          PJ Arends
          wrote on last edited by
          #21

          Marc Clifton wrote: 30 terabytes of data that is being generated nightly! Sounds like a job for him who's name can not be mentioned.


          "You're obviously a superstar." - Christian Graus about me - 12 Feb '03 "Obviously ???  You're definitely a superstar!!!" - mYkel - 21 Jun '04 "There's not enough blatant self-congratulatory backslapping in the world today..." - HumblePie - 21 Jun '05 Within you lies the power for good - Use it!

          Within you lies the power for good; Use it!

          1 Reply Last reply
          0
          • C Christian Graus

            Jeffry J. Brickley wrote: wondering how far from or over the kid sister rule we are... I never had a kid sister.... I do, but she's a bit of a tart, so... Jeffry J. Brickley wrote: but I do recognize mine was the exception, not the rule. Depends on how long you were married. My life was like that between the conception of the first child and the birth of the second ( 4 years ). Christian Graus - Microsoft MVP - C++

            E Offline
            E Offline
            El Corazon
            wrote on last edited by
            #22

            Christian Graus wrote: Depends on how long you were married. She already had kids... life was just like that after the first year... _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

            C 1 Reply Last reply
            0
            • E El Corazon

              Christian Graus wrote: Depends on how long you were married. She already had kids... life was just like that after the first year... _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

              C Offline
              C Offline
              Christian Graus
              wrote on last edited by
              #23

              OK, well if there's no biological excuse, I'd say run for your life. Christian Graus - Microsoft MVP - C++

              E 1 Reply Last reply
              0
              • C Christian Graus

                OK, well if there's no biological excuse, I'd say run for your life. Christian Graus - Microsoft MVP - C++

                E Offline
                E Offline
                El Corazon
                wrote on last edited by
                #24

                Christian Graus wrote: OK, well if there's no biological excuse, I'd say run for your life. I did... just not as soon as I should have. ;P Hermit since Nov 2001. :-D _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                1 Reply Last reply
                0
                • C Christian Graus

                  Jeffry J. Brickley wrote: wondering how far from or over the kid sister rule we are... I never had a kid sister.... I do, but she's a bit of a tart, so... Jeffry J. Brickley wrote: but I do recognize mine was the exception, not the rule. Depends on how long you were married. My life was like that between the conception of the first child and the birth of the second ( 4 years ). Christian Graus - Microsoft MVP - C++

                  PJ ArendsP Offline
                  PJ ArendsP Offline
                  PJ Arends
                  wrote on last edited by
                  #25

                  Jeffry J. Brickley wrote: then it's don't look, don't touch Christian Graus wrote: My life was like that between the conception of the first child and the birth of the second hmmm, I am not married so maybe I have no idea how it works, but that just does not seem right to me.:~


                  "You're obviously a superstar." - Christian Graus about me - 12 Feb '03 "Obviously ???  You're definitely a superstar!!!" - mYkel - 21 Jun '04 "There's not enough blatant self-congratulatory backslapping in the world today..." - HumblePie - 21 Jun '05 Within you lies the power for good - Use it!

                  Within you lies the power for good; Use it!

                  C E 2 Replies Last reply
                  0
                  • PJ ArendsP PJ Arends

                    Jeffry J. Brickley wrote: then it's don't look, don't touch Christian Graus wrote: My life was like that between the conception of the first child and the birth of the second hmmm, I am not married so maybe I have no idea how it works, but that just does not seem right to me.:~


                    "You're obviously a superstar." - Christian Graus about me - 12 Feb '03 "Obviously ???  You're definitely a superstar!!!" - mYkel - 21 Jun '04 "There's not enough blatant self-congratulatory backslapping in the world today..." - HumblePie - 21 Jun '05 Within you lies the power for good - Use it!

                    C Offline
                    C Offline
                    Christian Graus
                    wrote on last edited by
                    #26

                    PJ Arends wrote: but that just does not seem right to me. It was DEFINATELY not right, but there were a lot of issues, mostly post natal depression that just turned to hell, and to be honest, after 6 months without sex, I stopped doing anything constructive about it. I'm just glad we got through it, now. Christian Graus - Microsoft MVP - C++

                    PJ ArendsP 1 Reply Last reply
                    0
                    • E El Corazon

                      Marc Clifton wrote: Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! ahhhh, a sense of humor too. :) okay I'll be serious then... several ways to do this... We do it for the earth all the time, though we worry about textures and elevation, you need location and time, so multiple images for a given location (bernard's star moving as well as catching asteroids and comets in reference to the slower moving stars). http://www.vterrain.org/LOD/spherical.html[^] and http://www.vterrain.org/LOD/Papers/index.html[^] they are all terrain based, but many include image referencing with gridded terrain, or spherical mapping and referencing (which the stars in reference to eart are mapped in Ra Dec for spherical coordinates). _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                      S Offline
                      S Offline
                      Steve Mayfield
                      wrote on last edited by
                      #27

                      ah, but what was omitted was...although it is one bit wide, you need a recording device with 'advanced' perpendicular recording technology[^] and a vertical bit density of 30Tb :laugh: Steve

                      E 1 Reply Last reply
                      0
                      • PJ ArendsP PJ Arends

                        Jeffry J. Brickley wrote: then it's don't look, don't touch Christian Graus wrote: My life was like that between the conception of the first child and the birth of the second hmmm, I am not married so maybe I have no idea how it works, but that just does not seem right to me.:~


                        "You're obviously a superstar." - Christian Graus about me - 12 Feb '03 "Obviously ???  You're definitely a superstar!!!" - mYkel - 21 Jun '04 "There's not enough blatant self-congratulatory backslapping in the world today..." - HumblePie - 21 Jun '05 Within you lies the power for good - Use it!

                        E Offline
                        E Offline
                        El Corazon
                        wrote on last edited by
                        #28

                        PJ Arends wrote: hmmm, I am not married so maybe I have no idea how it works, but that just does not seem right to me. My pessimism is half joke. There are no rules, and yes, such things do happen and others. Some get better, some get worse. When there is cooperation and willingness to work through issues, almost anything can be managed. Without that... anything gets worse. _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                        1 Reply Last reply
                        0
                        • C Christian Graus

                          PJ Arends wrote: but that just does not seem right to me. It was DEFINATELY not right, but there were a lot of issues, mostly post natal depression that just turned to hell, and to be honest, after 6 months without sex, I stopped doing anything constructive about it. I'm just glad we got through it, now. Christian Graus - Microsoft MVP - C++

                          PJ ArendsP Offline
                          PJ ArendsP Offline
                          PJ Arends
                          wrote on last edited by
                          #29

                          Sorry, it was meant to be light hearted. No looking, no touching, yet second child? My lame attempts at a joke just don't go over too well in text:sigh:


                          "You're obviously a superstar." - Christian Graus about me - 12 Feb '03 "Obviously ???  You're definitely a superstar!!!" - mYkel - 21 Jun '04 "There's not enough blatant self-congratulatory backslapping in the world today..." - HumblePie - 21 Jun '05 Within you lies the power for good - Use it!

                          Within you lies the power for good; Use it!

                          1 Reply Last reply
                          0
                          • S Steve Mayfield

                            ah, but what was omitted was...although it is one bit wide, you need a recording device with 'advanced' perpendicular recording technology[^] and a vertical bit density of 30Tb :laugh: Steve

                            E Offline
                            E Offline
                            El Corazon
                            wrote on last edited by
                            #30

                            Steve Mayfield wrote: ah, but what was omitted was...although it is one bit wide, you need a recording device with 'advanced' perpendicular recording technology[^] and a vertical bit density of 30Tb Actually we get much higher density on our holographic storage prototype system, but I don't get to play with that. :) _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                            S 1 Reply Last reply
                            0
                            • E El Corazon

                              Steve Mayfield wrote: ah, but what was omitted was...although it is one bit wide, you need a recording device with 'advanced' perpendicular recording technology[^] and a vertical bit density of 30Tb Actually we get much higher density on our holographic storage prototype system, but I don't get to play with that. :) _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                              S Offline
                              S Offline
                              S Douglas
                              wrote on last edited by
                              #31

                              Jeffry J. Brickley wrote: higher density on our holographic storage prototype system Perhaps I missed something, but if this is real and you’re allowed to could you please explain? Sounds something like right out of Star Trek. Cool concept. ------------------------------- DEBUGGING : Removing the needles from the haystack.

                              E 1 Reply Last reply
                              0
                              • M Marc Clifton

                                Rolando E. Cruz-Marshall wrote: I'm willing to point you in the right direction. Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! Marc My website Traceract

                                M Offline
                                M Offline
                                Matt Newman
                                wrote on last edited by
                                #32

                                Marc Clifton wrote: Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! Simple, its just a collections of 1s and 0s right? Well since the 0s really have no value you can just discard them. That just leaves the ones and you really don't need that much redundancy so you can just discard all but one and viola you have compressed 30 TB to 1 bit Matt Newman
                                Even the very best tools in the hands of an idiot will produce something of little or no value. - Chris Meech on Idiots

                                P F 2 Replies Last reply
                                0
                                • M Marc Clifton

                                  I hope you can all help me! I need to write a data management system to manage 30 terabytes of data that is being generated nightly! Yes, there's quite a night life where I live, I guess! Here's[^] a link describing this project! (My professor wants it done by the end of the semister, BTW) But hey, I get to play with a cool 3000M pixel camera!!! :-D Marc My website Traceract

                                  P Offline
                                  P Offline
                                  peterchen
                                  wrote on last edited by
                                  #33

                                  Get a good deal on USB 2.0 Harddrives (don't use Maxtor), stack them to a tower, stick together with duct tape, apply some spray paint to make it look more professional. Hire a guy who remembers what goes on which disk, and un- and replugs the USB cable on demand. :rolleyes: Now I read the other uys suggestions. Do you already have any idea about the Possible storage media? Required lifetime of the data?


                                  Pandoras Gift #44: Hope. The one that keeps you on suffering.
                                  aber.. "Wie gesagt, der Scheiss is' Therapie"
                                  boost your code || Fold With Us! || sighist | doxygen

                                  1 Reply Last reply
                                  0
                                  • S S Douglas

                                    Jeffry J. Brickley wrote: higher density on our holographic storage prototype system Perhaps I missed something, but if this is real and you’re allowed to could you please explain? Sounds something like right out of Star Trek. Cool concept. ------------------------------- DEBUGGING : Removing the needles from the haystack.

                                    E Offline
                                    E Offline
                                    El Corazon
                                    wrote on last edited by
                                    #34

                                    sfdougl wrote: Perhaps I missed something, but if this is real and you’re allowed to could you please explain? Sounds something like right out of Star Trek. Cool concept. you can google on it, nothing like Star Trek, little cube, big box with lasers and mirrors. If I recall it needs two or three to read, and one or more extra to write. IBM and others announced prototypes years ago... it's just getting the technology production ready that is the problem. There were half a dozen prototypes in operation a couple years ago, not sure how many now. It was expected to reach production in 2004, then 2005, then 2006... I wouldn't hold your breath. _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                                    S 1 Reply Last reply
                                    0
                                    • E El Corazon

                                      sfdougl wrote: Perhaps I missed something, but if this is real and you’re allowed to could you please explain? Sounds something like right out of Star Trek. Cool concept. you can google on it, nothing like Star Trek, little cube, big box with lasers and mirrors. If I recall it needs two or three to read, and one or more extra to write. IBM and others announced prototypes years ago... it's just getting the technology production ready that is the problem. There were half a dozen prototypes in operation a couple years ago, not sure how many now. It was expected to reach production in 2004, then 2005, then 2006... I wouldn't hold your breath. _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                                      S Offline
                                      S Offline
                                      S Douglas
                                      wrote on last edited by
                                      #35

                                      Jeffry J. Brickley wrote: It was expected to reach production in 2004, then 2005, then 2006... I wouldn't hold your breath. I wouldn’t expect to see anything either. Cool concept though. ------------------------------- DEBUGGING : Removing the needles from the haystack.

                                      1 Reply Last reply
                                      0
                                      • M Marc Clifton

                                        I hope you can all help me! I need to write a data management system to manage 30 terabytes of data that is being generated nightly! Yes, there's quite a night life where I live, I guess! Here's[^] a link describing this project! (My professor wants it done by the end of the semister, BTW) But hey, I get to play with a cool 3000M pixel camera!!! :-D Marc My website Traceract

                                        L Offline
                                        L Offline
                                        Lost User
                                        wrote on last edited by
                                        #36

                                        VB is your friend ;P The tigress is here :-D

                                        F 1 Reply Last reply
                                        0
                                        • M Matt Newman

                                          Marc Clifton wrote: Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! Simple, its just a collections of 1s and 0s right? Well since the 0s really have no value you can just discard them. That just leaves the ones and you really don't need that much redundancy so you can just discard all but one and viola you have compressed 30 TB to 1 bit Matt Newman
                                          Even the very best tools in the hands of an idiot will produce something of little or no value. - Chris Meech on Idiots

                                          P Offline
                                          P Offline
                                          Paul Watson
                                          wrote on last edited by
                                          #37

                                          Matt Newman wrote: Well since the 0s really have no value you can just discard them. :laugh: :laugh: :laugh: :laugh: regards, Paul Watson South Africa Colib and WebTwoZero. K(arl) wrote: oh, and BTW, CHRISTIAN ISN'T A PARADOX, HE IS A TASMANIAN!

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups