Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
CODE PROJECT For Those Who Code
  • Home
  • Articles
  • FAQ
Community
  1. Home
  2. The Lounge
  3. How Do I Write A Data Management System? PLEASE HELP!

How Do I Write A Data Management System? PLEASE HELP!

Scheduled Pinned Locked Moved The Lounge
questioncomhelpannouncement
40 Posts 16 Posters 15 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • C Christian Graus

    OK, well if there's no biological excuse, I'd say run for your life. Christian Graus - Microsoft MVP - C++

    E Offline
    E Offline
    El Corazon
    wrote on last edited by
    #24

    Christian Graus wrote: OK, well if there's no biological excuse, I'd say run for your life. I did... just not as soon as I should have. ;P Hermit since Nov 2001. :-D _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

    1 Reply Last reply
    0
    • C Christian Graus

      Jeffry J. Brickley wrote: wondering how far from or over the kid sister rule we are... I never had a kid sister.... I do, but she's a bit of a tart, so... Jeffry J. Brickley wrote: but I do recognize mine was the exception, not the rule. Depends on how long you were married. My life was like that between the conception of the first child and the birth of the second ( 4 years ). Christian Graus - Microsoft MVP - C++

      PJ ArendsP Offline
      PJ ArendsP Offline
      PJ Arends
      wrote on last edited by
      #25

      Jeffry J. Brickley wrote: then it's don't look, don't touch Christian Graus wrote: My life was like that between the conception of the first child and the birth of the second hmmm, I am not married so maybe I have no idea how it works, but that just does not seem right to me.:~


      "You're obviously a superstar." - Christian Graus about me - 12 Feb '03 "Obviously ???  You're definitely a superstar!!!" - mYkel - 21 Jun '04 "There's not enough blatant self-congratulatory backslapping in the world today..." - HumblePie - 21 Jun '05 Within you lies the power for good - Use it!

      Within you lies the power for good; Use it!

      C E 2 Replies Last reply
      0
      • PJ ArendsP PJ Arends

        Jeffry J. Brickley wrote: then it's don't look, don't touch Christian Graus wrote: My life was like that between the conception of the first child and the birth of the second hmmm, I am not married so maybe I have no idea how it works, but that just does not seem right to me.:~


        "You're obviously a superstar." - Christian Graus about me - 12 Feb '03 "Obviously ???  You're definitely a superstar!!!" - mYkel - 21 Jun '04 "There's not enough blatant self-congratulatory backslapping in the world today..." - HumblePie - 21 Jun '05 Within you lies the power for good - Use it!

        C Offline
        C Offline
        Christian Graus
        wrote on last edited by
        #26

        PJ Arends wrote: but that just does not seem right to me. It was DEFINATELY not right, but there were a lot of issues, mostly post natal depression that just turned to hell, and to be honest, after 6 months without sex, I stopped doing anything constructive about it. I'm just glad we got through it, now. Christian Graus - Microsoft MVP - C++

        PJ ArendsP 1 Reply Last reply
        0
        • E El Corazon

          Marc Clifton wrote: Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! ahhhh, a sense of humor too. :) okay I'll be serious then... several ways to do this... We do it for the earth all the time, though we worry about textures and elevation, you need location and time, so multiple images for a given location (bernard's star moving as well as catching asteroids and comets in reference to the slower moving stars). http://www.vterrain.org/LOD/spherical.html[^] and http://www.vterrain.org/LOD/Papers/index.html[^] they are all terrain based, but many include image referencing with gridded terrain, or spherical mapping and referencing (which the stars in reference to eart are mapped in Ra Dec for spherical coordinates). _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

          S Offline
          S Offline
          Steve Mayfield
          wrote on last edited by
          #27

          ah, but what was omitted was...although it is one bit wide, you need a recording device with 'advanced' perpendicular recording technology[^] and a vertical bit density of 30Tb :laugh: Steve

          E 1 Reply Last reply
          0
          • PJ ArendsP PJ Arends

            Jeffry J. Brickley wrote: then it's don't look, don't touch Christian Graus wrote: My life was like that between the conception of the first child and the birth of the second hmmm, I am not married so maybe I have no idea how it works, but that just does not seem right to me.:~


            "You're obviously a superstar." - Christian Graus about me - 12 Feb '03 "Obviously ???  You're definitely a superstar!!!" - mYkel - 21 Jun '04 "There's not enough blatant self-congratulatory backslapping in the world today..." - HumblePie - 21 Jun '05 Within you lies the power for good - Use it!

            E Offline
            E Offline
            El Corazon
            wrote on last edited by
            #28

            PJ Arends wrote: hmmm, I am not married so maybe I have no idea how it works, but that just does not seem right to me. My pessimism is half joke. There are no rules, and yes, such things do happen and others. Some get better, some get worse. When there is cooperation and willingness to work through issues, almost anything can be managed. Without that... anything gets worse. _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

            1 Reply Last reply
            0
            • C Christian Graus

              PJ Arends wrote: but that just does not seem right to me. It was DEFINATELY not right, but there were a lot of issues, mostly post natal depression that just turned to hell, and to be honest, after 6 months without sex, I stopped doing anything constructive about it. I'm just glad we got through it, now. Christian Graus - Microsoft MVP - C++

              PJ ArendsP Offline
              PJ ArendsP Offline
              PJ Arends
              wrote on last edited by
              #29

              Sorry, it was meant to be light hearted. No looking, no touching, yet second child? My lame attempts at a joke just don't go over too well in text:sigh:


              "You're obviously a superstar." - Christian Graus about me - 12 Feb '03 "Obviously ???  You're definitely a superstar!!!" - mYkel - 21 Jun '04 "There's not enough blatant self-congratulatory backslapping in the world today..." - HumblePie - 21 Jun '05 Within you lies the power for good - Use it!

              Within you lies the power for good; Use it!

              1 Reply Last reply
              0
              • S Steve Mayfield

                ah, but what was omitted was...although it is one bit wide, you need a recording device with 'advanced' perpendicular recording technology[^] and a vertical bit density of 30Tb :laugh: Steve

                E Offline
                E Offline
                El Corazon
                wrote on last edited by
                #30

                Steve Mayfield wrote: ah, but what was omitted was...although it is one bit wide, you need a recording device with 'advanced' perpendicular recording technology[^] and a vertical bit density of 30Tb Actually we get much higher density on our holographic storage prototype system, but I don't get to play with that. :) _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                S 1 Reply Last reply
                0
                • E El Corazon

                  Steve Mayfield wrote: ah, but what was omitted was...although it is one bit wide, you need a recording device with 'advanced' perpendicular recording technology[^] and a vertical bit density of 30Tb Actually we get much higher density on our holographic storage prototype system, but I don't get to play with that. :) _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                  S Offline
                  S Offline
                  S Douglas
                  wrote on last edited by
                  #31

                  Jeffry J. Brickley wrote: higher density on our holographic storage prototype system Perhaps I missed something, but if this is real and you’re allowed to could you please explain? Sounds something like right out of Star Trek. Cool concept. ------------------------------- DEBUGGING : Removing the needles from the haystack.

                  E 1 Reply Last reply
                  0
                  • M Marc Clifton

                    Rolando E. Cruz-Marshall wrote: I'm willing to point you in the right direction. Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! Marc My website Traceract

                    M Offline
                    M Offline
                    Matt Newman
                    wrote on last edited by
                    #32

                    Marc Clifton wrote: Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! Simple, its just a collections of 1s and 0s right? Well since the 0s really have no value you can just discard them. That just leaves the ones and you really don't need that much redundancy so you can just discard all but one and viola you have compressed 30 TB to 1 bit Matt Newman
                    Even the very best tools in the hands of an idiot will produce something of little or no value. - Chris Meech on Idiots

                    P F 2 Replies Last reply
                    0
                    • M Marc Clifton

                      I hope you can all help me! I need to write a data management system to manage 30 terabytes of data that is being generated nightly! Yes, there's quite a night life where I live, I guess! Here's[^] a link describing this project! (My professor wants it done by the end of the semister, BTW) But hey, I get to play with a cool 3000M pixel camera!!! :-D Marc My website Traceract

                      P Offline
                      P Offline
                      peterchen
                      wrote on last edited by
                      #33

                      Get a good deal on USB 2.0 Harddrives (don't use Maxtor), stack them to a tower, stick together with duct tape, apply some spray paint to make it look more professional. Hire a guy who remembers what goes on which disk, and un- and replugs the USB cable on demand. :rolleyes: Now I read the other uys suggestions. Do you already have any idea about the Possible storage media? Required lifetime of the data?


                      Pandoras Gift #44: Hope. The one that keeps you on suffering.
                      aber.. "Wie gesagt, der Scheiss is' Therapie"
                      boost your code || Fold With Us! || sighist | doxygen

                      1 Reply Last reply
                      0
                      • S S Douglas

                        Jeffry J. Brickley wrote: higher density on our holographic storage prototype system Perhaps I missed something, but if this is real and you’re allowed to could you please explain? Sounds something like right out of Star Trek. Cool concept. ------------------------------- DEBUGGING : Removing the needles from the haystack.

                        E Offline
                        E Offline
                        El Corazon
                        wrote on last edited by
                        #34

                        sfdougl wrote: Perhaps I missed something, but if this is real and you’re allowed to could you please explain? Sounds something like right out of Star Trek. Cool concept. you can google on it, nothing like Star Trek, little cube, big box with lasers and mirrors. If I recall it needs two or three to read, and one or more extra to write. IBM and others announced prototypes years ago... it's just getting the technology production ready that is the problem. There were half a dozen prototypes in operation a couple years ago, not sure how many now. It was expected to reach production in 2004, then 2005, then 2006... I wouldn't hold your breath. _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                        S 1 Reply Last reply
                        0
                        • E El Corazon

                          sfdougl wrote: Perhaps I missed something, but if this is real and you’re allowed to could you please explain? Sounds something like right out of Star Trek. Cool concept. you can google on it, nothing like Star Trek, little cube, big box with lasers and mirrors. If I recall it needs two or three to read, and one or more extra to write. IBM and others announced prototypes years ago... it's just getting the technology production ready that is the problem. There were half a dozen prototypes in operation a couple years ago, not sure how many now. It was expected to reach production in 2004, then 2005, then 2006... I wouldn't hold your breath. _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                          S Offline
                          S Offline
                          S Douglas
                          wrote on last edited by
                          #35

                          Jeffry J. Brickley wrote: It was expected to reach production in 2004, then 2005, then 2006... I wouldn't hold your breath. I wouldn’t expect to see anything either. Cool concept though. ------------------------------- DEBUGGING : Removing the needles from the haystack.

                          1 Reply Last reply
                          0
                          • M Marc Clifton

                            I hope you can all help me! I need to write a data management system to manage 30 terabytes of data that is being generated nightly! Yes, there's quite a night life where I live, I guess! Here's[^] a link describing this project! (My professor wants it done by the end of the semister, BTW) But hey, I get to play with a cool 3000M pixel camera!!! :-D Marc My website Traceract

                            L Offline
                            L Offline
                            Lost User
                            wrote on last edited by
                            #36

                            VB is your friend ;P The tigress is here :-D

                            F 1 Reply Last reply
                            0
                            • M Matt Newman

                              Marc Clifton wrote: Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! Simple, its just a collections of 1s and 0s right? Well since the 0s really have no value you can just discard them. That just leaves the ones and you really don't need that much redundancy so you can just discard all but one and viola you have compressed 30 TB to 1 bit Matt Newman
                              Even the very best tools in the hands of an idiot will produce something of little or no value. - Chris Meech on Idiots

                              P Offline
                              P Offline
                              Paul Watson
                              wrote on last edited by
                              #37

                              Matt Newman wrote: Well since the 0s really have no value you can just discard them. :laugh: :laugh: :laugh: :laugh: regards, Paul Watson South Africa Colib and WebTwoZero. K(arl) wrote: oh, and BTW, CHRISTIAN ISN'T A PARADOX, HE IS A TASMANIAN!

                              1 Reply Last reply
                              0
                              • M Matt Newman

                                Marc Clifton wrote: Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! Simple, its just a collections of 1s and 0s right? Well since the 0s really have no value you can just discard them. That just leaves the ones and you really don't need that much redundancy so you can just discard all but one and viola you have compressed 30 TB to 1 bit Matt Newman
                                Even the very best tools in the hands of an idiot will produce something of little or no value. - Chris Meech on Idiots

                                F Offline
                                F Offline
                                feline_dracoform
                                wrote on last edited by
                                #38

                                i was going to try to post this from memory, but my vague memory of the details did not have the simple elegance of this description :) zen is the art of being at one with the two'ness

                                1 Reply Last reply
                                0
                                • L Lost User

                                  VB is your friend ;P The tigress is here :-D

                                  F Offline
                                  F Offline
                                  feline_dracoform
                                  wrote on last edited by
                                  #39

                                  naughty pussycat! :-D *makes a note of this one for future reference* after all, if i am going to have a reputation for being naughty i might as well live up to it ;) zen is the art of being at one with the two'ness

                                  1 Reply Last reply
                                  0
                                  • M Marc Clifton

                                    I hope you can all help me! I need to write a data management system to manage 30 terabytes of data that is being generated nightly! Yes, there's quite a night life where I live, I guess! Here's[^] a link describing this project! (My professor wants it done by the end of the semister, BTW) But hey, I get to play with a cool 3000M pixel camera!!! :-D Marc My website Traceract

                                    R Offline
                                    R Offline
                                    Richard Stringer
                                    wrote on last edited by
                                    #40

                                    Marc Clifton wrote: I hope you can all help me! I need to write a data management system to manage 30 terabytes of data that is being generated nightly If I were you I would go with Access, VB.net, and use a thin client model. This oughta work pretty good for a app that only has to run once a night :) Richard Suppose you were an idiot... And suppose you were a member of Congress... But I repeat myself. --Mark Twain

                                    1 Reply Last reply
                                    0
                                    Reply
                                    • Reply as topic
                                    Log in to reply
                                    • Oldest to Newest
                                    • Newest to Oldest
                                    • Most Votes


                                    • Login

                                    • Don't have an account? Register

                                    • Login or register to search.
                                    • First post
                                      Last post
                                    0
                                    • Categories
                                    • Recent
                                    • Tags
                                    • Popular
                                    • World
                                    • Users
                                    • Groups