Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
CODE PROJECT For Those Who Code
  • Home
  • Articles
  • FAQ
Community
  1. Home
  2. The Lounge
  3. How Do I Write A Data Management System? PLEASE HELP!

How Do I Write A Data Management System? PLEASE HELP!

Scheduled Pinned Locked Moved The Lounge
questioncomhelpannouncement
40 Posts 16 Posters 15 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • E El Corazon

    Steve Mayfield wrote: ah, but what was omitted was...although it is one bit wide, you need a recording device with 'advanced' perpendicular recording technology[^] and a vertical bit density of 30Tb Actually we get much higher density on our holographic storage prototype system, but I don't get to play with that. :) _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

    S Offline
    S Offline
    S Douglas
    wrote on last edited by
    #31

    Jeffry J. Brickley wrote: higher density on our holographic storage prototype system Perhaps I missed something, but if this is real and you’re allowed to could you please explain? Sounds something like right out of Star Trek. Cool concept. ------------------------------- DEBUGGING : Removing the needles from the haystack.

    E 1 Reply Last reply
    0
    • M Marc Clifton

      Rolando E. Cruz-Marshall wrote: I'm willing to point you in the right direction. Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! Marc My website Traceract

      M Offline
      M Offline
      Matt Newman
      wrote on last edited by
      #32

      Marc Clifton wrote: Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! Simple, its just a collections of 1s and 0s right? Well since the 0s really have no value you can just discard them. That just leaves the ones and you really don't need that much redundancy so you can just discard all but one and viola you have compressed 30 TB to 1 bit Matt Newman
      Even the very best tools in the hands of an idiot will produce something of little or no value. - Chris Meech on Idiots

      P F 2 Replies Last reply
      0
      • M Marc Clifton

        I hope you can all help me! I need to write a data management system to manage 30 terabytes of data that is being generated nightly! Yes, there's quite a night life where I live, I guess! Here's[^] a link describing this project! (My professor wants it done by the end of the semister, BTW) But hey, I get to play with a cool 3000M pixel camera!!! :-D Marc My website Traceract

        P Offline
        P Offline
        peterchen
        wrote on last edited by
        #33

        Get a good deal on USB 2.0 Harddrives (don't use Maxtor), stack them to a tower, stick together with duct tape, apply some spray paint to make it look more professional. Hire a guy who remembers what goes on which disk, and un- and replugs the USB cable on demand. :rolleyes: Now I read the other uys suggestions. Do you already have any idea about the Possible storage media? Required lifetime of the data?


        Pandoras Gift #44: Hope. The one that keeps you on suffering.
        aber.. "Wie gesagt, der Scheiss is' Therapie"
        boost your code || Fold With Us! || sighist | doxygen

        1 Reply Last reply
        0
        • S S Douglas

          Jeffry J. Brickley wrote: higher density on our holographic storage prototype system Perhaps I missed something, but if this is real and you’re allowed to could you please explain? Sounds something like right out of Star Trek. Cool concept. ------------------------------- DEBUGGING : Removing the needles from the haystack.

          E Offline
          E Offline
          El Corazon
          wrote on last edited by
          #34

          sfdougl wrote: Perhaps I missed something, but if this is real and you’re allowed to could you please explain? Sounds something like right out of Star Trek. Cool concept. you can google on it, nothing like Star Trek, little cube, big box with lasers and mirrors. If I recall it needs two or three to read, and one or more extra to write. IBM and others announced prototypes years ago... it's just getting the technology production ready that is the problem. There were half a dozen prototypes in operation a couple years ago, not sure how many now. It was expected to reach production in 2004, then 2005, then 2006... I wouldn't hold your breath. _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

          S 1 Reply Last reply
          0
          • E El Corazon

            sfdougl wrote: Perhaps I missed something, but if this is real and you’re allowed to could you please explain? Sounds something like right out of Star Trek. Cool concept. you can google on it, nothing like Star Trek, little cube, big box with lasers and mirrors. If I recall it needs two or three to read, and one or more extra to write. IBM and others announced prototypes years ago... it's just getting the technology production ready that is the problem. There were half a dozen prototypes in operation a couple years ago, not sure how many now. It was expected to reach production in 2004, then 2005, then 2006... I wouldn't hold your breath. _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

            S Offline
            S Offline
            S Douglas
            wrote on last edited by
            #35

            Jeffry J. Brickley wrote: It was expected to reach production in 2004, then 2005, then 2006... I wouldn't hold your breath. I wouldn’t expect to see anything either. Cool concept though. ------------------------------- DEBUGGING : Removing the needles from the haystack.

            1 Reply Last reply
            0
            • M Marc Clifton

              I hope you can all help me! I need to write a data management system to manage 30 terabytes of data that is being generated nightly! Yes, there's quite a night life where I live, I guess! Here's[^] a link describing this project! (My professor wants it done by the end of the semister, BTW) But hey, I get to play with a cool 3000M pixel camera!!! :-D Marc My website Traceract

              L Offline
              L Offline
              Lost User
              wrote on last edited by
              #36

              VB is your friend ;P The tigress is here :-D

              F 1 Reply Last reply
              0
              • M Matt Newman

                Marc Clifton wrote: Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! Simple, its just a collections of 1s and 0s right? Well since the 0s really have no value you can just discard them. That just leaves the ones and you really don't need that much redundancy so you can just discard all but one and viola you have compressed 30 TB to 1 bit Matt Newman
                Even the very best tools in the hands of an idiot will produce something of little or no value. - Chris Meech on Idiots

                P Offline
                P Offline
                Paul Watson
                wrote on last edited by
                #37

                Matt Newman wrote: Well since the 0s really have no value you can just discard them. :laugh: :laugh: :laugh: :laugh: regards, Paul Watson South Africa Colib and WebTwoZero. K(arl) wrote: oh, and BTW, CHRISTIAN ISN'T A PARADOX, HE IS A TASMANIAN!

                1 Reply Last reply
                0
                • M Matt Newman

                  Marc Clifton wrote: Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! Simple, its just a collections of 1s and 0s right? Well since the 0s really have no value you can just discard them. That just leaves the ones and you really don't need that much redundancy so you can just discard all but one and viola you have compressed 30 TB to 1 bit Matt Newman
                  Even the very best tools in the hands of an idiot will produce something of little or no value. - Chris Meech on Idiots

                  F Offline
                  F Offline
                  feline_dracoform
                  wrote on last edited by
                  #38

                  i was going to try to post this from memory, but my vague memory of the details did not have the simple elegance of this description :) zen is the art of being at one with the two'ness

                  1 Reply Last reply
                  0
                  • L Lost User

                    VB is your friend ;P The tigress is here :-D

                    F Offline
                    F Offline
                    feline_dracoform
                    wrote on last edited by
                    #39

                    naughty pussycat! :-D *makes a note of this one for future reference* after all, if i am going to have a reputation for being naughty i might as well live up to it ;) zen is the art of being at one with the two'ness

                    1 Reply Last reply
                    0
                    • M Marc Clifton

                      I hope you can all help me! I need to write a data management system to manage 30 terabytes of data that is being generated nightly! Yes, there's quite a night life where I live, I guess! Here's[^] a link describing this project! (My professor wants it done by the end of the semister, BTW) But hey, I get to play with a cool 3000M pixel camera!!! :-D Marc My website Traceract

                      R Offline
                      R Offline
                      Richard Stringer
                      wrote on last edited by
                      #40

                      Marc Clifton wrote: I hope you can all help me! I need to write a data management system to manage 30 terabytes of data that is being generated nightly If I were you I would go with Access, VB.net, and use a thin client model. This oughta work pretty good for a app that only has to run once a night :) Richard Suppose you were an idiot... And suppose you were a member of Congress... But I repeat myself. --Mark Twain

                      1 Reply Last reply
                      0
                      Reply
                      • Reply as topic
                      Log in to reply
                      • Oldest to Newest
                      • Newest to Oldest
                      • Most Votes


                      • Login

                      • Don't have an account? Register

                      • Login or register to search.
                      • First post
                        Last post
                      0
                      • Categories
                      • Recent
                      • Tags
                      • Popular
                      • World
                      • Users
                      • Groups