How Do I Write A Data Management System? PLEASE HELP!

Marc Clifton

I hope you can all help me! I need to write a data management system to manage 30 terabytes of data that is being generated nightly! Yes, there's quite a night life where I live, I guess! Here's[^] a link describing this project! (My professor wants it done by the end of the semister, BTW) But hey, I get to play with a cool 3000M pixel camera!!! :-D Marc My website Traceract

Paul Watson

Go back to school kid and then when you get out get some experience and then maybe you can come back here and be privileged enough to ask a question. Now get! :P (Cool camera though. Imagine the detail in the Playboy shots you could get from it.) regards, Paul Watson South Africa Colib and WebTwoZero. K(arl) wrote: oh, and BTW, CHRISTIAN ISN'T A PARADOX, HE IS A TASMANIAN!

TheGreatAndPowerfulOz

Paul Watson wrote: Imagine the detail in the Playboy shots eeeewww! gross!

Christian Graus

Add one more to the list of female CPians. Christian Graus - Microsoft MVP - C++

Rolando Cruz

Hi, OK, 30 terabytes. Is this data formated in any way? What is represented wihtin the 30 TBytes? Images? Dates? Times? Stellar Coordinates? As you can see your initial question is too general. :doh: Please be more specific. :) What are the results you want to get out of the DMS? What information do you want to store in this DMS? I'm willing to point you in the right direction. If you want you can directly send me an email to discuss this project of yours in more detail. Rolando :suss:

El Corazon

Sounds like it is already done... your problem is solved. Congradulations! This unique system for surveying the heavens **is made possible by advances in several technologies including**: * Large optics fabrication to create the telescope's distinctive 3-mirror design which includes a convex 4-meter secondary mirror, the size of many primary mirrors on today's large research telescopes. *** Data management systems to process and catalog the 30 terabytes of data generated nightly, the equivalent of 7,000 DVDs.** * New detectors needed to build the LSST's 3 billion pixel digital camera, the largest ever created. _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb) -- modified at 20:05 Monday 5th September, 2005

El Corazon

Christian Graus wrote: Add one more to the list of female CPians. sorry, I agree with ahz. Looking at pores just doesn't seem appealing. Plus you can easily use area-of-interest level-of-detail since you can pretty much guarentee zoom of only a few areas of interest.... chances are you could go months before someone discovered you didn't store it all. :rolleyes: _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

Jim Crafton

Paul Watson wrote: (Cool camera though. Imagine the detail in the Playboy shots you could get from it.) Well as they say, there's levels of detail, and then there's levels of detail. ¡El diablo está en mis pantalones! ¡Mire, mire! Real Mentats use only 100% pure, unfooled around with Sapho Juice(tm)! SELECT * FROM User WHERE Clue > 0 0 rows returned Save an Orange - Use the VCF!

Christian Graus

I more meant that I couldn't imagine a guy saying 'eeeww gross'. Christian Graus - Microsoft MVP - C++

El Corazon

Christian Graus wrote: I couldn't imagine a guy saying Ahhhh.... true.... I think my phrasing would have been... "uhh... I'll pass on THAT much detail." although compression using self-similarity and area related Level of detail could compress such images... after all, though one pore may not look exactly the same as another, it will look similar, you can use difference compression with area-offsets as you get higher and higher compression on similar looking details. :) Interesting idea.... I think I could do it... but I would need volunteer for the gigapixel imaging.... somehow I doubt playboy magazine would provide that detail, I'd be looking at paper fibers. ;P _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

Marc Clifton

Rolando E. Cruz-Marshall wrote: I'm willing to point you in the right direction. Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! Marc My website Traceract

El Corazon

Marc Clifton wrote: Well, I was hoping to hear from Bill S., as I understand he has some lossless compression algorithms that will reduce 30 TB down to 1 bit! ahhhh, a sense of humor too. :) okay I'll be serious then... several ways to do this... We do it for the earth all the time, though we worry about textures and elevation, you need location and time, so multiple images for a given location (bernard's star moving as well as catching asteroids and comets in reference to the slower moving stars). http://www.vterrain.org/LOD/spherical.html[^] and http://www.vterrain.org/LOD/Papers/index.html[^] they are all terrain based, but many include image referencing with gridded terrain, or spherical mapping and referencing (which the stars in reference to eart are mapped in Ra Dec for spherical coordinates). _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

Marc Clifton

Jeffry J. Brickley wrote: many include image referencing with gridded terrain, or spherical mapping and referencing (which the stars in reference to eart are mapped in Ra Dec for spherical coordinates). Very cool stuff! Wow! :-D Marc My website Traceract

El Corazon

Marc Clifton wrote: Very cool stuff! Wow! A friend's place since I can't show my work. Though I will be talking in November locally... probably boring stuff though, as well as hard to get into. :-D _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

TheGreatAndPowerfulOz

actually, not female. sorry to burst your bubble that a guy would say "ewwww gross!". But I don't think that looking that close at a *picture* would be that interesting. Looking that close at the *subject* of the picture would be only slightly less appealing. I'd rather be *in* the subject!

Christian Graus

ahz wrote: sorry to burst your bubble that a guy would say "ewwww gross!". OK, I guess guys are just more manly around where I live :-) ahz wrote: But I don't think that looking that close at a *picture* would be that interesting. Looking that close at the *subject* of the picture would be only slightly less appealing. I'd rather be *in* the subject! So you want to be 'in' it, but you don't want to 'see' it ? I'm not arguing that ultra close ups of femaleness don't lose their appeal after you hit the age of 12 ( they do ), but you're saying that you prefer the lights off all the time ? That's taking it a bit far, IMO. Christian Graus - Microsoft MVP - C++

El Corazon

wondering how far from or over the kid sister rule we are... I never had a kid sister.... Well, I could say he could try marriage, then it's don't look, don't touch. ;) but I do recognize mine was the exception, not the rule. _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

Christian Graus

Jeffry J. Brickley wrote: wondering how far from or over the kid sister rule we are... I never had a kid sister.... I do, but she's a bit of a tart, so... Jeffry J. Brickley wrote: but I do recognize mine was the exception, not the rule. Depends on how long you were married. My life was like that between the conception of the first child and the birth of the second ( 4 years ). Christian Graus - Microsoft MVP - C++

David Stone

How are things going with the missus now, CG?

[Cheshire] I can't afford those plastic things to cover the electric sockets so I just draw bunny faces on the electric outlets to scare the kids away from them... [RLtim] Newsflash! Kids aren't afraid of bunnies. [Cheshire] Oh they will be... -Bash.org

Christian Graus

Swimmingly, thanks. I'm not sure why, but it's feast or famine at my place, there doesn't appear to be an average position. Christian Graus - Microsoft MVP - C++