Simple question for the Database Rock Stars
-
Indeed, a GROUP HAVING few members. I'd INSERT myself in the ranks, but I am not worthy to JOIN...
Bad command or file name. Bad, bad command! Sit! Stay! Staaaay...
Try using the KEY (the whole key, and nothing but the key)
-
Just kidding about the rock stars but thought it might get some attention. But I do have a question. I have read all about the databases and really don't care which one is better or more efficient and so on, what I want to know and have always wanted to ask: If you have a simple program that needs to store data, what is the data size cut off that it is more efficient to use a database or just serialize to files (xml or other)? I have tested xml files holding as many as 10,000 elements, and have not noticed much of a delay putting same elements in database tables. I have tried several different approaches and tried to complicate the tables and queries and didn't see much difference in performance. Has anybody ever done any load testing or any research on what would be the cutoff point on data size, or evaluated the overhead over XML or a Database? I also know that there is a lot of support for working with databases and cloud storage which simplifies the DAL & LOB data access and storage, but it also leaves a large footprint on your device for something where the data load might not be so large as to warrant such a large footprint, such as mobile devices. Or does it? I don't know that's why I am asking. Please enlighten me on the subject.
The difference between a question and a stupid question depends on who you ask to answer it! wreckless
If you need any kind of concurrency it can quickly become messy with (xml)files.
Wrong is evil and must be defeated. - Jeff Ello
-
Try using the KEY (the whole key, and nothing but the key)
-
Just kidding about the rock stars but thought it might get some attention. But I do have a question. I have read all about the databases and really don't care which one is better or more efficient and so on, what I want to know and have always wanted to ask: If you have a simple program that needs to store data, what is the data size cut off that it is more efficient to use a database or just serialize to files (xml or other)? I have tested xml files holding as many as 10,000 elements, and have not noticed much of a delay putting same elements in database tables. I have tried several different approaches and tried to complicate the tables and queries and didn't see much difference in performance. Has anybody ever done any load testing or any research on what would be the cutoff point on data size, or evaluated the overhead over XML or a Database? I also know that there is a lot of support for working with databases and cloud storage which simplifies the DAL & LOB data access and storage, but it also leaves a large footprint on your device for something where the data load might not be so large as to warrant such a large footprint, such as mobile devices. Or does it? I don't know that's why I am asking. Please enlighten me on the subject.
The difference between a question and a stupid question depends on who you ask to answer it! wreckless
It depends on the structure of the data. For an example of why this is important, if look at the structure of CodeProject, as you should have before you posted, you will see that you have inserted a Message data item to the Lounge table, which is not where it belongs in the structure. The effect of this is that stored procedures set up to resolve the type of problem in your Message object will not be able to find it with their pre-configured queries, so your problem will not be found, and will not be resolved. The world will not end and civilisation will not collapse because of this (probably, but don't quote me if it happens), but it does demonstrate that if the data you have to handle has a complex structure, or many different branches, then storing it in large XML files, e.g. pages of the Lounge, is a pretty damned stupid thing to do. ... Almost as stupid as posting programming questions in the CP Lounge.
I wanna be a eunuchs developer! Pass me a bread knife!
-
Try using the KEY (the whole key, and nothing but the key)
He could try, but he is not the right CANDIDATE to have the KEY.
You have just been Sharapova'd.
-
He could try, but he is not the right CANDIDATE to have the KEY.
You have just been Sharapova'd.
I think the nearest you can get to a rockstar DBA is Bobby McFerrin[^]
-
There are no database rockstars, but those who master databases are a SELECT group.
Yup, and we hang out in HEAPs and CLUSTERS.
If it's not broken, fix it until it is
-
Indeed, a GROUP HAVING few members. I'd INSERT myself in the ranks, but I am not worthy to JOIN...
Bad command or file name. Bad, bad command! Sit! Stay! Staaaay...
If you're not clever enough to join the
RANKs[^], you could try theDENSE_RANKs[^]. ;P
"These people looked deep within my soul and assigned me a number based on the order in which I joined." - Homer
-
Just kidding about the rock stars but thought it might get some attention. But I do have a question. I have read all about the databases and really don't care which one is better or more efficient and so on, what I want to know and have always wanted to ask: If you have a simple program that needs to store data, what is the data size cut off that it is more efficient to use a database or just serialize to files (xml or other)? I have tested xml files holding as many as 10,000 elements, and have not noticed much of a delay putting same elements in database tables. I have tried several different approaches and tried to complicate the tables and queries and didn't see much difference in performance. Has anybody ever done any load testing or any research on what would be the cutoff point on data size, or evaluated the overhead over XML or a Database? I also know that there is a lot of support for working with databases and cloud storage which simplifies the DAL & LOB data access and storage, but it also leaves a large footprint on your device for something where the data load might not be so large as to warrant such a large footprint, such as mobile devices. Or does it? I don't know that's why I am asking. Please enlighten me on the subject.
The difference between a question and a stupid question depends on who you ask to answer it! wreckless
wreckless wrote:
Please enlighten me on the subject.
Data Integrity
Jeremy Falcon
-
There are no database rockstars, but those who master databases are a SELECT group.
here we go.... :sigh:
Charlie Gilley Stuck in a dysfunctional matrix from which I must escape... "Where liberty dwells, there is my country." B. Franklin, 1783 “They who can give up essential liberty to obtain a little temporary safety deserve neither liberty nor safety.” BF, 1759
-
Just kidding about the rock stars but thought it might get some attention. But I do have a question. I have read all about the databases and really don't care which one is better or more efficient and so on, what I want to know and have always wanted to ask: If you have a simple program that needs to store data, what is the data size cut off that it is more efficient to use a database or just serialize to files (xml or other)? I have tested xml files holding as many as 10,000 elements, and have not noticed much of a delay putting same elements in database tables. I have tried several different approaches and tried to complicate the tables and queries and didn't see much difference in performance. Has anybody ever done any load testing or any research on what would be the cutoff point on data size, or evaluated the overhead over XML or a Database? I also know that there is a lot of support for working with databases and cloud storage which simplifies the DAL & LOB data access and storage, but it also leaves a large footprint on your device for something where the data load might not be so large as to warrant such a large footprint, such as mobile devices. Or does it? I don't know that's why I am asking. Please enlighten me on the subject.
The difference between a question and a stupid question depends on who you ask to answer it! wreckless
wreckless wrote:
Just kidding about the rock stars
Good, 'cause anyone who thinks he's a rock star is actually just another hipster douchebag. It's not about size. Others have pointed out some of the many concerns involved. In short, XML is fine for configuration and reports, but not suitable for random access and multi-user access.
-
wreckless wrote:
Just kidding about the rock stars
Good, 'cause anyone who thinks he's a rock star is actually just another hipster douchebag. It's not about size. Others have pointed out some of the many concerns involved. In short, XML is fine for configuration and reports, but not suitable for random access and multi-user access.
I knew I should have left the rock stars part out of it. I also learned it's not a good idea to ask a question when I've been drinking. It was just spontaneous combustion I guess. But what the heck, sh#t happens. (Like posting in the lounge, sorry bout that) Lots of good answers here anyway, It looks to me like if it is simple keep it simple. If it is complicated, keep it simple by using a database. That about sums it up. But then again, how do you define simple? What simple for some may be Rock Science to others.
I guess it all depends on what is is? wreckless
-
Just kidding about the rock stars but thought it might get some attention. But I do have a question. I have read all about the databases and really don't care which one is better or more efficient and so on, what I want to know and have always wanted to ask: If you have a simple program that needs to store data, what is the data size cut off that it is more efficient to use a database or just serialize to files (xml or other)? I have tested xml files holding as many as 10,000 elements, and have not noticed much of a delay putting same elements in database tables. I have tried several different approaches and tried to complicate the tables and queries and didn't see much difference in performance. Has anybody ever done any load testing or any research on what would be the cutoff point on data size, or evaluated the overhead over XML or a Database? I also know that there is a lot of support for working with databases and cloud storage which simplifies the DAL & LOB data access and storage, but it also leaves a large footprint on your device for something where the data load might not be so large as to warrant such a large footprint, such as mobile devices. Or does it? I don't know that's why I am asking. Please enlighten me on the subject.
The difference between a question and a stupid question depends on who you ask to answer it! wreckless
