Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
  1. Home
  2. General Programming
  3. C#
  4. Continued Values Collection/List/Dictionary [modified]

Continued Values Collection/List/Dictionary [modified]

Scheduled Pinned Locked Moved C#
questioncsharpdatabasedata-structuresperformance
32 Posts 5 Posters 0 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • L Lost User

    Value1, value2 and value3 are distinct entities that you want to track? A dictionary consists of a value and a key. The key would be your index-column, the value could be a struct that holds the three columns;

    System.Collections.Generic.Dictionary<int, MyValues> myListOfValues;

    struct MyValues
    {
    int value1;
    int value2;
    int value3;
    }

    You could consider the generic list as your datatable, and the struct as a single row in that table. Now you can add values to your dictionary;

    MyValues oneRow = new MyValues();
    oneRow.value1 = 100;
    oneRow.value2 = 200;
    oneRow.value3 = 300;
    myListOfValues.Add(1, oneRow);

    Now, if you want the recreate those values for index 3, you would have to search in the list for the first non-empty value for the column value2. If speed is important, then I'd create one row outside of that list, just to mirror the current values. That wouldn't help if you need the values from the middle of the index, you'd still have to walk the list for that. How many records will be in that list? It might just be worth to store copies of the latest value, instead of looking for them.

    I are Troll :suss:

    S Offline
    S Offline
    Som Shekhar
    wrote on last edited by
    #7

    I modified the question to answer all the people who replied. Please read that. And yes. thanks for the attempt.

    L 1 Reply Last reply
    0
    • realJSOPR realJSOP

      Have each object maintain a dictionary of values. In the samples you rpovided above: Index 1 would contain 1,100 2,200 3,300 Index 2 would contain 3, 200 Index 3 would contain 1, 150 3, 300 Index 4 would contain 2,250 Index 5 would contain 1,100 2,200 Use google to learn how to use dictionary collections.

      .45 ACP - because shooting twice is just silly
      -----
      "Why don't you tie a kerosene-soaked rag around your ankles so the ants won't climb up and eat your candy ass..." - Dale Earnhardt, 1997
      -----
      "The staggering layers of obscenity in your statement make it a work of art on so many levels." - J. Jystad, 2001

      S Offline
      S Offline
      Som Shekhar
      wrote on last edited by
      #8

      Thanks for the attempt. I have modified the question for all the responses. Answering the same answer to all replies was not a good idea. Please give it a read.

      1 Reply Last reply
      0
      • B BillWoodruff

        Namaste Sri Som, [edit : made array of "current value" nullable integers private and non-static after realizing that by making the array static you could only have one usable instance of the class : please remember this code was written in less than five minutes "off top of my head" : welcome any suggestions to improve it ! ] Here's an idea off the "top of my head" : 1. use a class inheriting from a generic dictionary (we'll use an int [non-nullable] here for a key, but, of course, you could use something else as a key) 2. for the value part of each dictionary entry use a List of nullable ints List<int?> were going to make use of nulllable here to simulate "missing" data entries. 3. use an array of nullable ints inside the dictionary to track the current values you may need to replace "missing values" with : that gets us around the problem that a .NET Dictionary has no inherent "ordinality" you can rely on.

            public class keyedNullableIntTable : Dictionary<int, List<int?>>
            {
                private int?\[\] referenceValues = new int?\[3\];
        
                public void Add(int theKey, List<int?> theValues)
                {
                    for (int i = 0; i < 3; i++)
                    {
                        if (theValues\[i\] == null)
                        {
                            if (referenceValues\[i\] != null) 
                            {
                                theValues\[i\] = referenceValues\[i\];
                            }
                        }
                        else
                        {
                            referenceValues\[i\] = theValues\[i\];
                        }
                    }
        
                    base.Add(theKey, theValues);
                }
            }
        

        Here's a sample test : assumes you have a form with a 'button1 on it to call the eventhandler :

            private void button1\_Click(object sender, EventArgs e)
            {
                keyedNullableIntTable t1 = new keyedNullableIntTable();
        
                t1.Add(1, new List<int?> { 100,null,300 });
                t1.Add(2, new List<int?> { null, null, 300 });
                t1.Add(3, new List<int?> { 222, 333, 444 });
                t1.Add(4, new List<int?> { 111, null, null });
                t1.Add(5, new List<int?> { null, null, null });
        
                foreach (var theEntry in t1)
                {
                    Console.Write("key = " + theEntry.Key + "\\tlist = ");
                    foreach (var listValue in theEntry.Value)
                    {
        
        S Offline
        S Offline
        Som Shekhar
        wrote on last edited by
        #9

        This only solves the problem of creating the dictionary. Question is for retrieving them back. I have added my comments to the question itself. There are some more areas to look at. Please give it a read. And yes. thanks for the attempt.

        S B 2 Replies Last reply
        0
        • S Som Shekhar

          This only solves the problem of creating the dictionary. Question is for retrieving them back. I have added my comments to the question itself. There are some more areas to look at. Please give it a read. And yes. thanks for the attempt.

          S Offline
          S Offline
          Som Shekhar
          wrote on last edited by
          #10

          Namaste Suits just fine. However, you could do with a Hello too. (We are too used to "Hello World" anyways) :laugh:

          1 Reply Last reply
          0
          • S Som Shekhar

            This only solves the problem of creating the dictionary. Question is for retrieving them back. I have added my comments to the question itself. There are some more areas to look at. Please give it a read. And yes. thanks for the attempt.

            B Offline
            B Offline
            BillWoodruff
            wrote on last edited by
            #11

            Som Shekhar wrote: "I have added my comments to the question itself. There are some more areas to look at." Hi Som, Have edited the first code example to make the internal list of "current values to replace with if incoming item# is null" private and not static. Will be able to review your comments later tonight (I live at GMT +7 by the way) to try to understand what you mean by "retrieving them back" : isn't the test example I show in the code ... where the keys and list values are being read out in a foreach loop ... and printed to the console ... an example of retrieving back the values ? If I want the 3rd. item in the List in the dictionary t1 which is accessed by the key #4 : and I access it via : t1[4][2] Isn't that retrieving ? Namaste, Bill

            "Many : not conversant with mathematical studies, imagine that because it [the Analytical Engine] is to give results in numerical notation, its processes must consequently be arithmetical, numerical, rather than algebraical and analytical. This is an error. The engine can arrange and combine numerical quantities as if they were letters or any other general symbols; and it fact it might bring out its results in algebraical notation, were provisions made accordingly." Ada, Countess Lovelace, 1844

            S 1 Reply Last reply
            0
            • S Som Shekhar

              I modified the question to answer all the people who replied. Please read that. And yes. thanks for the attempt.

              L Offline
              L Offline
              Lost User
              wrote on last edited by
              #12

              Som Shekhar wrote:

              Can there be something faster than this?

              Yup; don't store the empty values, but do the looping on insert. Meaning that when you insert the values (null, 100, null), that you'll loop the list *at that moment* to fetch the null-values and store them at that index. It's either a lookup on insert (fast, consumes more memory) or a lookup when you're reading (slower, less memory-pressure). AFAIK, you can't have both (yet)

              I are Troll :suss:

              S 1 Reply Last reply
              0
              • L Lost User

                Som Shekhar wrote:

                Can there be something faster than this?

                Yup; don't store the empty values, but do the looping on insert. Meaning that when you insert the values (null, 100, null), that you'll loop the list *at that moment* to fetch the null-values and store them at that index. It's either a lookup on insert (fast, consumes more memory) or a lookup when you're reading (slower, less memory-pressure). AFAIK, you can't have both (yet)

                I are Troll :suss:

                S Offline
                S Offline
                Som Shekhar
                wrote on last edited by
                #13

                I prefer anything to be done at the insert stage. So, that's taken. Storing null values depends if it is an object or a list. In case of an class object constructor may demand all values and hence the null value. It can be skipped if possible. Doesn't any implementation exist in this format? A very practical example will be Configuration Plans which is time bound. We may only want to save the planned changes and not at every stage.

                L 1 Reply Last reply
                0
                • S Som Shekhar

                  I prefer anything to be done at the insert stage. So, that's taken. Storing null values depends if it is an object or a list. In case of an class object constructor may demand all values and hence the null value. It can be skipped if possible. Doesn't any implementation exist in this format? A very practical example will be Configuration Plans which is time bound. We may only want to save the planned changes and not at every stage.

                  L Offline
                  L Offline
                  Lost User
                  wrote on last edited by
                  #14

                  Som Shekhar wrote:

                  Doesn't any implementation exist in this format?

                  I don't know of any in the Framework, but then again, I don't know the entire framework by heart yet.

                  Som Shekhar wrote:

                  We may only want to save the planned changes and not at every stage.

                  Like I said, memory is cheap these days - and I doubt that you'll save a lot by inserting null values for a non-changed field. These kind of constructs are very common in SQL Server, where one would use a query to recreate the full list. The query does the lookups (over a speedy index) and you can read it as if it were the original table. ..but in-memory? Short lists should just store the values in a redundant way, and long lists shouldn't be kept in memory at all.

                  I are Troll :suss:

                  S 1 Reply Last reply
                  0
                  • L Lost User

                    Som Shekhar wrote:

                    Doesn't any implementation exist in this format?

                    I don't know of any in the Framework, but then again, I don't know the entire framework by heart yet.

                    Som Shekhar wrote:

                    We may only want to save the planned changes and not at every stage.

                    Like I said, memory is cheap these days - and I doubt that you'll save a lot by inserting null values for a non-changed field. These kind of constructs are very common in SQL Server, where one would use a query to recreate the full list. The query does the lookups (over a speedy index) and you can read it as if it were the original table. ..but in-memory? Short lists should just store the values in a redundant way, and long lists shouldn't be kept in memory at all.

                    I are Troll :suss:

                    S Offline
                    S Offline
                    Som Shekhar
                    wrote on last edited by
                    #15

                    Eddy Vluggen wrote:

                    Like I said, memory is cheap these days

                    Memory is not a trouble. Speed is. This is for a single such list. When this kind of list exist in 100s and each has to be going through a for loop with multiple calculations in between, the calculations go in 0.2-0.3 sec range. this is not too much to look at but with drag and drop, 0.2-0.3 lag is not acceptable. I am just trying to go to 0.05-0.06 sec range. These kind of change cannot come by simply tweaking a line or two. It can only come by changing the whole method of searching records. By the way, this whole thing is not even happening in the server/sql. its happening in the memory... hence the speed trouble.

                    L 1 Reply Last reply
                    0
                    • S Som Shekhar

                      Eddy Vluggen wrote:

                      Like I said, memory is cheap these days

                      Memory is not a trouble. Speed is. This is for a single such list. When this kind of list exist in 100s and each has to be going through a for loop with multiple calculations in between, the calculations go in 0.2-0.3 sec range. this is not too much to look at but with drag and drop, 0.2-0.3 lag is not acceptable. I am just trying to go to 0.05-0.06 sec range. These kind of change cannot come by simply tweaking a line or two. It can only come by changing the whole method of searching records. By the way, this whole thing is not even happening in the server/sql. its happening in the memory... hence the speed trouble.

                      L Offline
                      L Offline
                      Lost User
                      wrote on last edited by
                      #16

                      Som Shekhar wrote:

                      By the way, this whole thing is not even happening in the server/sql. its happening in the memory... hence the speed trouble.

                      The good news is that memory is usually faster to access then a server :)

                      Som Shekhar wrote:

                      each has to be going through a for loop with multiple calculations in between

                      The only option that I'm aware of is to precalculate the missing values. That way you only have a lookup in a list, which is quite fast. So, instead of inserting the nulls for the unchanged values, insert the value. That would move the cost for inserting from the "read from the list"-part to the "add to the list"-part of the code.

                      I are Troll :suss:

                      S 1 Reply Last reply
                      0
                      • L Lost User

                        Som Shekhar wrote:

                        By the way, this whole thing is not even happening in the server/sql. its happening in the memory... hence the speed trouble.

                        The good news is that memory is usually faster to access then a server :)

                        Som Shekhar wrote:

                        each has to be going through a for loop with multiple calculations in between

                        The only option that I'm aware of is to precalculate the missing values. That way you only have a lookup in a list, which is quite fast. So, instead of inserting the nulls for the unchanged values, insert the value. That would move the cost for inserting from the "read from the list"-part to the "add to the list"-part of the code.

                        I are Troll :suss:

                        S Offline
                        S Offline
                        Som Shekhar
                        wrote on last edited by
                        #17

                        If you read the modified question, i am saying an index along with as where to lookup again next time. Saving values instead of null may have problems later one when more values are inserted or removed. The whole purpose of the list is to save the value where changed.

                        L 1 Reply Last reply
                        0
                        • S Som Shekhar

                          If you read the modified question, i am saying an index along with as where to lookup again next time. Saving values instead of null may have problems later one when more values are inserted or removed. The whole purpose of the list is to save the value where changed.

                          L Offline
                          L Offline
                          Lost User
                          wrote on last edited by
                          #18

                          Som Shekhar wrote:

                          Saving values instead of null may have problems later one when more values are inserted or removed. The whole purpose of the list is to save the value where changed.

                          It sounded like the main issue was to have a list with values that you can query at a high speed. If you save all the values, then you won't have the problems you mentioned when removing an item;

                          Col1 Col2 Col3
                          100 200 300
                          100 200 100
                          100 100 100

                          Remove the second line, all data will still be correct. On the other hand, if you store the null-values (to indicate a non-change), then you might run into trouble;

                          Col1 Col2 Col3
                          100 200 300
                          ? ? 100
                          ? 100 ?

                          If you remove the second line now, you'll get this;

                          Col1 Col2 Col3
                          100 200 300
                          ? 100 ?

                          Which decodes to this when you try to track back the changes;

                          Col1 Col2 Col3
                          100 200 300
                          100 100 300

                          As you can see, the last item has changed. I don't see the advantage of storing only the changes in this particular structure, only more challenges :( It seems that I don't understand the question well enough to provide you with an answer.

                          I are Troll :suss:

                          S 1 Reply Last reply
                          0
                          • L Lost User

                            Som Shekhar wrote:

                            Saving values instead of null may have problems later one when more values are inserted or removed. The whole purpose of the list is to save the value where changed.

                            It sounded like the main issue was to have a list with values that you can query at a high speed. If you save all the values, then you won't have the problems you mentioned when removing an item;

                            Col1 Col2 Col3
                            100 200 300
                            100 200 100
                            100 100 100

                            Remove the second line, all data will still be correct. On the other hand, if you store the null-values (to indicate a non-change), then you might run into trouble;

                            Col1 Col2 Col3
                            100 200 300
                            ? ? 100
                            ? 100 ?

                            If you remove the second line now, you'll get this;

                            Col1 Col2 Col3
                            100 200 300
                            ? 100 ?

                            Which decodes to this when you try to track back the changes;

                            Col1 Col2 Col3
                            100 200 300
                            100 100 300

                            As you can see, the last item has changed. I don't see the advantage of storing only the changes in this particular structure, only more challenges :( It seems that I don't understand the question well enough to provide you with an answer.

                            I are Troll :suss:

                            S Offline
                            S Offline
                            Som Shekhar
                            wrote on last edited by
                            #19

                            Hey there!!! I really appreciate your efforts. But the question is to know if I am missing something fundamentally? If there is an implementation already present? Like we have Hashtables, List, Dictionaries for various purposes. Is there any other tool that I missed which can handle such a case? Or, may be there could be a need to develop such a list which could only record changes, do all the calculations internally, fast enough to match those of dictionary/indexed methods. In any case, thanks once again.

                            L 1 Reply Last reply
                            0
                            • S Som Shekhar

                              I am working on 3.5 sp1. So, can't use Tuple for now. Please read the comments in the modified question.

                              G Offline
                              G Offline
                              Gideon Engelberth
                              wrote on last edited by
                              #20

                              Well, you could make your own Tuple if you really wanted, but it looks like you already have a similar class to use instead. Like Eddy said, for your situation, you will have to loop somewhere. Either you have to keep a continuous list with the calculated values for all indexes up to the highest one, which implies a loop on every item insert/change, or you have to perform a search for the next lowest item and calculate its values on item access. It sounds like you want array-like access performance, so you will probably want to take the first option of calculating the values on insert (as Eddy suggested). If you will be accessing the items in sequence and not randomly indexing, you could get the best of both worlds by writing an iterator that keeps a "current value" and "index" to keep the calculation time minimal. A quick search did not find any existing implementation for such a collection, but it should not be that difficult to roll your own (especially since you know exactly what features you want).

                              S 1 Reply Last reply
                              0
                              • G Gideon Engelberth

                                Well, you could make your own Tuple if you really wanted, but it looks like you already have a similar class to use instead. Like Eddy said, for your situation, you will have to loop somewhere. Either you have to keep a continuous list with the calculated values for all indexes up to the highest one, which implies a loop on every item insert/change, or you have to perform a search for the next lowest item and calculate its values on item access. It sounds like you want array-like access performance, so you will probably want to take the first option of calculating the values on insert (as Eddy suggested). If you will be accessing the items in sequence and not randomly indexing, you could get the best of both worlds by writing an iterator that keeps a "current value" and "index" to keep the calculation time minimal. A quick search did not find any existing implementation for such a collection, but it should not be that difficult to roll your own (especially since you know exactly what features you want).

                                S Offline
                                S Offline
                                Som Shekhar
                                wrote on last edited by
                                #21

                                Gideon Engelberth wrote:

                                Like Eddy said, for your situation, you will have to loop somewhere.

                                Yes. I am already doing that. That is how it being done currently even in the class. options are obvious that either at the insert or at the lookup time, looping is inevitable. The point it that I want to achieve performance boost by some better technique instead of obvious looping. hashtables improve the efficiency of dictionary. and similarly datatable uses indexing techniques. A datatable like structure could be created by using a simple dictionary also. Since I have a basic functionality need, I only wonder if there could be very basic. Less the number of lines, faster the code. I am already working on reducing lines further by creating internal classes. Done most of it already. I will try and refine that and may be post here later. I owe a lot to CP already. Seems like there is nothing to save me here right now. In any case, thanks a lot guys.

                                1 Reply Last reply
                                0
                                • S Som Shekhar

                                  Hey there!!! I really appreciate your efforts. But the question is to know if I am missing something fundamentally? If there is an implementation already present? Like we have Hashtables, List, Dictionaries for various purposes. Is there any other tool that I missed which can handle such a case? Or, may be there could be a need to develop such a list which could only record changes, do all the calculations internally, fast enough to match those of dictionary/indexed methods. In any case, thanks once again.

                                  L Offline
                                  L Offline
                                  Lost User
                                  wrote on last edited by
                                  #22

                                  Som Shekhar wrote:

                                  I really appreciate your efforts.

                                  Nice to see someone who's biting into a subject, instead of just asking for code :)

                                  Som Shekhar wrote:

                                  But the question is to know if I am missing something fundamentally? If there is an implementation already present? Like we have Hashtables, List, Dictionaries for various purposes. Is there any other tool that I missed which can handle such a case?

                                  Not that I know. Yes, we got generic lists that can take all kinds of data, and we got observable lists that give you a notification if anything changes. But no list that's specialized in doing an incremental save. I think that most of us would cache the result, storing redundant values. It's a waste of memory, I know, but we often make these kind of trades. If you got some spare CPU-time, then it might make sense to add this optimization. You'll lose a bit of speed reconstructing the data at a particular index, but return you'd have some extra memory. The guys who work with Windows Mobile might have more experience with this, as they have less resources and actually need to think about using them effectively. On my desktop, I don't mind wasting a megabyte or so, if it means that I can spend my time on more critical issues.

                                  Som Shekhar wrote:

                                  Or, may be there could be a need to develop such a list which could only record changes, do all the calculations internally, fast enough to match those of dictionary/indexed methods.

                                  Again, recalculating the data will (logically seen) cost more processor-time than just reading it. Then again, the time that it takes might be neglectable, and it may also be true that you win back a fair amount of memory. That would depend on the amount of data, and the amount of 'holes' that one has to move through to get the 'last known values' for the columns on that particular index. At the start of this thread, I would have advised against that on the assumption that there's not much to gain. I'm not that sure anymore. The only way to get a definite answer is by building a prototype and measuring the results. Therein lies another consideration; would it be worth to spend the time on building such a prototype?

                                  I are Troll :suss:

                                  S 1 Reply Last reply
                                  0
                                  • L Lost User

                                    Som Shekhar wrote:

                                    I really appreciate your efforts.

                                    Nice to see someone who's biting into a subject, instead of just asking for code :)

                                    Som Shekhar wrote:

                                    But the question is to know if I am missing something fundamentally? If there is an implementation already present? Like we have Hashtables, List, Dictionaries for various purposes. Is there any other tool that I missed which can handle such a case?

                                    Not that I know. Yes, we got generic lists that can take all kinds of data, and we got observable lists that give you a notification if anything changes. But no list that's specialized in doing an incremental save. I think that most of us would cache the result, storing redundant values. It's a waste of memory, I know, but we often make these kind of trades. If you got some spare CPU-time, then it might make sense to add this optimization. You'll lose a bit of speed reconstructing the data at a particular index, but return you'd have some extra memory. The guys who work with Windows Mobile might have more experience with this, as they have less resources and actually need to think about using them effectively. On my desktop, I don't mind wasting a megabyte or so, if it means that I can spend my time on more critical issues.

                                    Som Shekhar wrote:

                                    Or, may be there could be a need to develop such a list which could only record changes, do all the calculations internally, fast enough to match those of dictionary/indexed methods.

                                    Again, recalculating the data will (logically seen) cost more processor-time than just reading it. Then again, the time that it takes might be neglectable, and it may also be true that you win back a fair amount of memory. That would depend on the amount of data, and the amount of 'holes' that one has to move through to get the 'last known values' for the columns on that particular index. At the start of this thread, I would have advised against that on the assumption that there's not much to gain. I'm not that sure anymore. The only way to get a definite answer is by building a prototype and measuring the results. Therein lies another consideration; would it be worth to spend the time on building such a prototype?

                                    I are Troll :suss:

                                    S Offline
                                    S Offline
                                    Som Shekhar
                                    wrote on last edited by
                                    #23

                                    Eddy Vluggen wrote:

                                    Nice to see someone who's biting into a subject, instead of just asking for code

                                    Coding is easy. Concepts are difficult to grasp. If you know the direction, you can reach anywhere. If you only know the target,god save you.

                                    Eddy Vluggen wrote:

                                    It's a waste of memory

                                    Memory is not really an issue. I am building an application for a bigger use and hence using all kind of hardware resources onto it. I can tell my clients to use better hardware. This means a good speed CPU and a good amount of RAM. Hence I really don't mind 1-2 MB extra here. I am already looping to create lookup-ready directory. Hence that is already covered. As I mentioned, The trouble comes when multiple of such calculations happen together. I am currently working on multi-threading of different instances. Atleast to save some more time. Let me give you a link of another problem that i posted. You would see the use of such a datatype there. http://www.codeproject.com/Messages/3304858/What-will-be-the-height-of-fluid-columns-in-a-vari.aspx[] In this problem, calculation of fluid height is needed. There are multiple fluid columns and many such tubes. With drag and drop functionality :( Usually working with already implemented concepts is always better. Consider using a dictionary vs. implemented List with key.

                                    Eddy Vluggen wrote:

                                    would it be worth to spend the time on building such a prototype?

                                    You would be surprised that i have come across such situation more than 4-5 times already while designing my applications. I usually work on disconnected database system and speed is a primary concern in loading and saving data. I initially worked with datatables which worked fine when my application was young. As it grew older, datatables are damn slow. I moved to dictionary. So far, they are fine. Even today, i experience a max lag of 0.5-0.6 sec on a drag drop operation which isn't too much to worry about. By multi-threading, i hope to reduce it to around 0.1-0.2 which should be manageable. But it is good to keep up with concepts. Usually a parallel solutions does wonders and tha

                                    L 1 Reply Last reply
                                    0
                                    • S Som Shekhar

                                      Eddy Vluggen wrote:

                                      Nice to see someone who's biting into a subject, instead of just asking for code

                                      Coding is easy. Concepts are difficult to grasp. If you know the direction, you can reach anywhere. If you only know the target,god save you.

                                      Eddy Vluggen wrote:

                                      It's a waste of memory

                                      Memory is not really an issue. I am building an application for a bigger use and hence using all kind of hardware resources onto it. I can tell my clients to use better hardware. This means a good speed CPU and a good amount of RAM. Hence I really don't mind 1-2 MB extra here. I am already looping to create lookup-ready directory. Hence that is already covered. As I mentioned, The trouble comes when multiple of such calculations happen together. I am currently working on multi-threading of different instances. Atleast to save some more time. Let me give you a link of another problem that i posted. You would see the use of such a datatype there. http://www.codeproject.com/Messages/3304858/What-will-be-the-height-of-fluid-columns-in-a-vari.aspx[] In this problem, calculation of fluid height is needed. There are multiple fluid columns and many such tubes. With drag and drop functionality :( Usually working with already implemented concepts is always better. Consider using a dictionary vs. implemented List with key.

                                      Eddy Vluggen wrote:

                                      would it be worth to spend the time on building such a prototype?

                                      You would be surprised that i have come across such situation more than 4-5 times already while designing my applications. I usually work on disconnected database system and speed is a primary concern in loading and saving data. I initially worked with datatables which worked fine when my application was young. As it grew older, datatables are damn slow. I moved to dictionary. So far, they are fine. Even today, i experience a max lag of 0.5-0.6 sec on a drag drop operation which isn't too much to worry about. By multi-threading, i hope to reduce it to around 0.1-0.2 which should be manageable. But it is good to keep up with concepts. Usually a parallel solutions does wonders and tha

                                      L Offline
                                      L Offline
                                      Lost User
                                      wrote on last edited by
                                      #24

                                      Som Shekhar wrote:

                                      Coding is easy.

                                      I'm looking at a buglist right now which tells me that it's not as easy as English.

                                      Som Shekhar wrote:

                                      As I mentioned, The trouble comes when multiple of such calculations happen together. I am currently working on multi-threading of different instances. Atleast to save some more time.

                                      Have you seen the article[^] on the AForge.Parallel.For-class? It might help in building a prototype to measure against :)

                                      Som Shekhar wrote:

                                      In this problem, calculation of fluid height is needed. There are multiple fluid columns and many such tubes. With drag and drop functionality

                                      True, but it would also make an impressive interface :cool:

                                      Som Shekhar wrote:

                                      Usually working with already implemented concepts is always better. Consider using a dictionary vs. implemented List with key.

                                      I'd try to mirror the concept of a database in-memory; creating a list of the records, and the equivalent of an index. IQueryable[^] springs into mind.

                                      Som Shekhar wrote:

                                      You would be surprised that i have come across such situation more than 4-5 times already while designing my applications. I usually work on disconnected database system and speed is a primary concern in loading and saving data. I initially worked with datatables which worked fine when my application was young. As it grew older, datatables are damn slow. I moved to dictionary. So far, they are fine. Even today, i experience a max lag of 0.5-0.6 sec on a drag drop operation which isn't too much to worry about.

                                      This post[^] confirms that although databases manipulate data very fast, your results are faster.

                                      S 1 Reply Last reply
                                      0
                                      • L Lost User

                                        Som Shekhar wrote:

                                        Coding is easy.

                                        I'm looking at a buglist right now which tells me that it's not as easy as English.

                                        Som Shekhar wrote:

                                        As I mentioned, The trouble comes when multiple of such calculations happen together. I am currently working on multi-threading of different instances. Atleast to save some more time.

                                        Have you seen the article[^] on the AForge.Parallel.For-class? It might help in building a prototype to measure against :)

                                        Som Shekhar wrote:

                                        In this problem, calculation of fluid height is needed. There are multiple fluid columns and many such tubes. With drag and drop functionality

                                        True, but it would also make an impressive interface :cool:

                                        Som Shekhar wrote:

                                        Usually working with already implemented concepts is always better. Consider using a dictionary vs. implemented List with key.

                                        I'd try to mirror the concept of a database in-memory; creating a list of the records, and the equivalent of an index. IQueryable[^] springs into mind.

                                        Som Shekhar wrote:

                                        You would be surprised that i have come across such situation more than 4-5 times already while designing my applications. I usually work on disconnected database system and speed is a primary concern in loading and saving data. I initially worked with datatables which worked fine when my application was young. As it grew older, datatables are damn slow. I moved to dictionary. So far, they are fine. Even today, i experience a max lag of 0.5-0.6 sec on a drag drop operation which isn't too much to worry about.

                                        This post[^] confirms that although databases manipulate data very fast, your results are faster.

                                        S Offline
                                        S Offline
                                        Som Shekhar
                                        wrote on last edited by
                                        #25

                                        Parallel.For looks promising. Will dig into it. Currently, since i have already implemented multithreading, I guess no need to implement that for now.

                                        Eddy Vluggen wrote:

                                        True, but it would also make an impressive interface

                                        Oh you bet. These days, looks may not be everything but that is what sells the first. I guess, that is it for now... I gotta be happy with multithreading for now. Since no other implementation already exist in this area. It was great having some meaningful conversations. :)

                                        L 1 Reply Last reply
                                        0
                                        • B BillWoodruff

                                          Som Shekhar wrote: "I have added my comments to the question itself. There are some more areas to look at." Hi Som, Have edited the first code example to make the internal list of "current values to replace with if incoming item# is null" private and not static. Will be able to review your comments later tonight (I live at GMT +7 by the way) to try to understand what you mean by "retrieving them back" : isn't the test example I show in the code ... where the keys and list values are being read out in a foreach loop ... and printed to the console ... an example of retrieving back the values ? If I want the 3rd. item in the List in the dictionary t1 which is accessed by the key #4 : and I access it via : t1[4][2] Isn't that retrieving ? Namaste, Bill

                                          "Many : not conversant with mathematical studies, imagine that because it [the Analytical Engine] is to give results in numerical notation, its processes must consequently be arithmetical, numerical, rather than algebraical and analytical. This is an error. The engine can arrange and combine numerical quantities as if they were letters or any other general symbols; and it fact it might bring out its results in algebraical notation, were provisions made accordingly." Ada, Countess Lovelace, 1844

                                          S Offline
                                          S Offline
                                          Som Shekhar
                                          wrote on last edited by
                                          #26

                                          I guess you sent me a message. I didn't see it here though.. What I was looking for was a framework implementation to sort my issue. I have done something on my own already and it works currently. Just a speed improvement was needed. I have already worked on multithreading and some decent work is already done... so only thing better would be a root level work.

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups