Skip to content
  • Categories
  • Recent
  • Tags
  • Popular
  • World
  • Users
  • Groups
Skins
  • Light
  • Cerulean
  • Cosmo
  • Flatly
  • Journal
  • Litera
  • Lumen
  • Lux
  • Materia
  • Minty
  • Morph
  • Pulse
  • Sandstone
  • Simplex
  • Sketchy
  • Spacelab
  • United
  • Yeti
  • Zephyr
  • Dark
  • Cyborg
  • Darkly
  • Quartz
  • Slate
  • Solar
  • Superhero
  • Vapor

  • Default (No Skin)
  • No Skin
Collapse
Code Project
  1. Home
  2. The Lounge
  3. Time to ask for another computer!

Time to ask for another computer!

Scheduled Pinned Locked Moved The Lounge
question
37 Posts 16 Posters 0 Views 1 Watching
  • Oldest to Newest
  • Newest to Oldest
  • Most Votes
Reply
  • Reply as topic
Log in to reply
This topic has been deleted. Only users with topic management privileges can see it.
  • E El Corazon

    I just beat this one up. Yup, got my auto-scaling (based on data, not processors) threading model running well, and knocked out all four cores with a large dataset. That justifies a new computer right? Or rather, I just have to limit my scaling to the appropriate number of cores.... darn....

    _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

    D Offline
    D Offline
    Dan Neely
    wrote on last edited by
    #5

    with Penryn coming out in a month and a half you've maxed out your hardware just a little bit early. EDIT: Also nVidia is alleged to be releasing new GPUs in mid November. Back in April a PR person said something about a 1 terraflop card for the next refresh, but otherwise is keeping everything very close to their chest fueling the rumor mills at a breakneck pace.

    -- If you view money as inherently evil, I view it as my duty to assist in making you more virtuous.

    E 1 Reply Last reply
    0
    • E El Corazon

      PIEBALDconsult wrote:

      Now publish your code so we can all do that.

      piece of cake.... typical builder design pattern modified for parallel nature, director feeds n number of workers to work, each worker is a VERY typical builder design pattern running original linear mode. Implicitely shared atomically protected queue in to each worker, when work queues are filled with n number of entries waiting, hire another worker (you are falling behind). see, all there. ;P

      _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

      M Offline
      M Offline
      Member 96
      wrote on last edited by
      #6

      My eyes glazed over somewhere just past the first "design pattern". ;) Congrats on achieving...well ...something that seems to be difficult.


      Modo vincis, modo vinceris.

      1 Reply Last reply
      0
      • D Dan Neely

        with Penryn coming out in a month and a half you've maxed out your hardware just a little bit early. EDIT: Also nVidia is alleged to be releasing new GPUs in mid November. Back in April a PR person said something about a 1 terraflop card for the next refresh, but otherwise is keeping everything very close to their chest fueling the rumor mills at a breakneck pace.

        -- If you view money as inherently evil, I view it as my duty to assist in making you more virtuous.

        E Offline
        E Offline
        El Corazon
        wrote on last edited by
        #7

        dan neely wrote:

        with Penryn coming out in a month and a half you've maxed out your hardware just a little bit early. EDIT: Also nVidia is alleged to be releasing new GPUs in mid November. Back in April a PR person said something about a 1 terraflop card for the next refresh, but otherwise is keeping everything very close to their chest fueling the rumor mills at a breakneck pace.

        well, this new design is suppost to last at least until 32 cores, I am hoping past, but not going to count my chickens before they core, or what ever it should be.... I'll know for sure when I get a few Penryn in test it. ;) and given a month that it takes to order anything around here, my timing isn't as far off as you might think.... Yup, nVidia has an NDA in place and strongly nforced. If you ever want inside info again, you button your lip. :) -- modified at 16:30 Wednesday 26th September, 2007

        _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

        D D 2 Replies Last reply
        0
        • E El Corazon

          dan neely wrote:

          with Penryn coming out in a month and a half you've maxed out your hardware just a little bit early. EDIT: Also nVidia is alleged to be releasing new GPUs in mid November. Back in April a PR person said something about a 1 terraflop card for the next refresh, but otherwise is keeping everything very close to their chest fueling the rumor mills at a breakneck pace.

          well, this new design is suppost to last at least until 32 cores, I am hoping past, but not going to count my chickens before they core, or what ever it should be.... I'll know for sure when I get a few Penryn in test it. ;) and given a month that it takes to order anything around here, my timing isn't as far off as you might think.... Yup, nVidia has an NDA in place and strongly nforced. If you ever want inside info again, you button your lip. :) -- modified at 16:30 Wednesday 26th September, 2007

          _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

          D Offline
          D Offline
          Dan Neely
          wrote on last edited by
          #8

          El Corazon wrote:

          and given a month that it takes to order anything around here, my timing isn't as far off as you might think....

          hmmm So your purchase request is going to say "..The new nVidia card coming out next month that I can't put the name of here because everyone who knows is gagged by an NDA. Quantity: However many can be SLIed together. Price: TBD". Getting that approved sounds like it's going to be an 'interesting' experience. :rolleyes:

          -- If you view money as inherently evil, I view it as my duty to assist in making you more virtuous.

          P E 3 Replies Last reply
          0
          • E El Corazon

            dan neely wrote:

            with Penryn coming out in a month and a half you've maxed out your hardware just a little bit early. EDIT: Also nVidia is alleged to be releasing new GPUs in mid November. Back in April a PR person said something about a 1 terraflop card for the next refresh, but otherwise is keeping everything very close to their chest fueling the rumor mills at a breakneck pace.

            well, this new design is suppost to last at least until 32 cores, I am hoping past, but not going to count my chickens before they core, or what ever it should be.... I'll know for sure when I get a few Penryn in test it. ;) and given a month that it takes to order anything around here, my timing isn't as far off as you might think.... Yup, nVidia has an NDA in place and strongly nforced. If you ever want inside info again, you button your lip. :) -- modified at 16:30 Wednesday 26th September, 2007

            _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

            D Offline
            D Offline
            daniilzol
            wrote on last edited by
            #9

            You'd probably need two Nehalems[^] to fully test your architecture. Too bad they aren't coming for another year... :rolleyes:

            1 Reply Last reply
            0
            • D Dan Neely

              El Corazon wrote:

              and given a month that it takes to order anything around here, my timing isn't as far off as you might think....

              hmmm So your purchase request is going to say "..The new nVidia card coming out next month that I can't put the name of here because everyone who knows is gagged by an NDA. Quantity: However many can be SLIed together. Price: TBD". Getting that approved sounds like it's going to be an 'interesting' experience. :rolleyes:

              -- If you view money as inherently evil, I view it as my duty to assist in making you more virtuous.

              P Offline
              P Offline
              PIEBALDconsult
              wrote on last edited by
              #10

              You give the boss a blank piece of paper to sign, then fill in the details.

              1 Reply Last reply
              0
              • E El Corazon

                PIEBALDconsult wrote:

                Now publish your code so we can all do that.

                piece of cake.... typical builder design pattern modified for parallel nature, director feeds n number of workers to work, each worker is a VERY typical builder design pattern running original linear mode. Implicitely shared atomically protected queue in to each worker, when work queues are filled with n number of entries waiting, hire another worker (you are falling behind). see, all there. ;P

                _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                P Offline
                P Offline
                PIEBALDconsult
                wrote on last edited by
                #11

                That's all well and good, but I don't have The Grand Negus' compiler. :-D

                E 1 Reply Last reply
                0
                • E El Corazon

                  I just beat this one up. Yup, got my auto-scaling (based on data, not processors) threading model running well, and knocked out all four cores with a large dataset. That justifies a new computer right? Or rather, I just have to limit my scaling to the appropriate number of cores.... darn....

                  _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                  J Offline
                  J Offline
                  Jorgen Sigvardsson
                  wrote on last edited by
                  #12

                  <boss-mode>Now is the time to dazzle us with your optimization techniques! That is, if you want a new computer again. Ever.</boss-mode>

                  -- Kein Mitleid Für Die Mehrheit

                  E 1 Reply Last reply
                  0
                  • D Dan Neely

                    El Corazon wrote:

                    and given a month that it takes to order anything around here, my timing isn't as far off as you might think....

                    hmmm So your purchase request is going to say "..The new nVidia card coming out next month that I can't put the name of here because everyone who knows is gagged by an NDA. Quantity: However many can be SLIed together. Price: TBD". Getting that approved sounds like it's going to be an 'interesting' experience. :rolleyes:

                    -- If you view money as inherently evil, I view it as my duty to assist in making you more virtuous.

                    E Offline
                    E Offline
                    El Corazon
                    wrote on last edited by
                    #13

                    dan neely wrote:

                    hmmm So your purchase request is going to say "..The new nVidia card coming out next month that I can't put the name of here because everyone who knows is gagged by an NDA. Quantity: However many can be SLIed together. Price: TBD". Getting that approved sounds like it's going to be an 'interesting' experience.

                    no, the proposal for new work includes hardware upgrades that keep the proposal reviewer drooling at the possibilities. Given fiscal year is ending this weekend, the time is right and some are already in. Then money is granted, and purchase requests entered following the release.

                    _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                    1 Reply Last reply
                    0
                    • P PIEBALDconsult

                      That's all well and good, but I don't have The Grand Negus' compiler. :-D

                      E Offline
                      E Offline
                      El Corazon
                      wrote on last edited by
                      #14

                      PIEBALDconsult wrote:

                      but I don't have The Grand Negus' compiler.

                      That's okay, his doesn't do threading. and all that atomic stuff just overcomplicates everything. ;P

                      _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                      A L 2 Replies Last reply
                      0
                      • E El Corazon

                        I just beat this one up. Yup, got my auto-scaling (based on data, not processors) threading model running well, and knocked out all four cores with a large dataset. That justifies a new computer right? Or rather, I just have to limit my scaling to the appropriate number of cores.... darn....

                        _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                        E Offline
                        E Offline
                        Ed Poore
                        wrote on last edited by
                        #15

                        Perhaps you should try a couple of these[^]?


                        My Blog[^]

                        1 Reply Last reply
                        0
                        • E El Corazon

                          I just beat this one up. Yup, got my auto-scaling (based on data, not processors) threading model running well, and knocked out all four cores with a large dataset. That justifies a new computer right? Or rather, I just have to limit my scaling to the appropriate number of cores.... darn....

                          _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                          R Offline
                          R Offline
                          realJSOP
                          wrote on last edited by
                          #16

                          I think maybe a new programmer would solve the issue, but it's cheaper to buy a new system. :)

                          "Why don't you tie a kerosene-soaked rag around your ankles so the ants won't climb up and eat your candy ass..." - Dale Earnhardt, 1997
                          -----
                          "...the staggering layers of obscenity in your statement make it a work of art on so many levels." - Jason Jystad, 10/26/2001

                          1 Reply Last reply
                          0
                          • J Jorgen Sigvardsson

                            <boss-mode>Now is the time to dazzle us with your optimization techniques! That is, if you want a new computer again. Ever.</boss-mode>

                            -- Kein Mitleid Für Die Mehrheit

                            E Offline
                            E Offline
                            El Corazon
                            wrote on last edited by
                            #17

                            Joergen Sigvardsson wrote:

                            Now is the time to dazzle us with your optimization techniques! That is, if you want a new computer again. Ever.

                            < boss response mode >My test proved the new design is scaleable to an n-processor model of unknown upper limit. Using four threads and gradually increasing data-flow we processed approximately 10 times the amount of data we processed under the previous design. That is effectively 50 times the last scaling model used in 1990's on the SGI/Cray Origin computers. We exceeded our goals by a whopping 2+ multiple through the use of more efficient processes and a redesigned core based entirely for a massively parallel and auto-scaling system. We respond to data as a company does to work, the threading model starts off respectively small and efficient, when work exceeds the ability to handle the load, more workers are hired automatically scaling the system. More than just a thread pool, this system is designed for massive data flow without synchronization blocking allowing free-running threads to "clear the work" faster than the competitor's products by at least 9 times. In short, four processors should have gained us 3.5 multiple in a decent scaling model. Through effcient design we stretched that number 10 times increase in data flow at the full limit of those 4 processors. Where that upper limit is we will have to find out. You could help us find that out as we shatter the data flow records again putting the company as a leader in parallel technology for ... industry.< /boss response mode > -- modified at 19:07 Wednesday 26th September, 2007

                            _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                            A 1 Reply Last reply
                            0
                            • E El Corazon

                              PIEBALDconsult wrote:

                              but I don't have The Grand Negus' compiler.

                              That's okay, his doesn't do threading. and all that atomic stuff just overcomplicates everything. ;P

                              _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                              A Offline
                              A Offline
                              Andy Brummer
                              wrote on last edited by
                              #18

                              Plus you use all those pesky floats and doubles.


                              This blanket smells like ham

                              E 1 Reply Last reply
                              0
                              • E El Corazon

                                Joergen Sigvardsson wrote:

                                Now is the time to dazzle us with your optimization techniques! That is, if you want a new computer again. Ever.

                                < boss response mode >My test proved the new design is scaleable to an n-processor model of unknown upper limit. Using four threads and gradually increasing data-flow we processed approximately 10 times the amount of data we processed under the previous design. That is effectively 50 times the last scaling model used in 1990's on the SGI/Cray Origin computers. We exceeded our goals by a whopping 2+ multiple through the use of more efficient processes and a redesigned core based entirely for a massively parallel and auto-scaling system. We respond to data as a company does to work, the threading model starts off respectively small and efficient, when work exceeds the ability to handle the load, more workers are hired automatically scaling the system. More than just a thread pool, this system is designed for massive data flow without synchronization blocking allowing free-running threads to "clear the work" faster than the competitor's products by at least 9 times. In short, four processors should have gained us 3.5 multiple in a decent scaling model. Through effcient design we stretched that number 10 times increase in data flow at the full limit of those 4 processors. Where that upper limit is we will have to find out. You could help us find that out as we shatter the data flow records again putting the company as a leader in parallel technology for ... industry.< /boss response mode > -- modified at 19:07 Wednesday 26th September, 2007

                                _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                                A Offline
                                A Offline
                                Andy Brummer
                                wrote on last edited by
                                #19

                                Sounds like you need to put in a request for one of these[^]. If you can max out 16 cores without busting out a ridiculous number of threads, you really know your stuff.


                                This blanket smells like ham

                                E 1 Reply Last reply
                                0
                                • A Andy Brummer

                                  Plus you use all those pesky floats and doubles.


                                  This blanket smells like ham

                                  E Offline
                                  E Offline
                                  El Corazon
                                  wrote on last edited by
                                  #20

                                  Andy Brummer wrote:

                                  you use all those pesky floats and doubles.

                                  and half-floats and long double floats, if it floats, I use it. I think that qualifies me as evil incarnate to PEC.

                                  _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                                  L 1 Reply Last reply
                                  0
                                  • A Andy Brummer

                                    Sounds like you need to put in a request for one of these[^]. If you can max out 16 cores without busting out a ridiculous number of threads, you really know your stuff.


                                    This blanket smells like ham

                                    E Offline
                                    E Offline
                                    El Corazon
                                    wrote on last edited by
                                    #21

                                    Andy Brummer wrote:

                                    Sounds like you need to put in a request for one of these[^]. If you can max out 16 cores without busting out a ridiculous number of threads, you really know your stuff.

                                    Well, I floored it with data, it is simply designed to queue waiting data and workers never halt if there is data on the queue, they clear it. Without blocking to halt it, it basically plows through numbers in massive quantities. You have to feed it a lot and fast to get that far. That is about 20 times the data flow that any one customer has ever sent us, basically equivalent to all the data from all our customers sent simultaneously to the same machine. Fairly unlikely, but I need to double that to meet an outstanding challenge from one customer. Right now I am neck and neck with a 64 node processor for this same problem double my cores and I could shatter the record they took from us, on a machine that costs a small fraction of the costs. :-D

                                    _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                                    1 Reply Last reply
                                    0
                                    • E El Corazon

                                      I just beat this one up. Yup, got my auto-scaling (based on data, not processors) threading model running well, and knocked out all four cores with a large dataset. That justifies a new computer right? Or rather, I just have to limit my scaling to the appropriate number of cores.... darn....

                                      _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                                      P Offline
                                      P Offline
                                      peterchen
                                      wrote on last edited by
                                      #22

                                      Or rather, I just have to limit my scaling to the appropriate number of cores.... darn.... I was going to say that.


                                      We are a big screwed up dysfunctional psychotic happy family - some more screwed up, others more happy, but everybody's psychotic joint venture definition of CP
                                      My first real C# project | Linkify!|FoldWithUs! | sighist

                                      E 1 Reply Last reply
                                      0
                                      • D Dan Neely

                                        El Corazon wrote:

                                        and given a month that it takes to order anything around here, my timing isn't as far off as you might think....

                                        hmmm So your purchase request is going to say "..The new nVidia card coming out next month that I can't put the name of here because everyone who knows is gagged by an NDA. Quantity: However many can be SLIed together. Price: TBD". Getting that approved sounds like it's going to be an 'interesting' experience. :rolleyes:

                                        -- If you view money as inherently evil, I view it as my duty to assist in making you more virtuous.

                                        E Offline
                                        E Offline
                                        El Corazon
                                        wrote on last edited by
                                        #23

                                        dan neely wrote:

                                        hmmm So your purchase request is going to say "..The new nVidia card coming out next month that I can't put the name of here because everyone who knows is gagged by an NDA. Quantity: However many can be SLIed together. Price: TBD". Getting that approved sounds like it's going to be an 'interesting' experience.

                                        Now see, I just got my first call in.... customers already drooling and going to set aside FY08 (starting October) money for us. Given time it takes to transfer that kind of stuff, the money will be here when the products arrive on the shelf, we'll order them and still wait 30 days.... Unfortunately, I probably won't be keeping any myself.... :sigh:

                                        _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                                        1 Reply Last reply
                                        0
                                        • P peterchen

                                          Or rather, I just have to limit my scaling to the appropriate number of cores.... darn.... I was going to say that.


                                          We are a big screwed up dysfunctional psychotic happy family - some more screwed up, others more happy, but everybody's psychotic joint venture definition of CP
                                          My first real C# project | Linkify!|FoldWithUs! | sighist

                                          E Offline
                                          E Offline
                                          El Corazon
                                          wrote on last edited by
                                          #24

                                          peterchen wrote:

                                          I was going to say that.

                                          :laugh: ya caught that did you? :-D I had to find out where the top end was before I capped it. But it made a good joke about getting a new machine since I did order an oct-core (dual quad) for a customer. but I won't even see it, he'll get it and put it together because of location. Just ordered a quad-core for one of my team to replace a failed dual processor and save money. Hoping next year could mean some new hardware. One project in particular could use an nVidia Tesla. Next couple of months will tell. In the mean time, I am ready for FY08 funding with a new design finished. :)

                                          _________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)

                                          1 Reply Last reply
                                          0
                                          Reply
                                          • Reply as topic
                                          Log in to reply
                                          • Oldest to Newest
                                          • Newest to Oldest
                                          • Most Votes


                                          • Login

                                          • Don't have an account? Register

                                          • Login or register to search.
                                          • First post
                                            Last post
                                          0
                                          • Categories
                                          • Recent
                                          • Tags
                                          • Popular
                                          • World
                                          • Users
                                          • Groups