Time to ask for another computer!
-
I just beat this one up. Yup, got my auto-scaling (based on data, not processors) threading model running well, and knocked out all four cores with a large dataset. That justifies a new computer right? Or rather, I just have to limit my scaling to the appropriate number of cores.... darn....
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
-
I just beat this one up. Yup, got my auto-scaling (based on data, not processors) threading model running well, and knocked out all four cores with a large dataset. That justifies a new computer right? Or rather, I just have to limit my scaling to the appropriate number of cores.... darn....
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
Oh definitely. Now publish your code so we can all do that.
-
Oh definitely. Now publish your code so we can all do that.
PIEBALDconsult wrote:
Now publish your code so we can all do that.
piece of cake.... typical builder design pattern modified for parallel nature, director feeds n number of workers to work, each worker is a VERY typical builder design pattern running original linear mode. Implicitely shared atomically protected queue in to each worker, when work queues are filled with n number of entries waiting, hire another worker (you are falling behind). see, all there. ;P
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
-
I just beat this one up. Yup, got my auto-scaling (based on data, not processors) threading model running well, and knocked out all four cores with a large dataset. That justifies a new computer right? Or rather, I just have to limit my scaling to the appropriate number of cores.... darn....
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
El Corazon wrote:
Yup, got my auto-scaling (based on data, not processors) threading model running well,
Sounds like a great article to me!
A guide to posting questions on CodeProject[^]
Dave Kreskowiak Microsoft MVP Visual Developer - Visual Basic
2006, 2007 -
I just beat this one up. Yup, got my auto-scaling (based on data, not processors) threading model running well, and knocked out all four cores with a large dataset. That justifies a new computer right? Or rather, I just have to limit my scaling to the appropriate number of cores.... darn....
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
with Penryn coming out in a month and a half you've maxed out your hardware just a little bit early. EDIT: Also nVidia is alleged to be releasing new GPUs in mid November. Back in April a PR person said something about a 1 terraflop card for the next refresh, but otherwise is keeping everything very close to their chest fueling the rumor mills at a breakneck pace.
-- If you view money as inherently evil, I view it as my duty to assist in making you more virtuous.
-
PIEBALDconsult wrote:
Now publish your code so we can all do that.
piece of cake.... typical builder design pattern modified for parallel nature, director feeds n number of workers to work, each worker is a VERY typical builder design pattern running original linear mode. Implicitely shared atomically protected queue in to each worker, when work queues are filled with n number of entries waiting, hire another worker (you are falling behind). see, all there. ;P
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
-
with Penryn coming out in a month and a half you've maxed out your hardware just a little bit early. EDIT: Also nVidia is alleged to be releasing new GPUs in mid November. Back in April a PR person said something about a 1 terraflop card for the next refresh, but otherwise is keeping everything very close to their chest fueling the rumor mills at a breakneck pace.
-- If you view money as inherently evil, I view it as my duty to assist in making you more virtuous.
dan neely wrote:
with Penryn coming out in a month and a half you've maxed out your hardware just a little bit early. EDIT: Also nVidia is alleged to be releasing new GPUs in mid November. Back in April a PR person said something about a 1 terraflop card for the next refresh, but otherwise is keeping everything very close to their chest fueling the rumor mills at a breakneck pace.
well, this new design is suppost to last at least until 32 cores, I am hoping past, but not going to count my chickens before they core, or what ever it should be.... I'll know for sure when I get a few Penryn in test it. ;) and given a month that it takes to order anything around here, my timing isn't as far off as you might think.... Yup, nVidia has an NDA in place and strongly nforced. If you ever want inside info again, you button your lip. :) -- modified at 16:30 Wednesday 26th September, 2007
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
-
dan neely wrote:
with Penryn coming out in a month and a half you've maxed out your hardware just a little bit early. EDIT: Also nVidia is alleged to be releasing new GPUs in mid November. Back in April a PR person said something about a 1 terraflop card for the next refresh, but otherwise is keeping everything very close to their chest fueling the rumor mills at a breakneck pace.
well, this new design is suppost to last at least until 32 cores, I am hoping past, but not going to count my chickens before they core, or what ever it should be.... I'll know for sure when I get a few Penryn in test it. ;) and given a month that it takes to order anything around here, my timing isn't as far off as you might think.... Yup, nVidia has an NDA in place and strongly nforced. If you ever want inside info again, you button your lip. :) -- modified at 16:30 Wednesday 26th September, 2007
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
El Corazon wrote:
and given a month that it takes to order anything around here, my timing isn't as far off as you might think....
hmmm So your purchase request is going to say "..The new nVidia card coming out next month that I can't put the name of here because everyone who knows is gagged by an NDA. Quantity: However many can be SLIed together. Price: TBD". Getting that approved sounds like it's going to be an 'interesting' experience. :rolleyes:
-- If you view money as inherently evil, I view it as my duty to assist in making you more virtuous.
-
dan neely wrote:
with Penryn coming out in a month and a half you've maxed out your hardware just a little bit early. EDIT: Also nVidia is alleged to be releasing new GPUs in mid November. Back in April a PR person said something about a 1 terraflop card for the next refresh, but otherwise is keeping everything very close to their chest fueling the rumor mills at a breakneck pace.
well, this new design is suppost to last at least until 32 cores, I am hoping past, but not going to count my chickens before they core, or what ever it should be.... I'll know for sure when I get a few Penryn in test it. ;) and given a month that it takes to order anything around here, my timing isn't as far off as you might think.... Yup, nVidia has an NDA in place and strongly nforced. If you ever want inside info again, you button your lip. :) -- modified at 16:30 Wednesday 26th September, 2007
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
-
El Corazon wrote:
and given a month that it takes to order anything around here, my timing isn't as far off as you might think....
hmmm So your purchase request is going to say "..The new nVidia card coming out next month that I can't put the name of here because everyone who knows is gagged by an NDA. Quantity: However many can be SLIed together. Price: TBD". Getting that approved sounds like it's going to be an 'interesting' experience. :rolleyes:
-- If you view money as inherently evil, I view it as my duty to assist in making you more virtuous.
You give the boss a blank piece of paper to sign, then fill in the details.
-
PIEBALDconsult wrote:
Now publish your code so we can all do that.
piece of cake.... typical builder design pattern modified for parallel nature, director feeds n number of workers to work, each worker is a VERY typical builder design pattern running original linear mode. Implicitely shared atomically protected queue in to each worker, when work queues are filled with n number of entries waiting, hire another worker (you are falling behind). see, all there. ;P
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
That's all well and good, but I don't have The Grand Negus' compiler. :-D
-
I just beat this one up. Yup, got my auto-scaling (based on data, not processors) threading model running well, and knocked out all four cores with a large dataset. That justifies a new computer right? Or rather, I just have to limit my scaling to the appropriate number of cores.... darn....
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
<boss-mode>Now is the time to dazzle us with your optimization techniques! That is, if you want a new computer again. Ever.</boss-mode>
-- Kein Mitleid Für Die Mehrheit
-
El Corazon wrote:
and given a month that it takes to order anything around here, my timing isn't as far off as you might think....
hmmm So your purchase request is going to say "..The new nVidia card coming out next month that I can't put the name of here because everyone who knows is gagged by an NDA. Quantity: However many can be SLIed together. Price: TBD". Getting that approved sounds like it's going to be an 'interesting' experience. :rolleyes:
-- If you view money as inherently evil, I view it as my duty to assist in making you more virtuous.
dan neely wrote:
hmmm So your purchase request is going to say "..The new nVidia card coming out next month that I can't put the name of here because everyone who knows is gagged by an NDA. Quantity: However many can be SLIed together. Price: TBD". Getting that approved sounds like it's going to be an 'interesting' experience.
no, the proposal for new work includes hardware upgrades that keep the proposal reviewer drooling at the possibilities. Given fiscal year is ending this weekend, the time is right and some are already in. Then money is granted, and purchase requests entered following the release.
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
-
That's all well and good, but I don't have The Grand Negus' compiler. :-D
PIEBALDconsult wrote:
but I don't have The Grand Negus' compiler.
That's okay, his doesn't do threading. and all that atomic stuff just overcomplicates everything. ;P
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
-
I just beat this one up. Yup, got my auto-scaling (based on data, not processors) threading model running well, and knocked out all four cores with a large dataset. That justifies a new computer right? Or rather, I just have to limit my scaling to the appropriate number of cores.... darn....
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
-
I just beat this one up. Yup, got my auto-scaling (based on data, not processors) threading model running well, and knocked out all four cores with a large dataset. That justifies a new computer right? Or rather, I just have to limit my scaling to the appropriate number of cores.... darn....
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
I think maybe a new programmer would solve the issue, but it's cheaper to buy a new system. :)
"Why don't you tie a kerosene-soaked rag around your ankles so the ants won't climb up and eat your candy ass..." - Dale Earnhardt, 1997
-----
"...the staggering layers of obscenity in your statement make it a work of art on so many levels." - Jason Jystad, 10/26/2001 -
<boss-mode>Now is the time to dazzle us with your optimization techniques! That is, if you want a new computer again. Ever.</boss-mode>
-- Kein Mitleid Für Die Mehrheit
Joergen Sigvardsson wrote:
Now is the time to dazzle us with your optimization techniques! That is, if you want a new computer again. Ever.
< boss response mode >My test proved the new design is scaleable to an n-processor model of unknown upper limit. Using four threads and gradually increasing data-flow we processed approximately 10 times the amount of data we processed under the previous design. That is effectively 50 times the last scaling model used in 1990's on the SGI/Cray Origin computers. We exceeded our goals by a whopping 2+ multiple through the use of more efficient processes and a redesigned core based entirely for a massively parallel and auto-scaling system. We respond to data as a company does to work, the threading model starts off respectively small and efficient, when work exceeds the ability to handle the load, more workers are hired automatically scaling the system. More than just a thread pool, this system is designed for massive data flow without synchronization blocking allowing free-running threads to "clear the work" faster than the competitor's products by at least 9 times. In short, four processors should have gained us 3.5 multiple in a decent scaling model. Through effcient design we stretched that number 10 times increase in data flow at the full limit of those 4 processors. Where that upper limit is we will have to find out. You could help us find that out as we shatter the data flow records again putting the company as a leader in parallel technology for ... industry.< /boss response mode > -- modified at 19:07 Wednesday 26th September, 2007
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
-
PIEBALDconsult wrote:
but I don't have The Grand Negus' compiler.
That's okay, his doesn't do threading. and all that atomic stuff just overcomplicates everything. ;P
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
Plus you use all those pesky floats and doubles.
This blanket smells like ham
-
Joergen Sigvardsson wrote:
Now is the time to dazzle us with your optimization techniques! That is, if you want a new computer again. Ever.
< boss response mode >My test proved the new design is scaleable to an n-processor model of unknown upper limit. Using four threads and gradually increasing data-flow we processed approximately 10 times the amount of data we processed under the previous design. That is effectively 50 times the last scaling model used in 1990's on the SGI/Cray Origin computers. We exceeded our goals by a whopping 2+ multiple through the use of more efficient processes and a redesigned core based entirely for a massively parallel and auto-scaling system. We respond to data as a company does to work, the threading model starts off respectively small and efficient, when work exceeds the ability to handle the load, more workers are hired automatically scaling the system. More than just a thread pool, this system is designed for massive data flow without synchronization blocking allowing free-running threads to "clear the work" faster than the competitor's products by at least 9 times. In short, four processors should have gained us 3.5 multiple in a decent scaling model. Through effcient design we stretched that number 10 times increase in data flow at the full limit of those 4 processors. Where that upper limit is we will have to find out. You could help us find that out as we shatter the data flow records again putting the company as a leader in parallel technology for ... industry.< /boss response mode > -- modified at 19:07 Wednesday 26th September, 2007
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)
-
Plus you use all those pesky floats and doubles.
This blanket smells like ham
Andy Brummer wrote:
you use all those pesky floats and doubles.
and half-floats and long double floats, if it floats, I use it. I think that qualifies me as evil incarnate to PEC.
_________________________ Asu no koto o ieba, tenjo de nezumi ga warau. Talk about things of tomorrow and the mice in the ceiling laugh. (Japanese Proverb)