Looks like the server problems are spreading...
-
Planes grounded as mass worldwide IT outage hits airlines, media and banks - BBC News[^] It's not just the CodeProject hamsters that are on strike any more! :laugh:
"These people looked deep within my soul and assigned me a number based on the order in which I joined." - Homer
I have two questions: 1) Did you test the new deployment package? Obviously not. The financial ramifications of this error could very well end Crowdstrike. Remember Takata? 2) How is it that this software is crashing the OS? I found this: On Friday, CrowdStrike experienced a major disruption following an issue with a software update. This caused Windows to crash due to a fault in the way CrowdStrike's software update interacted with Windows. So, not only are there reports of workstations crashing (Windows 10 and 11) but the servers are getting nuked as well. Sounds like the Crowdstrike client has a pretty intimite relationship with the kernel. Is it even a wonder why people have trepidation installing updates?
Charlie Gilley “They who can give up essential liberty to obtain a little temporary safety deserve neither liberty nor safety.” BF, 1759 Has never been more appropriate.
-
I have two questions: 1) Did you test the new deployment package? Obviously not. The financial ramifications of this error could very well end Crowdstrike. Remember Takata? 2) How is it that this software is crashing the OS? I found this: On Friday, CrowdStrike experienced a major disruption following an issue with a software update. This caused Windows to crash due to a fault in the way CrowdStrike's software update interacted with Windows. So, not only are there reports of workstations crashing (Windows 10 and 11) but the servers are getting nuked as well. Sounds like the Crowdstrike client has a pretty intimite relationship with the kernel. Is it even a wonder why people have trepidation installing updates?
Charlie Gilley “They who can give up essential liberty to obtain a little temporary safety deserve neither liberty nor safety.” BF, 1759 Has never been more appropriate.
totally irresponsible developers and testers ..releasing updates without testing ... imagine working at a big company with your so called agent installed in windows system directory and as a driver and used at critical points world wide...blame it on dev ops and other fancy words.....people getting stuck ...hell for system admins...world wide..
Caveat Emptor. "Progress doesn't come from early risers – progress is made by lazy men looking for easier ways to do things." Lazarus Long
-
totally irresponsible developers and testers ..releasing updates without testing ... imagine working at a big company with your so called agent installed in windows system directory and as a driver and used at critical points world wide...blame it on dev ops and other fancy words.....people getting stuck ...hell for system admins...world wide..
Caveat Emptor. "Progress doesn't come from early risers – progress is made by lazy men looking for easier ways to do things." Lazarus Long
abmv wrote:
totally irresponsible developers and testers ..releasing updates without testing ...
Don't blame the devs. To an extent, don't even blame the testers. Blame those who signed off on the whole thing being released. Which I'm betting are multiple levels of management up.
-
abmv wrote:
totally irresponsible developers and testers ..releasing updates without testing ...
Don't blame the devs. To an extent, don't even blame the testers. Blame those who signed off on the whole thing being released. Which I'm betting are multiple levels of management up.
this thread [https://www.reddit.com/r/crowdstrike/comments/1e6vmkf/bsod\_error\_in\_latest\_crowdstrike\_update/\](https://www.reddit.com/r/crowdstrike/comments/1e6vmkf/bsod\_error\_in\_latest\_crowdstrike\_update/) shows whats happening... sad ......... ..................... msft and cs ..hope it people are able to fix world wide and we get back to normal....and we learn from this
Caveat Emptor. "Progress doesn't come from early risers – progress is made by lazy men looking for easier ways to do things." Lazarus Long
-
this thread [https://www.reddit.com/r/crowdstrike/comments/1e6vmkf/bsod\_error\_in\_latest\_crowdstrike\_update/\](https://www.reddit.com/r/crowdstrike/comments/1e6vmkf/bsod\_error\_in\_latest\_crowdstrike\_update/) shows whats happening... sad ......... ..................... msft and cs ..hope it people are able to fix world wide and we get back to normal....and we learn from this
Caveat Emptor. "Progress doesn't come from early risers – progress is made by lazy men looking for easier ways to do things." Lazarus Long
abmv wrote:
and we learn from this
Now that's a tall order.
"the debugger doesn't tell me anything because this code compiles just fine" - random QA comment "Facebook is where you tell lies to your friends. Twitter is where you tell the truth to strangers." - chriselst "I don't drink any more... then again, I don't drink any less." - Mike Mullikins uncle
-
Planes grounded as mass worldwide IT outage hits airlines, media and banks - BBC News[^] It's not just the CodeProject hamsters that are on strike any more! :laugh:
"These people looked deep within my soul and assigned me a number based on the order in which I joined." - Homer
Looks like xkcd is getting in on this [xkcd: CrowdStrike](https://xkcd.com/2961)
"A little song, a little dance, a little seltzer down your pants" Chuckles the clown
-
this thread [https://www.reddit.com/r/crowdstrike/comments/1e6vmkf/bsod\_error\_in\_latest\_crowdstrike\_update/\](https://www.reddit.com/r/crowdstrike/comments/1e6vmkf/bsod\_error\_in\_latest\_crowdstrike\_update/) shows whats happening... sad ......... ..................... msft and cs ..hope it people are able to fix world wide and we get back to normal....and we learn from this
Caveat Emptor. "Progress doesn't come from early risers – progress is made by lazy men looking for easier ways to do things." Lazarus Long
I certainly haven't read every single last detail available on this (not even close), but my current understanding is that CrowdStrike has some security software that includes a kernel mode driver, and a new release of it is what's causing the crash. Drivers are some of the most notoriously difficult software to write, and they *need* to be written correctly, otherwise this is the result, unlike your average spreadsheet app crashing. Does this particular driver provide some functionality that couldn't be done in a user-mode app, or handed off to MS's own AV?
-
Planes grounded as mass worldwide IT outage hits airlines, media and banks - BBC News[^] It's not just the CodeProject hamsters that are on strike any more! :laugh:
"These people looked deep within my soul and assigned me a number based on the order in which I joined." - Homer
[lol crowdstrike just destroyed the internet - YouTube](https://youtu.be/pCxvyIx922A?t=220) ... analysis
Caveat Emptor. "Progress doesn't come from early risers – progress is made by lazy men looking for easier ways to do things." Lazarus Long
-
I certainly haven't read every single last detail available on this (not even close), but my current understanding is that CrowdStrike has some security software that includes a kernel mode driver, and a new release of it is what's causing the crash. Drivers are some of the most notoriously difficult software to write, and they *need* to be written correctly, otherwise this is the result, unlike your average spreadsheet app crashing. Does this particular driver provide some functionality that couldn't be done in a user-mode app, or handed off to MS's own AV?
This is what I have heard as well. There is a chunk of code that is deep in the kernel. That's all well and good, but if you want to put your hands down some other person's pants, you might ask for permission - in this case, test the flying elephant out of it. This smells like Crowdstrike got a bit lazy, and the other post about layers of management being involved induces me to go hmm. I'm not blaming the developers or testers. This is a systems engineering issue, and due to the critical nature of this software, there needs to be ONE person willing to bet his or her job that all is well. With all that said, how f'ing hard would it be to duplicate - I don't know - the servers of 10 key customers and test it on those machines?
Charlie Gilley “They who can give up essential liberty to obtain a little temporary safety deserve neither liberty nor safety.” BF, 1759 Has never been more appropriate.
-
Planes grounded as mass worldwide IT outage hits airlines, media and banks - BBC News[^] It's not just the CodeProject hamsters that are on strike any more! :laugh:
"These people looked deep within my soul and assigned me a number based on the order in which I joined." - Homer
Crowdstrike will likely not survive this incident. If you own stock, dump it now. I know many of us here do things like web development, etc but many of us work on mission critical systems. I read an article that the FAA was having difficulty communicating with in flight aircraft. Depending on Microsoft for mission critical systems is begging for a career ending day.
Charlie Gilley “They who can give up essential liberty to obtain a little temporary safety deserve neither liberty nor safety.” BF, 1759 Has never been more appropriate.
-
This is what I have heard as well. There is a chunk of code that is deep in the kernel. That's all well and good, but if you want to put your hands down some other person's pants, you might ask for permission - in this case, test the flying elephant out of it. This smells like Crowdstrike got a bit lazy, and the other post about layers of management being involved induces me to go hmm. I'm not blaming the developers or testers. This is a systems engineering issue, and due to the critical nature of this software, there needs to be ONE person willing to bet his or her job that all is well. With all that said, how f'ing hard would it be to duplicate - I don't know - the servers of 10 key customers and test it on those machines?
Charlie Gilley “They who can give up essential liberty to obtain a little temporary safety deserve neither liberty nor safety.” BF, 1759 Has never been more appropriate.
-
charlieg wrote:
how f'ing hard would it be to duplicate
Well, there's plenty of test machines available to try on now! :-D
