Either I'm missing something or .NET is

honey the codewitch

So .NET uses 16bit unicode by default, and with the territory comes the possibility of 32 bit codes embedded as surrogate pairs. That's all well and good even if it complicates things. However, .NET provides no functions for operating on those 32-bit values. No char.IsWhiteSpace(). No GetUnicodeCategory(), nada. So what the hell are you supposed to do with these values? *angery*

Real programmers use butterflies

Greg Utas

Telling that there wasn't one for Germany. DoneMark is very close to how it's actually pronounced natively (in Norwegian and Swedish, at any rate; Danish has been referred to as a throat disease rather than a language).

Richard Deeming

I don't know enough about UTF-32, but what about: Char.IsHighSurrogate Method (System) | Microsoft Docs[^] Char.ConvertToUtf32 Method (System) | Microsoft Docs[^] Char.ConvertFromUtf32(Int32) Method (System) | Microsoft Docs[^] Or maybe Jon Skeet's article will have something useful: Unicode and .NET[^]

"These people looked deep within my soul and assigned me a number based on the order in which I joined." - Homer

OriginalGriff

Um ... Char.IsWhiteSpace Method (System) | Microsoft Docs[^] and Char.GetUnicodeCategory Method (System) | Microsoft Docs[^] Or am I missing something?

"I have no idea what I did, but I'm taking full credit for it." - ThisOldTony AntiTwitter: @DalekDave is now a follower!

Lost User

What is about Char.IsWhiteSpace Method (System) | Microsoft Docs[^]

It does not solve my Problem, but it answers my question

honey the codewitch

Only works for 16 bit unicode values. Not these 32bit surrogates

Real programmers use butterflies

honey the codewitch

Okay yes, but once i have that converted (either to a 32bit int, or a double-char string, i can't do anything with it. I can't call char.IsWhiteSpace with it. I can't do anything but print its value. Which is stupid

Real programmers use butterflies

Richard Deeming

ASCII FTW! 127 characters should be enough for anyone! :-D I'm not sure there are any whitespace characters that would be encoded as a surrogate pair: Whitespace character - Wikipedia[^]

"These people looked deep within my soul and assigned me a number based on the order in which I joined." - Homer

RugbyLeague

"So what the hell are you supposed to do with these values" hope they never appear.

RugbyLeague

And EBCDIC - everybody always forgets EBCDIC :sigh:

honey the codewitch

Pretty much! :thumbsup:

Real programmers use butterflies

honey the codewitch

I've encountered a weird one. But I don't remember if it was a surrogate or not. I just remember it didn't print to the console properly (it cooked it) or didn't save to source as a literal value or something. It came up as whitespace, but only when I used these huge "not ranges" which are like [^a-z] (anything but a lower case letter) that "anything" part created ranges all throughout the 16-bit unicode spectrum. And that's when I ran into issues with one whitespace character.

Real programmers use butterflies

Greg Utas

And sixbit on DEC's PDP systems!

Dr Walt Fair PE

Actually Baudot it sufficient at 5 bits. CQ de W5ALT

Walt Fair, Jr.PhD P. E. Comport Computing Specializing in Technical Engineering Software

BillWoodruff

idea: research using Unicode categories in your RegEx ? [^]

«One day it will have to be officially admitted that what we have christened reality is an even greater illusion than the world of dreams.» Salvador Dali

honey the codewitch

I am using those. The category for surrogates is surrogate. Not helpful. Combining a hi and lo surrogate you get a 2 char string. The 2 char string cannot be queried for its unicode category in .NET AFAIK

Real programmers use butterflies

BillWoodruff

honey the codewitch wrote:

The 2 char string cannot be queried for its unicode category in .NET AFAIK

It is a mess, but, check this against what you expect, now:

public void PrintUniCodeRange(int sc, int ec)
{
bool isKey;

string key = "";

for (int i = sc; i <= ec; i++)
{
    string ucString = char.ConvertFromUtf32(i);
    
    isKey = i < 256;

    if (isKey) key = ((Keys)Enum.Parse(typeof(Keys), i.ToString())).ToString();

    UnicodeCategory cat = Char.GetUnicodeCategory(ucString, 0);

    if (cat != UnicodeCategory.OtherNotAssigned)
    {
        Console.WriteLine($"#{i} | Unicode Category: {cat} {(isKey ? "! Keys Enum: " + key : "")}");
    }
}

}

Calling the above with 8192 to 8233 parameters:

honey the codewitch

hmm, I wonder what my test was doing wrong, because GetUnicodeCategory(string, int) was returning only single char values for me i thought. maybe i had a bug

Real programmers use butterflies

honey the codewitch

Thank you! Turns out there was a bug in my code where i wasn't passing doublechar strings in. They ended up single char.

Real programmers use butterflies

User 2893688

Will someone please think about the children. [https://tenor.com/FJmS.gif\](https://tenor.com/FJmS.gif)