Testing if Unicode

[Software_Developer]

Nothing seems to work. The output of the code below is always Text is ASCII

#define UNICODE
#define _UNICODE
#include <windows.h>
#include <tchar.h>
#include <wchar.h>
#include <stdio.h>

int main()
{

char \*asciimessage = "This is an ASCII string.";
wchar\_t \*unicodemessage = L"This is a Wide Unicode string.";
TCHAR \*automessage = TEXT("This message can be either ASCII or UNICODE!");



if(IsTextUnicode(unicodemessage,80,NULL))
 printf("Text is Unicode\\n");
else
  printf("Text is ASCII\\n");


if(IsTextUnicode(asciimessage,80,NULL))
 printf("Text is Unicode\\n");
else
  printf("Text is ASCII\\n");

return 0;
}

[Lost User]

This code works:

char ascii\[\] = "The rain in Spain";
WCHAR ucode\[\] = L"The rain in Spain";

wcout << "Testing the ASCII string" << endl;
if (IsTextUnicode(ascii, sizeof ascii, NULL))
	wcout << "It is Unicode" << endl;
else
	wcout << "It is NOT Unicode" << endl;

wcout << "Testing the Unicode string" << endl;
if (IsTextUnicode(ucode, sizeof ucode, NULL))
	wcout << "It is Unicode" << endl;
else
	wcout << "It is NOT Unicode" << endl;

The issue seems to be that the buffer length must be correct, and parameter 3 should be NULL to ensure all possible tests are tried.

It's time for a new signature.

[Lost User]

Your parameters are incorrect. You have specified 80 for the buffer length in both your calls, but neither of your strings are 80 bytes long, so the tests will be inspecting some random data beyond the end of the strings. See also my response below.

It's time for a new signature.

[Software_Developer]

Thanks Richard. I ran your code and it works. Output:

Testing the ASCII string
It is NOT Unicode
Testing the Unicode string
It is Unicode
Press any key to continue

Complete code listing

#define UNICODE
#define _UNICODE
#include <windows.h>
#include <tchar.h>
#include <wchar.h>
#include <stdio.h>
#include <iostream.h>

int main()
{
char ascii[] = "The rain in Spain";
WCHAR ucode[] = L"The rain in Spain";

cout << "Testing the ASCII string" << endl;
if (IsTextUnicode(ascii, sizeof ascii, NULL))
	cout << "It is Unicode" << endl;
else
	cout << "It is NOT Unicode" << endl;

cout << "Testing the Unicode string" << endl;
if (IsTextUnicode(ucode, sizeof ucode, NULL))
	cout << "It is Unicode" << endl;
else
	cout << "It is NOT Unicode" << endl;

return 0;

}

[Rajesh R Subramanian]

I wish it were as simple as that. Try this:

LPCWSTR str = L"कमल"; //If you see ???, then you don't have Indic fonts installed.
BOOL b = false;
b = IsTextUnicode(str, _tcslen(str), NULL);
if(b)
AfxMessageBox(L"Text is Unicode!");
else
AfxMessageBox(L"Boo!");

I've worked extensively with Asian languages and I've never had this API to work reiably. I know the documentation kinda confesses it, but there has been no development on this at all!

Richard MacCutchan wrote:

char ascii[] = "The rain in Spain";

Richard MacCutchan wrote:

if (IsTextUnicode(ascii, sizeof ascii, NULL))

Also, your example is flawed because you're wrongly passing the size of the pointer instead of passing the size of the buffer itself in bytes.

Workout progress:
Current arm size: 14.4in
Desired arm size: 18in
Next Target: 15.4in by Dec 2010

Current training method: HIT

[Niklas L]

Rajesh R Subramanian wrote:

Also, your example is flawed because you're wrongly passing the size of the pointer instead of passing the size of the buffer itself in bytes.

No. Last time I checked:

char ascii\[\] = "The rain in Spain";

sizeof ascii == ::strlen(ascii) + 1

home

[Hans Dietrich]

I wonder what result you would get if the second param was number of bytes:

LPCWSTR str = L"कमल"; //If you see ???, then you don't have Indic fonts installed.
BOOL b = false;
b = IsTextUnicode(str, _tcslen(str)*sizeof(WCHAR), NULL);

Best wishes, Hans

---

[Hans Dietrich Software]

[Aescleal]

What pointer? Richard was taking the size of an array. Ash

[Lost User]

This works: (apologies if that is not Hindi, and I hope it's a nice word!)

WCHAR hindi[] = L"कमल";

wcout << sizeof hindi << endl;

if (IsTextUnicode(hindi, sizeof hindi, NULL))
wcout << "It is Unicode" << endl;

Note the result of the sizeof operator; sizeof arrayName gives size in bytes, which is the value required by the IsTextUnicode() function.

It's time for a new signature.

[Rajesh R Subramanian]

Yes, yes, apologies. See my reply to Richard. :)

Workout progress:
Current arm size: 14.4in
Desired arm size: 18in
Next Target: 15.4in by Dec 2010

Current training method: HIT

[Rajesh R Subramanian]

I must stop replying in the middle of the night. I overlooked it were size of an array. The word cannot be nicer, it means "Lotus". This probably means the API is now "improved"?! I'd be glad to go and test some of the old stuff that never worked. I'll keep you posted if they don't!

Workout progress:
Current arm size: 14.4in
Desired arm size: 18in
Next Target: 15.4in by Dec 2010

Current training method: HIT

[Lost User]

Rajesh R Subramanian wrote:

I must stop replying in the middle of the night.

If it's any consolation I do this all the time in the middle of the day!

It's time for a new signature.

[Niklas L]

No worries, I consider it a typo :)

home

[Nemanja Trifunovic]

Michael Kaplan does not like IsTextUnicode either.[^]

utf8-cpp

[VeganFanatic]

One other idea that comes to mind try { cout << mystring << endl; catch wcout << mystring << endl; }

http://www.contract-developer.tk

[ThatsAlok]

Rajesh R Subramanian wrote:

Workout progress: Current arm size: 14.4in Desired arm size: 18in Next Target: 15.4in by Dec 2010

Thats Incredible :-)

"Opinions are neither right nor wrong. I cannot change your opinion. I can, however, change what influences your opinion." - David Crow
Never mind - my own stupidity is the source of every "problem" - Mixture

cheers, Alok Gupta VC Forum Q&A :- I/IV Support CRY- Child Relief and You