Readline - UTF-8 or Unicode or both?

I am just wondering in what format does ReadLine read the characters in? Can it read Unicode text files?

Hi,

Not as yet - it just reads a byte-per-char so it's pretty much 'ascii' (or 'Latin1' by 'Max convention').

I have started work on a TextStream type though, and the next release of the compiler will be able to parse Latin1/UTF8/UTF16 source files. In addition, the Mac IDE will be able to save in Latin1/UTF8/UTF16 format. This was very easy to do on the Mac - I'm not sure when the Win32 IDE will catch up.

Hi,

I've been playing around with this tonight and having trouble. Have the above changed been implemented.

In my code I'm trying to compare a sting in my source with a string read from a file.

When the files is saved as standard 8 bit text I have no problem, however when the file is saved as Unicode 16 my seach string is not found.

Whats more, when I write to this unicode 16 file, latin characters from the source file are saved as some kind of asian glif?

Anybody know what I'm doing wrong?

So to clarify my question, does Readline read UTF 16 yet? It it still reading ascii? Will it ever?

Hi Mark,

Great thinking! So long as win can read them that will be fine as I am required to have local languages, ie Japanese in my game. It will be awesomely cool to see it.

OK new question, anybody know how to read raw bytes from a file and convert it to a Unicode 16 string :)