Re: any unicode conversion tools?

From: Chris Jacobs (c.t.mjacobs@freeler.nl)
Date: Fri May 07 2004 - 06:20:33 CDT


----- Original Message -----
From: "Chan Fook Sheng" <chanfooksheng@pacific.net.sg>
To: <unicode@unicode.org>
Sent: Friday, May 07, 2004 10:03 AM
Subject: any unicode conversion tools?

> Hi
>
> I am looking for unicode, utf-8 coonversion tools for windows platform,
> but can't find any on the web.
>
> can anyone direct me to some links?
>
> for example: the "/" character is 47 in decimal, 2F in hex.
>
> it can be represented in UTF-8 format as:
> 1 byte: still 2F
> 2 bytes: C0 AF (illegal)
> 3 bytes: E0 80 AF (illegal)

How should the conversion tools handle the illegal sequences?

If you want them accepted as if they were legal then I think the best way is
to pass the text thru a filter before feeding it to a conversion tool.

Writing a filter that replaces the illegal sequences by legal ones should
not be hard.



This archive was generated by hypermail 2.1.5 : Fri May 07 2004 - 18:45:26 CDT