Developing a Multilingual Text Analysis Engine - Does Using Unicode Solve All the Issues?
Brian O'Donovan - IBM Software Group
The IBM Dictionary and Linguistic Tools Group produces linguistic analysis tools which support over 30 different languages. The previous version of this product supported a wide variety of code pages for each of the languages. This presentation will describe the capabilities and value of the linguistic tools, and then describe how the dictionaries were ported from a mixed code page architecture to one that uses Unicode for all dictionaries.
I will discuss some of the benefits we gain from using Unicode e.g.
I will also describe some internationalization issues that remain even after the Unicode conversion e.g.
|When the world wants to talk, it speaks Unicode|
International Unicode Conferences are organized by Global Meeting Services, Inc., (GMS).
GMS is pleased to be able to offer the International Unicode Conferences under an exclusive
license granted by the Unicode Consortium. All responsibility for conference finances and
operations is borne by GMS. The independent conference board serves solely at the pleasure
of GMS and is composed of volunteers active in Unicode and in international software
development. All inquiries regarding International Unicode Conferences should be addressed
Unicode and the Unicode logo are registered trademarks of Unicode, Inc. Used with permission.
23 May 2002, Webmaster