Re: CJK Parsing Techniques

From: Roland Wang (rwang@verity.com)
Date: Tue Jul 01 1997 - 17:26:29 EDT

Next message: Jonathan Rosenne: "Re: MES as an ISO standard?"
Previous message: Rick McGowan: "Re: CJK Parsing Techniques"
Maybe in reply to: David C. Brauer: "CJK Parsing Techniques"
Next in thread: Maobing Jin: "Re: CJK Parsing Techniques"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ] [ attachment ]
Mail actions: [ respond to this message ] [ mail a new topic ]

> The parsing of CJK text to find meaning tokens (word equivalents) seems
> to be a daunting problem due to lack of word boundaries. Are there any
> techniques, tools or algorithms (free or licensable) that do a good job
> of parsing "words" out of a CJK string.

Verity's partners in China (Sino-Software) and Japan (NEC and Omron) develop
tokenizers which break text into smaller elements (words/phrases/tokens)
for Verity's text search and retrieval products.

_Roland Wang

Next message: Jonathan Rosenne: "Re: MES as an ISO standard?"
Previous message: Rick McGowan: "Re: CJK Parsing Techniques"
Maybe in reply to: David C. Brauer: "CJK Parsing Techniques"
Next in thread: Maobing Jin: "Re: CJK Parsing Techniques"
Messages sorted by: [ date ] [ thread ] [ subject ] [ author ] [ attachment ]
Mail actions: [ respond to this message ] [ mail a new topic ]

This archive was generated by hypermail 2.1.2 : Tue Jul 10 2001 - 17:20:35 EDT