Description of Issue:
We request feedback on a proposal to publish, as part of the data files for The Unicode Standard,
state machines that can be used for a performant implementation of the Unicode line breaking algorithm and the
Unicode grapheme cluster, word, and sentence segmentation algorithms.
The data files describing state machines that implement Version 17.0 of the line breaking and segmentation algorithms are available at https://unicode.org/review/pri555/17.0.0/.
The data files describing state machines that implement the proposed updates for Version 18.0 of the line breaking and segmentation algorithms are available at https://unicode.org/review/pri555/18.0.0/.
The proposal, which includes background information as well as documentation on the use of these data files, is found in document L2/26-135.
How to Provide Feedback: For information about how to discuss this
Public Review Issue and how to supply
formal feedback, please see the
feedback and discussion
instructions. The accumulated feedback received so far on this issue is shown below,
or you can look at a full page view.
Feedback is reviewed by the relevant committee according to their meeting schedule.
|