The Unicode Consortium Discussion Forum

I and my team working onSindhi Language sorting issues. We needto ask that can we change sort order by assigning different code weights ofSindhi Unicode Collection. Current Unicode char collection of Sindhi languagehaving many sorting issues. For example
Random Data for checking sort order
name sortorder
ٽوپي 7
ڊيل 23
هاري 50
غالب 36
موت 46
ڪردار 39
گھارو 43
Accordingto above input the required result of names by following sort order should comelike 7,23,36,39,43,46,50.
Case 1: Query execution without sort order –Default sortorder
Query :“SELECT names.name, names.sortorder FROM [names]order by name asc”
Results :
name sortorder
غالب 36
گھارو 43
موت 46
هاري 50
ٽوپي 7
ڊيل 23
ڪردار 39
Above results are really not following Sindhi alphabet sort order .
We need your comments andfeedback regarding concern issues. Your feedback wills highly appricated.

Reading your query, I believe the answer is to support sorting that is not based on code points but on sort-weights, using the UCA (UTS#10). This will likely need tailoring to your language, which would be the domain of CLDR. I'm hoping someone here can help you.

The DUCET (the default ordering for the Unicode Collation algorithm) is primarily useful for supplying a base ordering, and is rarely suitable for specific languages without a language tailoring. For the language tailorings, you need to look at DUCET plus CLDR.

The language tailorings are at http://unicode.org/repos/cldr/trunk/common/collation/ (also beta for CLDR v21). If additions/changes are needed for Singhi, please file a bug at http://unicode.org/cldr/trac/newticket. Collation ordering can be quite tricky to specify: please see the guidelines at http://cldr.unicode.org/index/cldr-spec ... guidelines.

BTW, there is a chart for the next DUCET at http://www.unicode.org/charts-6.1.0beta/collation/

See also:

http://unicode.org/collation/
http://unicode.org/faq/collation.html
http://unicode.org/collation/ducet-changes.html
http://unicode.org/collation/ducet-criteria.html