Re: Several BOMs in the same file

From: Doug Ewell (dewell@adelphia.net)
Date: Tue Mar 25 2003 - 11:10:46 EST

  • Next message: Edward H Trager: "Detecting UTF-8 Locale Question"

    Kent Karlsson <kentk at md dot chalmers dot se> wrote:

    > To avoid "flag bloat", one can instead use the "iconv" command,
    > and apply that to the source files. Since "head" and "tail" assumes
    > an ASCII compatible singlebyte or multibyte encoding, where any
    > state is reset at LF, the target encoding for the iconv command
    > must, for those commands, be such an encoding.

    I assume that means iconv doesn't consider SCSU to be "ASCII
    compatible," since SCSU doesn't reset its state at LF. Then again, SCSU
    has a 16-bit "Unicode mode" which allows arbitrary bytes, so I guess I
    answered my own question.

    -Doug Ewell
     Fullerton, California
     http://users.adelphia.net/~dewell/

    This archive was generated by hypermail 2.1.5 : Tue Mar 25 2003 - 12:04:32 EST