lkml.org 
[lkml]   [2007]   [Nov]   [6]   [last100]   RSS Feed
Views: [wrap][no wrap]   [headers]  [forward] 
 
Messages in this thread
    /
    From
    SubjectRe: [PATCH] Smackv10: Smack rules grammar + their stateful parser
    Date
    On Nov 06, 2007, at 01:33:05, Adrian Bunk wrote:
    > Can you limit this to 7bit ASCII and use isascii() somewhere?
    >
    > Otherwise I'd expect funny things to happen when you e.g. use
    > isspace() on the UTF-8 encoded character à.

    Actually, you don't need to. You tell them it expects UTF-8 encoded
    strings and be done with it. All US-ASCII characters from 0 through
    127 (IE: high bit clear) are exactly the same in UTF-8, and UTF-8
    special characters have the high bit set in all bytes. Therefore you
    just assume that anything with the high bit set is part of a word and
    you can handle basic UTF-8. (It doesn't work on special UTF-8 space
    characters like nonbreaking space and similar, but handling those is
    significantly more complicated).

    Cheers,
    Kyle Moffett

    -
    To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
    the body of a message to majordomo@vger.kernel.org
    More majordomo info at http://vger.kernel.org/majordomo-info.html
    Please read the FAQ at http://www.tux.org/lkml/

    \
     
     \ /
      Last update: 2007-11-06 09:29    [W:7.293 / U:0.044 seconds]
    ©2003-2020 Jasper Spaans|hosted at Digital Ocean and TransIP|Read the blog|Advertise on this site