Word breaks in strings <uniwbrk.h>
**********************************

This include file declares functions for determining where in a string ``words'' start and end.  Here ``words'' are not necessarily the same as entities that can be looked up in dictionaries, but rather groups of consecutive characters that should not be split by text processing operations.

Word breaks in a string
=======================

The following functions determine the word breaks in a string.

 -- Function: void u8_wordbreaks (const uint8_t *S, size_t N, char *P)
 -- Function: void u16_wordbreaks (const uint16_t *S, size_t N, char *P)
 -- Function: void u32_wordbreaks (const uint32_t *S, size_t N, char *P)
 -- Function: void ulc_wordbreaks (const char *S, size_t N, char *P)
     Determines the word break points in S, an array of N units, and stores the result at P[0..N-1].

     P[i] = 1
          means that there is a word boundary between S[i-1] and S[i].

     P[i] = 0
          means that S[i-1] and S[i] must not be separated.

     P[0] is always set to 0.  If an application wants to consider a word break to be present at the beginning of the string (before S[0]) or at the end of the string (after S[0..N-1]), it has to treat these cases explicitly.

Word break property
===================

This is a more low-level API.  The word break property is a property defined in Unicode Standard Annex #29, section ``Word Boundaries'', see http://www.unicode.org/reports/tr29/#Word_Boundaries.texnl  It is used for determining the word breaks in a string.

The following are the possible values of the word break property.  More values may be added in the future.

 -- Constant: int WBP_OTHER
 -- Constant: int WBP_CR
 -- Constant: int WBP_LF
 -- Constant: int WBP_NEWLINE
 -- Constant: int WBP_EXTEND
 -- Constant: int WBP_FORMAT
 -- Constant: int WBP_KATAKANA
 -- Constant: int WBP_ALETTER
 -- Constant: int WBP_MIDNUMLET
 -- Constant: int WBP_MIDLETTER
 -- Constant: int WBP_MIDNUM
 -- Constant: int WBP_NUMERIC
 -- Constant: int WBP_EXTENDNUMLET

The following function looks up the word break property of a character.

 -- Function: int uc_wordbreak_property (ucs4_t UC)
     Returns the Word_Break property of a Unicode character.