design/unicodeset_properties.html

<html>

<head>
<meta http-equiv="Content-Language" content="en-us">
<meta http-equiv="Content-Type" content="text/html; charset=windows-1252">
<title>UnicodeSet Properties</title>
</head>

<body>

<h1 align="center">UnicodeSet Properties</h1>
<p align="center"><i>Draft 2001-08-06</i></p>
<p>The following gives a <i>draft</i> proposed list of additional properties
that could be used in building a <a
href="http://www.icu-project.org/apiref/icu4c/classUnicodeSet.html#_details">UnicodeSet</a>,
which is used in transliteration (filters and rules), rule-based break
iteration, and as a general utility. While we may not offer all of these
properties initially in ICU, the eventual goal would be to support them all.</p>
<p>There will be two ways of invoking these in building a UnicodeSet. The syntax
is an extension of POSIX or Perl syntax, with the addition of
&quot;=value&quot;. In the tables below, only the Perl-style is given.</p>
<div align="center">
  <center>
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th>&nbsp;</th>
      <th>Positive</th>
      <th>Negative</th>
    </tr>
    <tr>
      <th>Posix-style syntax:</th>
      <td>[:type=value:]</td>
      <td>[:^type=value:]</td>
    </tr>
    <tr>
      <th>Perl-style syntax:</th>
      <td>\p{type=value}</td>
      <td>\P{type=value}</td>
    </tr>
  </table>
  </center>
</div>
<p>There are three variants given in the tables.</p>
<ul>
  <li>short, which omits the type (to prevent ambiguity, only allowed for
    certain cases)</li>
  <li>medium, which uses an abbreviated type and value</li>
  <li>long, which uses a full type and value</li>
</ul>
<p>If the type or value are omitted, then the equals sign is also. The short
style is used only for GeneralCategory and Script, since these are very common
and the omission is unambiguous. The value is omitted only in the case of binary
properties, whose values are only TRUE and FALSE (alternates: T, F, Y, N, Yes,
No). For brevity, the binary properties are listed without values in the tables.
NumericValue and CombiningClass can take numeric values. Only one sample is
given in the table.</p>
<p>In actual practice, you can mix type names that are omitted, abbreviated, or
full with values that are omitted, abbreviated or full. So for GeneralCategory=Unassigned
you could use what is in the table explicitly, and you could also use \p{gc=Unassigned},
\p{GeneralCategory=Cn}, and \p{Unassigned}. For the binary property WhiteSpace,
you could use \p{WhiteSpace}, \p{WhiteSpace=T},&nbsp; \p{WhiteSpace=TRUE}, or
even \P{WhiteSpace=F} (although the latter is probably best avoided!).</p>
<p>Case and whitespace are ignored when these are processed, so you can use them
for clarity if desired. E.g. \p{General Category = Uppercase Letter} or&nbsp; \p{general
category = uppercase letter}.</p>
<b>Note:</b> the GeneralCategory is already supported by UnicodeSet in ICU 1.8,
but only in the short form. There are also some special values in the General
Category:
<ul>
  <li>A single letter represents every (two-letter) property value that starts
    with that letter. Thus \p{M} represents the union of \p{Mn}, \p{Mc}, and \p{Me).</li>
  <li>The value &quot;Any&quot; will match against any code point: it is
    equivalent to [\u0000-\U0010FFFF].</li>
</ul>
<p>For omitted properties, see <a href="#Omitted_Properties">Omitted Properties</a>.
For a possible implementation, see <a href="#Possible_Implementation">Possible
Implementation</a>. For examples of these in transliteration, see <a
href="file:///C:/Documents%20and%20Settings/Davis/My%20Documents/ICU/transliteration_rule_tutorial.htm">Transliteration
Rule Tutorial</a>.</p>
<hr>
<div align="center">
  <center>
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th colspan="3" bgcolor="#FFFF00">General Category</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Short</th>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{Any}</td>
      <td>\p{gc=Any}</td>
      <td>\p{GeneralCategory=Any}</td>
    </tr>
    <tr>
      <td>\p{L}</td>
      <td>\p{gc=L}</td>
      <td>\p{GeneralCategory=Letter}</td>
    </tr>
    <tr>
      <td>\p{M}</td>
      <td>\p{gc=M}</td>
      <td>\p{GeneralCategory=Mark}</td>
    </tr>
    <tr>
      <td>\p{N}</td>
      <td>\p{gc=N}</td>
      <td>\p{GeneralCategory=Number}</td>
    </tr>
    <tr>
      <td>\p{C}</td>
      <td>\p{gc=C}</td>
      <td>\p{GeneralCategory=Other}</td>
    </tr>
    <tr>
      <td>\p{Z}</td>
      <td>\p{gc=Z}</td>
      <td>\p{GeneralCategory=Separator}</td>
    </tr>
    <tr>
      <td>\p{P}</td>
      <td>\p{gc=P}</td>
      <td>\p{GeneralCategory=Punctuation}</td>
    </tr>
    <tr>
      <td>\p{S}</td>
      <td>\p{gc=S}</td>
      <td>\p{GeneralCategory=Symbol}</td>
    </tr>
    <tr>
      <td colspan="3"><font size="1">&nbsp;</font></td>
    </tr>
    <tr>
      <td>\p{Lu}</td>
      <td>\p{gc=Lu}</td>
      <td>\p{GeneralCategory=UppercaseLetter}</td>
    </tr>
    <tr>
      <td>\p{Ll}</td>
      <td>\p{gc=Ll}</td>
      <td>\p{GeneralCategory=LowercaseLetter}</td>
    </tr>
    <tr>
      <td>\p{Lt}</td>
      <td>\p{gc=Lt}</td>
      <td>\p{GeneralCategory=TitlecaseLetter}</td>
    </tr>
    <tr>
      <td>\p{Lm}</td>
      <td>\p{gc=Lm}</td>
      <td>\p{GeneralCategory=ModifierLetter}</td>
    </tr>
    <tr>
      <td>\p{Lo}</td>
      <td>\p{gc=Lo}</td>
      <td>\p{GeneralCategory=OtherLetter}</td>
    </tr>
    <tr>
      <td>\p{Mn}</td>
      <td>\p{gc=Mn}</td>
      <td>\p{GeneralCategory=NonspacingMark}</td>
    </tr>
    <tr>
      <td>\p{Me}</td>
      <td>\p{gc=Me}</td>
      <td>\p{GeneralCategory=EnclosingMark}</td>
    </tr>
    <tr>
      <td>\p{Mc}</td>
      <td>\p{gc=Mc}</td>
      <td>\p{GeneralCategory=SpacingMark}</td>
    </tr>
    <tr>
      <td>\p{Nd}</td>
      <td>\p{gc=Nd}</td>
      <td>\p{GeneralCategory=DecimalNumber}</td>
    </tr>
    <tr>
      <td>\p{Nl}</td>
      <td>\p{gc=Nl}</td>
      <td>\p{GeneralCategory=LetterNumber}</td>
    </tr>
    <tr>
      <td>\p{No}</td>
      <td>\p{gc=No}</td>
      <td>\p{GeneralCategory=OtherNumber}</td>
    </tr>
    <tr>
      <td>\p{Zs}</td>
      <td>\p{gc=Zs}</td>
      <td>\p{GeneralCategory=SpaceSeparator}</td>
    </tr>
    <tr>
      <td>\p{Zl}</td>
      <td>\p{gc=Zl}</td>
      <td>\p{GeneralCategory=LineSeparator}</td>
    </tr>
    <tr>
      <td>\p{Zp}</td>
      <td>\p{gc=Zp}</td>
      <td>\p{GeneralCategory=ParagraphSeparator}</td>
    </tr>
    <tr>
      <td>\p{Pd}</td>
      <td>\p{gc=Pd}</td>
      <td>\p{GeneralCategory=DashPunctuation}</td>
    </tr>
    <tr>
      <td>\p{Ps}</td>
      <td>\p{gc=Ps}</td>
      <td>\p{GeneralCategory=OpenPunctuation}</td>
    </tr>
    <tr>
      <td>\p{Pi}</td>
      <td>\p{gc=Pi}</td>
      <td>\p{GeneralCategory=InitialPunctuation}</td>
    </tr>
    <tr>
      <td>\p{Pe}</td>
      <td>\p{gc=Pe}</td>
      <td>\p{GeneralCategory=ClosePunctuation}</td>
    </tr>
    <tr>
      <td>\p{Pf}</td>
      <td>\p{gc=Pf}</td>
      <td>\p{GeneralCategory=FinalPunctuation}</td>
    </tr>
    <tr>
      <td>\p{Pc}</td>
      <td>\p{gc=Pc}</td>
      <td>\p{GeneralCategory=ConnectorPunctuation}</td>
    </tr>
    <tr>
      <td>\p{Po}</td>
      <td>\p{gc=Po}</td>
      <td>\p{GeneralCategory=OtherPunctuation}</td>
    </tr>
    <tr>
      <td>\p{Sm}</td>
      <td>\p{gc=Sm}</td>
      <td>\p{GeneralCategory=MathSymbol}</td>
    </tr>
    <tr>
      <td>\p{Sc}</td>
      <td>\p{gc=Sc}</td>
      <td>\p{GeneralCategory=CurrencySymbol}</td>
    </tr>
    <tr>
      <td>\p{Sk}</td>
      <td>\p{gc=Sk}</td>
      <td>\p{GeneralCategory=ModifierSymbol}</td>
    </tr>
    <tr>
      <td>\p{So}</td>
      <td>\p{gc=So}</td>
      <td>\p{GeneralCategory=OtherSymbol}</td>
    </tr>
    <tr>
      <td>\p{Cc}</td>
      <td>\p{gc=Cc}</td>
      <td>\p{GeneralCategory=Control}</td>
    </tr>
    <tr>
      <td>\p{Cf}</td>
      <td>\p{gc=Cf}</td>
      <td>\p{GeneralCategory=Format}</td>
    </tr>
    <tr>
      <td>\p{Co}</td>
      <td>\p{gc=Co}</td>
      <td>\p{GeneralCategory=PrivateUse}</td>
    </tr>
    <tr>
      <td>\p{Cs}</td>
      <td>\p{gc=Cs}</td>
      <td>\p{GeneralCategory=Surrogate}</td>
    </tr>
    <tr>
      <td>\p{Cn}</td>
      <td>\p{gc=Cn}</td>
      <td>\p{GeneralCategory=Unassigned}</td>
    </tr>
  </table>
  <br>
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th colspan="2" bgcolor="#FFFF00">Combining Class</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{cc=99}</td>
      <td>\p{CombiningClass=99}</td>
    </tr>
    <tr>
      <td>\p{cc=rn}</td>
      <td>\p{CombiningClass=NotReordered}</td>
    </tr>
    <tr>
      <td>\p{cc=ov}</td>
      <td>\p{CombiningClass=Overlay}</td>
    </tr>
    <tr>
      <td>\p{cc=nu}</td>
      <td>\p{CombiningClass=Nukta}</td>
    </tr>
    <tr>
      <td>\p{cc=kv}</td>
      <td>\p{CombiningClass=KanaVoicing}</td>
    </tr>
    <tr>
      <td>\p{cc=vi}</td>
      <td>\p{CombiningClass=Virama}</td>
    </tr>
    <tr>
      <td>\p{cc=abl}</td>
      <td>\p{CombiningClass=AttachedBelowLeft}</td>
    </tr>
    <tr>
      <td>\p{cc=aar}</td>
      <td>\p{CombiningClass=AttachedAboveRight}</td>
    </tr>
    <tr>
      <td>\p{cc=bl}</td>
      <td>\p{CombiningClass=BelowLeft}</td>
    </tr>
    <tr>
      <td>\p{cc=b}</td>
      <td>\p{CombiningClass=Below}</td>
    </tr>
    <tr>
      <td>\p{cc=br}</td>
      <td>\p{CombiningClass=BelowRight}</td>
    </tr>
    <tr>
      <td>\p{cc=l}</td>
      <td>\p{CombiningClass=Left}</td>
    </tr>
    <tr>
      <td>\p{cc=r}</td>
      <td>\p{CombiningClass=Right}</td>
    </tr>
    <tr>
      <td>\p{cc=al}</td>
      <td>\p{CombiningClass=AboveLeft}</td>
    </tr>
    <tr>
      <td>\p{cc=a}</td>
      <td>\p{CombiningClass=Above}</td>
    </tr>
    <tr>
      <td>\p{cc=ar}</td>
      <td>\p{CombiningClass=AboveRight}</td>
    </tr>
    <tr>
      <td>\p{cc=db}</td>
      <td>\p{CombiningClass=DoubleBelow}</td>
    </tr>
    <tr>
      <td>\p{cc=da}</td>
      <td>\p{CombiningClass=DoubleAbove}</td>
    </tr>
    <tr>
      <td>\p{cc=is}</td>
      <td>\p{CombiningClass=IotaSubscript}</td>
    </tr>
  </table>
  <br>
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th colspan="2" bgcolor="#FFFF00">Bidi Class</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{bc=L}</td>
      <td>\p{BidiClass=LeftToRight}</td>
    </tr>
    <tr>
      <td>\p{bc=R}</td>
      <td>\p{BidiClass=RightToLeft}</td>
    </tr>
    <tr>
      <td>\p{bc=AL}</td>
      <td>\p{BidiClass=ArabicLetter}</td>
    </tr>
    <tr>
      <td>\p{bc=EN}</td>
      <td>\p{BidiClass=EuropeanNumber}</td>
    </tr>
    <tr>
      <td>\p{bc=ES}</td>
      <td>\p{BidiClass=EuropeanSeparator}</td>
    </tr>
    <tr>
      <td>\p{bc=ET}</td>
      <td>\p{BidiClass=EuropeanTerminator}</td>
    </tr>
    <tr>
      <td>\p{bc=AN}</td>
      <td>\p{BidiClass=ArabicNumber}</td>
    </tr>
    <tr>
      <td>\p{bc=CS}</td>
      <td>\p{BidiClass=CommonSeparator}</td>
    </tr>
    <tr>
      <td>\p{bc=B}</td>
      <td>\p{BidiClass=ParagraphSeparator}</td>
    </tr>
    <tr>
      <td>\p{bc=S}</td>
      <td>\p{BidiClass=SegmentSeparator}</td>
    </tr>
    <tr>
      <td>\p{bc=WS}</td>
      <td>\p{BidiClass=WhiteSpace}</td>
    </tr>
    <tr>
      <td>\p{bc=ON}</td>
      <td>\p{BidiClass=OtherNeutral}</td>
    </tr>
    <tr>
      <td>\p{bc=BN}</td>
      <td>\p{BidiClass=BoundaryNeutral}</td>
    </tr>
    <tr>
      <td>\p{bc=NSM}</td>
      <td>\p{BidiClass=NonspacingMark}</td>
    </tr>
    <tr>
      <td>\p{bc=LRO}</td>
      <td>\p{BidiClass=LeftToRightOverride}</td>
    </tr>
    <tr>
      <td>\p{bc=RLO}</td>
      <td>\p{BidiClass=RightToLeftOverride}</td>
    </tr>
    <tr>
      <td>\p{bc=LRE}</td>
      <td>\p{BidiClass=LeftToRightEmbedding}</td>
    </tr>
    <tr>
      <td>\p{bc=RLE}</td>
      <td>\p{BidiClass=RightToLeftEmbedding}</td>
    </tr>
    <tr>
      <td>\p{bc=PDF}</td>
      <td>\p{BidiClass=PopDirectionalFormat}</td>
    </tr>
  </table>
  <br>
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th colspan="2" bgcolor="#FFFF00">Decomposition Type</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{dt=no}</td>
      <td>\p{DecompositionType=none}</td>
    </tr>
    <tr>
      <td>\p{dt=ca}</td>
      <td>\p{DecompositionType=canonical}</td>
    </tr>
    <tr>
      <td>\p{dt=co}</td>
      <td>\p{DecompositionType=compat}</td>
    </tr>
    <tr>
      <td>\p{dt=fo}</td>
      <td>\p{DecompositionType=font}</td>
    </tr>
    <tr>
      <td>\p{dt=nb}</td>
      <td>\p{DecompositionType=noBreak}</td>
    </tr>
    <tr>
      <td>\p{dt=in}</td>
      <td>\p{DecompositionType=initial}</td>
    </tr>
    <tr>
      <td>\p{dt=me}</td>
      <td>\p{DecompositionType=medial}</td>
    </tr>
    <tr>
      <td>\p{dt=fi}</td>
      <td>\p{DecompositionType=final}</td>
    </tr>
    <tr>
      <td>\p{dt=is}</td>
      <td>\p{DecompositionType=isolated}</td>
    </tr>
    <tr>
      <td>\p{dt=ci}</td>
      <td>\p{DecompositionType=circle}</td>
    </tr>
    <tr>
      <td>\p{dt=sp}</td>
      <td>\p{DecompositionType=super}</td>
    </tr>
    <tr>
      <td>\p{dt=sb}</td>
      <td>\p{DecompositionType=sub}</td>
    </tr>
    <tr>
      <td>\p{dt=ve}</td>
      <td>\p{DecompositionType=vertical}</td>
    </tr>
    <tr>
      <td>\p{dt=wi}</td>
      <td>\p{DecompositionType=wide}</td>
    </tr>
    <tr>
      <td>\p{dt=na}</td>
      <td>\p{DecompositionType=narrow}</td>
    </tr>
    <tr>
      <td>\p{dt=sm}</td>
      <td>\p{DecompositionType=small}</td>
    </tr>
    <tr>
      <td>\p{dt=sq}</td>
      <td>\p{DecompositionType=square}</td>
    </tr>
    <tr>
      <td>\p{dt=fr}</td>
      <td>\p{DecompositionType=fraction}</td>
    </tr>
  </table>
  <br>
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th colspan="2" bgcolor="#FFFF00">Numeric Value</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{nv=1.5}</td>
      <td>\p{NumericValue=14.0}</td>
    </tr>
  </table>
  <br>
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th colspan="2" bgcolor="#FFFF00">Numeric Type</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{nt=no}</td>
      <td>\p{NumericType=none}</td>
    </tr>
    <tr>
      <td>\p{nt=nu}</td>
      <td>\p{NumericType=numeric}</td>
    </tr>
    <tr>
      <td>\p{nt=di}</td>
      <td>\p{NumericType=digit}</td>
    </tr>
    <tr>
      <td>\p{nt=de}</td>
      <td>\p{NumericType=decimal}</td>
    </tr>
  </table>
  <br>
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th colspan="2" bgcolor="#FFFF00">East Asian Width</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{ea=N}</td>
      <td>\p{EastAsianWidth=Neutral}</td>
    </tr>
    <tr>
      <td>\p{ea=A}</td>
      <td>\p{EastAsianWidth=Ambiguous}</td>
    </tr>
    <tr>
      <td>\p{ea=H}</td>
      <td>\p{EastAsianWidth=Halfwidth}</td>
    </tr>
    <tr>
      <td>\p{ea=W}</td>
      <td>\p{EastAsianWidth=Wide}</td>
    </tr>
    <tr>
      <td>\p{ea=F}</td>
      <td>\p{EastAsianWidth=Fullwidth}</td>
    </tr>
    <tr>
      <td>\p{ea=Na}</td>
      <td>\p{EastAsianWidth=Narrow}</td>
    </tr>
  </table>
  <br>
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th colspan="2" bgcolor="#FFFF00">Line Break</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{lb=OP}</td>
      <td>\p{LineBreak=OpenPunctuation}</td>
    </tr>
    <tr>
      <td>\p{lb=CL}</td>
      <td>\p{LineBreak=ClosePunctuation}</td>
    </tr>
    <tr>
      <td>\p{lb=QU}</td>
      <td>\p{LineBreak=Quotation}</td>
    </tr>
    <tr>
      <td>\p{lb=GL}</td>
      <td>\p{LineBreak=Glue}</td>
    </tr>
    <tr>
      <td>\p{lb=NS}</td>
      <td>\p{LineBreak=Nonstarter}</td>
    </tr>
    <tr>
      <td>\p{lb=EX}</td>
      <td>\p{LineBreak=Exclamation}</td>
    </tr>
    <tr>
      <td>\p{lb=SY}</td>
      <td>\p{LineBreak=BreakSymbols}</td>
    </tr>
    <tr>
      <td>\p{lb=IS}</td>
      <td>\p{LineBreak=InfixNumeric}</td>
    </tr>
    <tr>
      <td>\p{lb=PR}</td>
      <td>\p{LineBreak=PrefixNumeric}</td>
    </tr>
    <tr>
      <td>\p{lb=PO}</td>
      <td>\p{LineBreak=PostfixNumeric}</td>
    </tr>
    <tr>
      <td>\p{lb=NU}</td>
      <td>\p{LineBreak=Numeric}</td>
    </tr>
    <tr>
      <td>\p{lb=AL}</td>
      <td>\p{LineBreak=Alphabetic}</td>
    </tr>
    <tr>
      <td>\p{lb=ID}</td>
      <td>\p{LineBreak=Ideographic}</td>
    </tr>
    <tr>
      <td>\p{lb=IN}</td>
      <td>\p{LineBreak=Inseperable}</td>
    </tr>
    <tr>
      <td>\p{lb=HY}</td>
      <td>\p{LineBreak=Hyphen}</td>
    </tr>
    <tr>
      <td>\p{lb=CM}</td>
      <td>\p{LineBreak=CombiningMark}</td>
    </tr>
    <tr>
      <td>\p{lb=BB}</td>
      <td>\p{LineBreak=BreakBefore}</td>
    </tr>
    <tr>
      <td>\p{lb=BA}</td>
      <td>\p{LineBreak=BreakAfter}</td>
    </tr>
    <tr>
      <td>\p{lb=B2}</td>
      <td>\p{LineBreak=BreakBeforeAndAfter}</td>
    </tr>
    <tr>
      <td>\p{lb=SP}</td>
      <td>\p{LineBreak=Space}</td>
    </tr>
    <tr>
      <td>\p{lb=BK}</td>
      <td>\p{LineBreak=MandatoryBreak}</td>
    </tr>
    <tr>
      <td>\p{lb=CR}</td>
      <td>\p{LineBreak=CarriageReturn}</td>
    </tr>
    <tr>
      <td>\p{lb=LF}</td>
      <td>\p{LineBreak=LineFeed}</td>
    </tr>
    <tr>
      <td>\p{lb=CB}</td>
      <td>\p{LineBreak=ContingentBreak}</td>
    </tr>
    <tr>
      <td>\p{lb=SA}</td>
      <td>\p{LineBreak=ComplexContext}</td>
    </tr>
    <tr>
      <td>\p{lb=AI}</td>
      <td>\p{LineBreak=Ambiguous}</td>
    </tr>
    <tr>
      <td>\p{lb=SG}</td>
      <td>\p{LineBreak=Surrogate}</td>
    </tr>
    <tr>
      <td>\p{lb=ZW}</td>
      <td>\p{LineBreak=ZWSpace}</td>
    </tr>
    <tr>
      <td>\p{lb=XX}</td>
      <td>\p{LineBreak=Unknown}</td>
    </tr>
  </table>
  <br>
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th colspan="2" bgcolor="#FFFF00">Joining Type</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{jt=C}</td>
      <td>\p{JoiningType=JoinCausing}</td>
    </tr>
    <tr>
      <td>\p{jt=D}</td>
      <td>\p{JoiningType=DualJoining}</td>
    </tr>
    <tr>
      <td>\p{jt=R}</td>
      <td>\p{JoiningType=RightJoining}</td>
    </tr>
    <tr>
      <td>\p{jt=U}</td>
      <td>\p{JoiningType=NonJoining}</td>
    </tr>
    <tr>
      <td>\p{jt=L}</td>
      <td>\p{JoiningType=LeftJoining}</td>
    </tr>
    <tr>
      <td>\p{jt=T}</td>
      <td>\p{JoiningType=Transparent}</td>
    </tr>
  </table>
  <br>
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th colspan="3" bgcolor="#FFFF00">Script</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Short</th>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{Zyyy}</td>
      <td>\p{sc=Zyyy}</td>
      <td>\p{Script=COMMON}</td>
    </tr>
    <tr>
      <td>\p{Latn}</td>
      <td>\p{sc=Latn}</td>
      <td>\p{Script=LATIN}</td>
    </tr>
    <tr>
      <td>\p{Grek}</td>
      <td>\p{sc=Grek}</td>
      <td>\p{Script=GREEK}</td>
    </tr>
    <tr>
      <td>\p{Cyrl}</td>
      <td>\p{sc=Cyrl}</td>
      <td>\p{Script=CYRILLIC}</td>
    </tr>
    <tr>
      <td>\p{Armn}</td>
      <td>\p{sc=Armn}</td>
      <td>\p{Script=ARMENIAN}</td>
    </tr>
    <tr>
      <td>\p{Hebr}</td>
      <td>\p{sc=Hebr}</td>
      <td>\p{Script=HEBREW}</td>
    </tr>
    <tr>
      <td>\p{Arab}</td>
      <td>\p{sc=Arab}</td>
      <td>\p{Script=ARABIC}</td>
    </tr>
    <tr>
      <td>\p{Syrc}</td>
      <td>\p{sc=Syrc}</td>
      <td>\p{Script=SYRIAC}</td>
    </tr>
    <tr>
      <td>\p{Thaa}</td>
      <td>\p{sc=Thaa}</td>
      <td>\p{Script=THAANA}</td>
    </tr>
    <tr>
      <td>\p{Deva}</td>
      <td>\p{sc=Deva}</td>
      <td>\p{Script=DEVANAGARI}</td>
    </tr>
    <tr>
      <td>\p{Beng}</td>
      <td>\p{sc=Beng}</td>
      <td>\p{Script=BENGALI}</td>
    </tr>
    <tr>
      <td>\p{Guru}</td>
      <td>\p{sc=Guru}</td>
      <td>\p{Script=GURMUKHI}</td>
    </tr>
    <tr>
      <td>\p{Gujr}</td>
      <td>\p{sc=Gujr}</td>
      <td>\p{Script=GUJARATI}</td>
    </tr>
    <tr>
      <td>\p{Orya}</td>
      <td>\p{sc=Orya}</td>
      <td>\p{Script=ORIYA}</td>
    </tr>
    <tr>
      <td>\p{Taml}</td>
      <td>\p{sc=Taml}</td>
      <td>\p{Script=TAMIL}</td>
    </tr>
    <tr>
      <td>\p{Telu}</td>
      <td>\p{sc=Telu}</td>
      <td>\p{Script=TELUGU}</td>
    </tr>
    <tr>
      <td>\p{Knda}</td>
      <td>\p{sc=Knda}</td>
      <td>\p{Script=KANNADA}</td>
    </tr>
    <tr>
      <td>\p{Mlym}</td>
      <td>\p{sc=Mlym}</td>
      <td>\p{Script=MALAYALAM}</td>
    </tr>
    <tr>
      <td>\p{Sinh}</td>
      <td>\p{sc=Sinh}</td>
      <td>\p{Script=SINHALA}</td>
    </tr>
    <tr>
      <td>\p{Thai}</td>
      <td>\p{sc=Thai}</td>
      <td>\p{Script=THAI}</td>
    </tr>
    <tr>
      <td>\p{Laoo}</td>
      <td>\p{sc=Laoo}</td>
      <td>\p{Script=LAO}</td>
    </tr>
    <tr>
      <td>\p{Tibt}</td>
      <td>\p{sc=Tibt}</td>
      <td>\p{Script=TIBETAN}</td>
    </tr>
    <tr>
      <td>\p{Mymr}</td>
      <td>\p{sc=Mymr}</td>
      <td>\p{Script=MYANMAR}</td>
    </tr>
    <tr>
      <td>\p{Geor}</td>
      <td>\p{sc=Geor}</td>
      <td>\p{Script=GEORGIAN}</td>
    </tr>
    <tr>
      <td>\p{Hang}</td>
      <td>\p{sc=Hang}</td>
      <td>\p{Script=HANGUL}</td>
    </tr>
    <tr>
      <td>\p{Ethi}</td>
      <td>\p{sc=Ethi}</td>
      <td>\p{Script=ETHIOPIC}</td>
    </tr>
    <tr>
      <td>\p{Cher}</td>
      <td>\p{sc=Cher}</td>
      <td>\p{Script=CHEROKEE}</td>
    </tr>
    <tr>
      <td>\p{Cans}</td>
      <td>\p{sc=Cans}</td>
      <td>\p{Script=CANADIAN-ABORIGINAL}</td>
    </tr>
    <tr>
      <td>\p{Ogam}</td>
      <td>\p{sc=Ogam}</td>
      <td>\p{Script=OGHAM}</td>
    </tr>
    <tr>
      <td>\p{Runr}</td>
      <td>\p{sc=Runr}</td>
      <td>\p{Script=RUNIC}</td>
    </tr>
    <tr>
      <td>\p{Khmr}</td>
      <td>\p{sc=Khmr}</td>
      <td>\p{Script=KHMER}</td>
    </tr>
    <tr>
      <td>\p{Mong}</td>
      <td>\p{sc=Mong}</td>
      <td>\p{Script=MONGOLIAN}</td>
    </tr>
    <tr>
      <td>\p{Hira}</td>
      <td>\p{sc=Hira}</td>
      <td>\p{Script=HIRAGANA}</td>
    </tr>
    <tr>
      <td>\p{Kana}</td>
      <td>\p{sc=Kana}</td>
      <td>\p{Script=KATAKANA}</td>
    </tr>
    <tr>
      <td>\p{Bopo}</td>
      <td>\p{sc=Bopo}</td>
      <td>\p{Script=BOPOMOFO}</td>
    </tr>
    <tr>
      <td>\p{Hani}</td>
      <td>\p{sc=Hani}</td>
      <td>\p{Script=HAN}</td>
    </tr>
    <tr>
      <td>\p{Yiii}</td>
      <td>\p{sc=Yiii}</td>
      <td>\p{Script=YI}</td>
    </tr>
    <tr>
      <td>\p{Ital}</td>
      <td>\p{sc=Ital}</td>
      <td>\p{Script=OLD-ITALIC}</td>
    </tr>
    <tr>
      <td>\p{Goth}</td>
      <td>\p{sc=Goth}</td>
      <td>\p{Script=GOTHIC}</td>
    </tr>
    <tr>
      <td>\p{Dsrt}</td>
      <td>\p{sc=Dsrt}</td>
      <td>\p{Script=DESERET}</td>
    </tr>
    <tr>
      <td>\p{Qaai}</td>
      <td>\p{sc=Qaai}</td>
      <td>\p{Script=INHERITED}</td>
    </tr>
  </table>
  <br>
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th bgcolor="#FFFF00" colspan="3">Extended Properties (Binary)</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Short</th>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{BidiM}</td>
      <td>\p{BidiM=T}</td>
      <td>\p{BidiMirrored=True}</td>
    </tr>
    <tr>
      <td>\p{CExc}</td>
      <td>\p{CExc=T}</td>
      <td>\p{CompositionExclusion=True}</td>
    </tr>
    <tr>
      <td>\p{WhSp}</td>
      <td>\p{WhSp=T}</td>
      <td>\p{WhiteSpace=True}</td>
    </tr>
    <tr>
      <td>\p{NBrk}</td>
      <td>\p{NBrk=T}</td>
      <td>\p{NonBreak=True}</td>
    </tr>
    <tr>
      <td>\p{BdCon}</td>
      <td>\p{BdCon=T}</td>
      <td>\p{BidiControl=True}</td>
    </tr>
    <tr>
      <td>\p{JCon}</td>
      <td>\p{JCon=T}</td>
      <td>\p{JoinControl=True}</td>
    </tr>
    <tr>
      <td>\p{Dash}</td>
      <td>\p{Dash=T}</td>
      <td>\p{Dash=True}</td>
    </tr>
    <tr>
      <td>\p{Hyph}</td>
      <td>\p{Hyph=T}</td>
      <td>\p{Hyphen=True}</td>
    </tr>
    <tr>
      <td>\p{QMark}</td>
      <td>\p{QMark=T}</td>
      <td>\p{QuotationMark=True}</td>
    </tr>
    <tr>
      <td>\p{TPunc}</td>
      <td>\p{TPunc=T}</td>
      <td>\p{TerminalPunctuation=True}</td>
    </tr>
    <tr>
      <td>\p{OMath}</td>
      <td>\p{OMath=T}</td>
      <td>\p{OtherMath=True}</td>
    </tr>
    <tr>
      <td>\p{HexD}</td>
      <td>\p{HexD=T}</td>
      <td>\p{HexDigit=True}</td>
    </tr>
    <tr>
      <td>\p{OAlph}</td>
      <td>\p{OAlph=T}</td>
      <td>\p{OtherAlphabetic=True}</td>
    </tr>
    <tr>
      <td>\p{Ideo}</td>
      <td>\p{Ideo=T}</td>
      <td>\p{Ideographic=True}</td>
    </tr>
    <tr>
      <td>\p{Diac}</td>
      <td>\p{Diac=T}</td>
      <td>\p{Diacritic=True}</td>
    </tr>
    <tr>
      <td>\p{Ext}</td>
      <td>\p{Ext=T}</td>
      <td>\p{Extender=True}</td>
    </tr>
    <tr>
      <td>\p{OLoc}</td>
      <td>\p{OLoc=T}</td>
      <td>\p{OtherLowercase=True}</td>
    </tr>
    <tr>
      <td>\p{OUpc}</td>
      <td>\p{OUpc=T}</td>
      <td>\p{OtherUppercase=True}</td>
    </tr>
    <tr>
      <td>\p{NChar}</td>
      <td>\p{NChar=T}</td>
      <td>\p{NoncharacterCodePoint=True}</td>
    </tr>
    <tr>
      <td>\p{AHexD}</td>
      <td>\p{AHexD=T}</td>
      <td>\p{ASCIIHexDigit=True}</td>
    </tr>
  </table>
  <br>
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th bgcolor="#FFFF00" colspan="3">Derived Core Properties (Binary)</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Short</th>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{Math}</td>
      <td>\p{Math=T}</td>
      <td>\p{Math=True}</td>
    </tr>
    <tr>
      <td>\p{Alph}</td>
      <td>\p{Alph=T}</td>
      <td>\p{Alphabetic=True}</td>
    </tr>
    <tr>
      <td>\p{Loc}</td>
      <td>\p{Loc=T}</td>
      <td>\p{Lowercase=True}</td>
    </tr>
    <tr>
      <td>\p{Upc}</td>
      <td>\p{Upc=T}</td>
      <td>\p{Uppercase=True}</td>
    </tr>
    <tr>
      <td>\p{IDS}</td>
      <td>\p{IDS=T}</td>
      <td>\p{IDStart=True}</td>
    </tr>
    <tr>
      <td>\p{IDC}</td>
      <td>\p{IDC=T}</td>
      <td>\p{IDContinue=True}</td>
    </tr>
    <tr>
      <td>\p{XIDS}</td>
      <td>\p{XIDS=T}</td>
      <td>\p{XIDStart=True}</td>
    </tr>
    <tr>
      <td>\p{XIDC}</td>
      <td>\p{XIDC=T}</td>
      <td>\p{XIDContinue=True}</td>
    </tr>
  </table>
  &nbsp;
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th bgcolor="#FFFF00" colspan="2">Derived Normalization Properties (Non
        Binary)</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{NFCP=N}</td>
      <td>\p{NFCPermitted=NO}</td>
    </tr>
    <tr>
      <td>\p{NFCP=M}</td>
      <td>\p{NFCPermitted=MAYBE}</td>
    </tr>
    <tr>
      <td>\p{NFCP=Y}</td>
      <td>\p{NFCPermitted=YES}</td>
    </tr>
    <tr>
      <td>\p{NFKCP=N}</td>
      <td>\p{NFKCPermitted=NO}</td>
    </tr>
    <tr>
      <td>\p{NFKCP=M}</td>
      <td>\p{NFKCPermitted=MAYBE}</td>
    </tr>
    <tr>
      <td>\p{NFKCP=Y}</td>
      <td>\p{NFKCPermitted=YES}</td>
    </tr>
  </table>
  &nbsp;
  <table border="1" cellspacing="0" cellpadding="4">
    <tr>
      <th bgcolor="#FFFF00" colspan="3">Derived Normalization Properties
        (Binary)</th>
    </tr>
    <tr>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Medium</th>
      <th style="background-color: #FFFF00">Long</th>
    </tr>
    <tr>
      <td>\p{NFDP}</td>
      <td>\p{NFDP=T}</td>
      <td>\p{NFDPermitted=True}</td>
    </tr>
    <tr>
      <td>\p{NFKDP}</td>
      <td>\p{NFKDP=T}</td>
      <td>\p{NFKDPermitted=True}</td>
    </tr>
    <tr>
      <td>\p{FNC}</td>
      <td>\p{FNC=T}</td>
      <td>\p{FNC=True}</td>
    </tr>
    <tr>
      <td>\p{CompEx}</td>
      <td>\p{CompEx=T}</td>
      <td>\p{CompEx=True}</td>
    </tr>
    <tr>
      <td>\p{NFCX}</td>
      <td>\p{NFCX=T}</td>
      <td>\p{NFCExpands=True}</td>
    </tr>
    <tr>
      <td>\p{NFKCX}</td>
      <td>\p{NFKCX=T}</td>
      <td>\p{NFKCExpands=True}</td>
    </tr>
    <tr>
      <td>\p{NFDX}</td>
      <td>\p{NFDX=T}</td>
      <td>\p{NFDExpands=True}</td>
    </tr>
    <tr>
      <td>\p{NFKDX}</td>
      <td>\p{NFKDX=T}</td>
      <td>\p{NFKDExpands=True}</td>
    </tr>
    <tr>
      <td>\p{NFCX}</td>
      <td>\p{NFCX=T}</td>
      <td>\p{NFCExpands=True}</td>
    </tr>
  </table>
  </center>
</div>
<hr>
<h2><a name="Omitted_Properties">Omitted Properties</a></h2>
<p>The properties Block, JamoName, and JoiningGroup are omitted, since they are
not generally useful. (The Block property is actually pernicious.)</p>
<p>The String properties are also omitted. If included, they would look
something like:</p>
<ul>
  <li><code>\p{Name='LATIN LETTER A'}</code>
    <ul>
      <li>note the quotes to preserve spaces</li>
    </ul>
  </li>
  <li><code>\p{NFC=Å}</code>
    <ul>
      <li>similarly, NFD, NFKD, NFKC</li>
    </ul>
  </li>
  <li><code>\p{SimpleUppercase=Å}</code>
    <ul>
      <li>similarly, SimpleLowercase, SimpleTitlecase, SimpleCaseFolding</li>
    </ul>
  </li>
  <li><code>\p{FullUppercase=Å}</code>
    <ul>
      <li>similarly, FullLowercase, FullTitlecase, FullCaseFolding</li>
    </ul>
  </li>
  <li><code>\p{SpecialCasing=&quot;tr&quot;}</code></li>
  <li><code>\p{BidiMirror=')'}</code></li>
</ul>
<h2><a name="Possible_Implementation">Possible Implementation</a> (rough so far)</h2>
<p><i>(Java style API: ICU C++ would be analogous)</i></p>
<p>Add a function and interface to Character:</p>
<blockquote>
  <pre>public void addToSet(String typeName, String valueName, UnicodeSet set);</pre>
</blockquote>
<p>The addToSet function will internally iterate over all codepoints, adding the
ones that match the criterion. Since it can work with the internal data
structures for the properties, it can do this more efficiently.</p>
<p>If the valueName is empty or null, then two different strategies are used. If
the typeName is valid, then the value is set to TRUE. Otherwise the typeName is
invalid, so the code will try using &quot;gc&quot; as the typeName and the
former typeName as the valueName to see those are valid. If that fails, it will
try &quot;sc&quot;. If that fails, an error</p>
<p>Internally, we will use a simple implementation. All of the typeNames and
valueNames will be added to two hashtables that maps them to integers. (We might
make this one hashtable, and enforce that no string can be both a typeName and
valueName). A value integer will contain the real value, plus some bits that
tell which type it is valid for. Those validity bits are used to check
consistency. The type integer will be used to select a property, and the
internal iteration will pick up all code points that match the value. For cases
where the same valueName has two different values for two different properties,
we'll just use a little special-case code to remap the value if necessary when
we call all but the first property. Where the value is numeric, we'll detect
that based on the typeName, and parse for a double.</p>

</body>

</html>