跳到主要内容
uencoder

Understanding Surrogate Pairs

Learn 如何 UTF-16 represents characters 外部 BMP using surrogate pairs, 和为什么此 matters.

问题

单个 emoji 或罕见字符是 reported as two separate 代码 units, breaking 字符串长度和 indexing.

前置条件

  • Understanding 的 Unicode 代码 points
  • 熟悉UTF-16

步骤

  1. 1. Understand the BMP and beyond

    The Basic Multilingual Plane (U+0000 to U+FFFF) covers most common characters. Characters above U+FFFF (like emoji) cannot fit in a single 16-bit code unit and require a surrogate pair in UTF-16.

    输入
    😀 = U+1F600
    输出
    above BMP, needs surrogate pair
  2. 2. Compute the surrogate pair

    Subtract 0x10000 from the code point, giving a 20-bit value. The high 10 bits plus 0xD800 form the high surrogate. The low 10 bits plus 0xDC00 form the low surrogate. For U+1F600, the pair is D83D DE00.

    输入
    U+1F600
    输出
    high: D83D, low: DE00
  3. 3. Handle pairs in code

    When iterating or indexing strings, account for surrogate pairs. A string's .length counts code units, not characters. Use code-point-aware APIs (like String.fromCodePoint and [...str]) to avoid splitting pairs.

    输入
    '😀'.length
    输出
    2 (code units), not 1

预期结果

正确 handling 的 characters 外部 BMP, 具有否 拆分 surrogate pairs 或不正确长度 counts.

常见错误

Splitting a string at an index that falls inside a surrogate pair
Use code-point-aware iteration or check whether the code unit at the index is a low or high surrogate before splitting.
String length is double the expected character count
The string contains characters outside the BMP. Count code points, not code units, using a spread operator or iterator.

排障指引

  • If a character shows as two boxes, a surrogate pair was split. Rejoin them or use a UTF-8 representation.
  • JavaScript strings are UTF-16; use Array.from(str) or [...str] to iterate by code point.

安全限制

  • Surrogate pair bugs can cause truncation or misinterpretation of input, potentially bypassing length-based security checks.

相关工具

相关词条

参考链接