unicode

Branch: main

Switch branches or tags

Branch: main
Go to file t

413 files indexed

History
Code

idna/README.md

unicode-idna

Unicode IDNA processing for MoonBit, with UTS #46 and optional IDNA2008 label validation. The generated tables target Unicode 18.0.0.

moon add moonbit-community/unicode-idna

to_ascii and to_unicode support IDNA2008 label validation with UTS #46 input processing. These options enable the IDNA2008 character and ContextO checks:

  • check_idna2008=true restricts the resulting Unicode labels to the IDNA2008 PVALID, CONTEXTJ, and CONTEXTO categories. Other code points raise DisallowedCodePoint(cp~).
  • check_contexto=true independently validates the RFC 5892 ContextO rules. Violations raise InvalidContextO(cp~).

Both options default to false. They also check Unicode labels decoded from Punycode. Enable both alongside the default checks for IDNA2008 label validation. The check_joiners option checks CONTEXTJ rules and defaults to true.

let ascii = try! @idna.to_ascii(
  "ÖBB.at",
  check_idna2008=true,
  check_contexto=true,
)
// "xn--bb-eka.at"

Validation applies after UTS #46 mapping and NFC normalization. In the example, ÖBB.at is mapped to öbb.at, which passes IDNA2008 validation. Symbols such as ☕ are rejected by check_idna2008 even though UTS #46 allows them.

See the repository root README for the remaining options and examples.

1# unicode-idna23Unicode IDNA processing for MoonBit, with UTS #46 and optional IDNA2008 label4validation. The generated tables target Unicode 18.0.0.56```bash7moon add moonbit-community/unicode-idna8```910`to_ascii` and `to_unicode` support IDNA2008 label validation with UTS #46 input11processing. These options enable the IDNA2008 character and ContextO checks:1213- `check_idna2008=true` restricts the resulting Unicode labels to the IDNA200814  `PVALID`, `CONTEXTJ`, and `CONTEXTO` categories. Other code points raise15  `DisallowedCodePoint(cp~)`.16- `check_contexto=true` independently validates the RFC 5892 ContextO rules.17  Violations raise `InvalidContextO(cp~)`.1819Both options default to `false`. They also check Unicode labels decoded from20Punycode. Enable both alongside the default checks for IDNA2008 label21validation. The `check_joiners` option checks CONTEXTJ rules and defaults to22`true`.2324```moonbit25let ascii = try! @idna.to_ascii(26  "ÖBB.at",27  check_idna2008=true,28  check_contexto=true,29)30// "xn--bb-eka.at"31```3233Validation applies after UTS #46 mapping and NFC normalization. In the example,34`ÖBB.at` is mapped to `öbb.at`, which passes IDNA2008 validation. Symbols such as35`☕` are rejected by `check_idna2008` even though UTS #46 allows them.3637See the repository root README for the remaining options and examples.38