Tag
Raymond Chen recounts how he once created a reboot.com MS-DOS program from a single command-line echo using control characters (int 19h via IBM PC code page 437), inspired by a recent post on executable emoji programs.
A blog post exploring how unusual Unicode letterlike symbols (like ℡ and №) and styled alphabets can be used in domain names, thanks to browser-side IDNA2008 normalization per RFC5895, along with its limitations in tools like dig and social platforms.
A deep-dive blog post exploring why checking for whitespace is surprisingly complex, tracing Guava's implementation to Unicode's 25-character White_Space property and comparing how Java, Python, and JavaScript disagree on which characters count as whitespace.
This paper evaluates cross-lingual fairness of edit-based homoglyph and invisible-character watermarking across 40 language varieties in 24 scripts, finding that removing tokenizers does not eliminate inequity since script, not resource level, drives 96% of capacity variation.
苹果与切罗基族等原住民社区合作,借助 Unicode 标准推进 iOS 键盘对 200 多种语言的支持,以数字方式助力濒危原住民语言的保护与复兴。
该论文提出 Adversarial Surface-Form Robustness Dataset (ASRD),用四态评估框架对五个开源大模型在 2,100 个非规范形式提示(表情符号、Leetspeak、编码封装、隐形 Unicode 等)下的安全表现进行评测,揭示了表情符号几乎不影响理解而编码类输入导致高理解失败率等规律。
A deep-dive on fixing dotted-circle ("tofu") rendering issues in Myanmar text, part of Google's Noto font effort to provide comprehensive Unicode coverage.
BSE 2024 talk recap: Jimmy Lee explains from first principles how to build a truly usable multilingual text box using the Unicode and OpenType standards, emphasizing that the mapping from characters to glyphs is an irreversible, one-way data flow.
UTF-8000 is a proposed extension to UTF-8 that allows for arbitrarily large code units while preserving UTF-8 properties, presented as a standalone project with a reference implementation.
NVIDIA announced a $12.93 billion acquisition of Hugging Face, with the first six digits of the price encoding the 🤗 emoji in decimal. This playful detail was highlighted in social media posts from Polymarket and Julien Chaumond.
The article tracks and reports on terminal emulator support for Unicode's 'Symbols for Legacy Computing' blocks, highlighting compatibility for displaying legacy graphical characters across different terminals.
The article describes the development of enhanced binary file visualization features in the 'bine' hex editor, including colorized output using Unicode characters and a method to interpret binary files as images for large-scale viewing.
The article explains how Python's str.lower() function can introduce a security vulnerability in IDNA encoding due to mismatched Unicode versions, causing non-compliance with RFC standards and leading to inconsistent domain name handling.
This article explains why the up and down white arrows in Unicode render inconsistently on macOS, detailing Unicode code points and font design issues.
The article explains the origins of 'ghost characters' in Unicode, which stemmed from cataloging errors in the 1978 JIS X 0208 standard and have since been integrated into computer systems worldwide.
A deep dive into the complexity of splitting multiline text in Python, covering the many Unicode line break characters and the historical origins of newline representations in ASCII.
GitHub engineering describes how they optimized case-folding for their code search engine by removing early-exit branches, achieving memory-speed ASCII folding, and open-sourcing the result as a Rust crate called casefold.
A developer investigates why footnote backlink glyphs render as emoji in RSS readers, explores Unicode variation selectors (U+FE0E and U+FE0F) for controlling text vs emoji presentation, and discusses the broader challenges of variation selectors for web content.
libpdjson5 is a public domain C library for parsing JSON, JSON5, and JSON5E with full Unicode support, minimal memory footprint, and a streaming API. It is a fork of pdjson with various improvements including JSON5E support.
Mojibake is a self-contained Unicode 17 library for C11/C++17, providing normalization, case conversion, and character database functions with zero dependencies.