Novel Aspects of IEEE SA P3109 Arithmetic Formats for Machine Learning
Summary
The IEEE P3109 draft standard defines a parameterized family of binary floating-point formats and operations tailored for machine learning, supporting configurable width, precision, signedness, and infinities, along with extensive rounding modes including stochastic rounding and a novel scale-invariant approximation measure called kappa-approximation.
View Cached Full Text
Cached at: 06/05/26, 02:17 AM
# Novel Aspects of IEEE SA P3109 Arithmetic Formats for Machine Learning Source: [https://arxiv.org/abs/2606.04028](https://arxiv.org/abs/2606.04028) [View PDF](https://arxiv.org/pdf/2606.04028) > Abstract:The IEEE P3109 draft standard defines a parameterized family of binary floating\-point formats and associated operations, with a focus on facilitating machine learning\. These formats allow efficient and consistent representation of values in a small number of bits\. The defined formats are parameterized over width and precision in bits, signedness, and the presence of infinities\. Operations are defined by decoding floating\-point values to the set of closed extended reals: the reals augmented with positive and negative infinity and NaN \(Not a Number\)\. Explicit treatment of NaN and infinite operands ensures that only real arithmetic is invoked in operation definitions\. Extensive rounding and saturation modes are defined; stochastic rounding is included\. Operations are exception\-free, accelerating throughput, with exceptional situations communicated through return values, e\.g\., NaN\. Operations on blocks of values sharing a common scale factor are defined in terms of the underlying operations in a uniform manner\. System vendors may describe approximate implementations via a novel scale\-invariant measure, akin to units in the last place, called kappa\-approximation\. Standard function definitions and various other properties are mechanically verified and generated using formal specifications\. ## Submission history From: Christoph M\. Wintersteiger \[[view email](https://arxiv.org/show-email/110d6528/2606.04028)\] **\[v1\]**Mon, 1 Jun 2026 19:27:39 UTC \(24 KB\)
Similar Articles
More Floating Point Alternatives
This article explains various software-based alternatives to floating-point arithmetic, including decimal floating point, fractions, symbolic computation, interval arithmetic, and binary-coded decimal.
Float and integer arithmetic follow two different paradigms
博客文章指出整数与浮点算术遵循不同范式:整数运算需在灾难发生前预防溢出,而 IEEE-754 浮点运算中的 NaN 与无穷值会自然传播,不应照搬预防式检查(如用零分母或 FLT_EPSILON 守卫),这些检查在多数场景下无效且被 LLM 频繁写错。
@jino_rohit: before you start learning quantization for llms, you need to understand how different number formats are represented in…
A thread explaining why understanding number formats in memory is crucial for learning LLM quantization, covering gradient NaN debugging, numerical stability, and quantization distortion.
Intermediate Floating-Point Precision
This article explores how intermediate floating-point precision in C++ code depends on compiler settings, CPU flags, and architecture, particularly on x87 FPU, and how this affects performance and calculation results.
Algebraic Integer Quantization for Machine Learning Applications
本文提出代数整数量化(AIQ)作为大语言模型推理的有损压缩格式,利用代数整数可实现无误差乘加运算的特性构建矩阵乘法引擎,在等比特预算下达到与业界标准 MX 格式竞争的精度。