Novel Aspects of IEEE SA P3109 Arithmetic Formats for Machine Learning

arXiv cs.LG Papers

Summary

The IEEE P3109 draft standard defines a parameterized family of binary floating-point formats and operations tailored for machine learning, supporting configurable width, precision, signedness, and infinities, along with extensive rounding modes including stochastic rounding and a novel scale-invariant approximation measure called kappa-approximation.

arXiv:2606.04028v1 Announce Type: new Abstract: The IEEE P3109 draft standard defines a parameterized family of binary floating-point formats and associated operations, with a focus on facilitating machine learning. These formats allow efficient and consistent representation of values in a small number of bits. The defined formats are parameterized over width and precision in bits, signedness, and the presence of infinities. Operations are defined by decoding floating-point values to the set of closed extended reals: the reals augmented with positive and negative infinity and NaN (Not a Number). Explicit treatment of NaN and infinite operands ensures that only real arithmetic is invoked in operation definitions. Extensive rounding and saturation modes are defined; stochastic rounding is included. Operations are exception-free, accelerating throughput, with exceptional situations communicated through return values, e.g., NaN. Operations on blocks of values sharing a common scale factor are defined in terms of the underlying operations in a uniform manner. System vendors may describe approximate implementations via a novel scale-invariant measure, akin to units in the last place, called kappa-approximation. Standard function definitions and various other properties are mechanically verified and generated using formal specifications.
Original Article
View Cached Full Text

Cached at: 06/05/26, 02:17 AM

# Novel Aspects of IEEE SA P3109 Arithmetic Formats for Machine Learning
Source: [https://arxiv.org/abs/2606.04028](https://arxiv.org/abs/2606.04028)
[View PDF](https://arxiv.org/pdf/2606.04028)

> Abstract:The IEEE P3109 draft standard defines a parameterized family of binary floating\-point formats and associated operations, with a focus on facilitating machine learning\. These formats allow efficient and consistent representation of values in a small number of bits\. The defined formats are parameterized over width and precision in bits, signedness, and the presence of infinities\. Operations are defined by decoding floating\-point values to the set of closed extended reals: the reals augmented with positive and negative infinity and NaN \(Not a Number\)\. Explicit treatment of NaN and infinite operands ensures that only real arithmetic is invoked in operation definitions\. Extensive rounding and saturation modes are defined; stochastic rounding is included\. Operations are exception\-free, accelerating throughput, with exceptional situations communicated through return values, e\.g\., NaN\. Operations on blocks of values sharing a common scale factor are defined in terms of the underlying operations in a uniform manner\. System vendors may describe approximate implementations via a novel scale\-invariant measure, akin to units in the last place, called kappa\-approximation\. Standard function definitions and various other properties are mechanically verified and generated using formal specifications\.

## Submission history

From: Christoph M\. Wintersteiger \[[view email](https://arxiv.org/show-email/110d6528/2606.04028)\] **\[v1\]**Mon, 1 Jun 2026 19:27:39 UTC \(24 KB\)

Similar Articles

More Floating Point Alternatives

Hacker News Top

This article explains various software-based alternatives to floating-point arithmetic, including decimal floating point, fractions, symbolic computation, interval arithmetic, and binary-coded decimal.

Float and integer arithmetic follow two different paradigms

Hacker News Top

博客文章指出整数与浮点算术遵循不同范式:整数运算需在灾难发生前预防溢出,而 IEEE-754 浮点运算中的 NaN 与无穷值会自然传播,不应照搬预防式检查(如用零分母或 FLT_EPSILON 守卫),这些检查在多数场景下无效且被 LLM 频繁写错。

Intermediate Floating-Point Precision

Lobsters Hottest

This article explores how intermediate floating-point precision in C++ code depends on compiler settings, CPU flags, and architecture, particularly on x87 FPU, and how this affects performance and calculation results.

Algebraic Integer Quantization for Machine Learning Applications

arXiv cs.LG

本文提出代数整数量化(AIQ)作为大语言模型推理的有损压缩格式,利用代数整数可实现无误差乘加运算的特性构建矩阵乘法引擎,在等比特预算下达到与业界标准 MX 格式竞争的精度。