Tag
提出了 Extender，一种日志结构化的 Transformer 架构，通过增加一条拼接通道 ε 而非仅依赖残差通道 h，在 924M 参数规模下实现与 Transformer 相当的短上下文精度、更优的长上下文（RULER）表现，且持久化注意力内存足迹较多头注意力缩小 104 倍。
ZeroFS is a log-structured filesystem that serves S3-compatible buckets as POSIX filesystems over NFS and 9P, or as raw block devices, with compression, encryption, and local caching for fast reads. It passes extensive POSIX and stress test suites, including kernel builds and Jepsen failover testing.