Tag
This paper investigates neural circuits in a sparse 8-layer Python transformer, finding dedicated circuitry for 106 programming concepts and decomposing them into concept-specific and token-driven components, with implications for understanding structural encoding in code models.
Introduces ast-guard, an open-source AST-based security tool that prevents malicious code execution from LLM-generated Python strings by parsing them into an abstract syntax tree and applying node-level whitelisting and context-aware safety checks.
This article explores using Zig's comptime to create tagged union subsets, inspired by Mitchell Hashimoto's work, and applies the technique to a MyST parser's AST traversal.