ast

This article explains how to design high-performance parsers by focusing on memory layout and data-oriented design, using the example of the Yuku JavaScript/TypeScript parser written in Zig.

kparser is a small, readable parser for the K programming language, designed as a pedagogical reference to make K's grammar legible by printing ASTs in a Lisp-style nested-list form from a REPL.

Experiment shows AST-backed context graphs for coding agents can reduce token usage by 90% compared to broad snippets, while maintaining grounding, with a hybrid approach recommended to handle narrow retrieval cases.

cocoindex-code is an AST-based semantic code search tool that can be quickly integrated into coding agents, saving up to 70% tokens and improving search efficiency.

Evan You explains why integrating React Compiler directly into OXC (Rust) offers significant performance gains over a plugin approach, while addressing binary size concerns and future plans for AST transfer.

The Reflex team optimized Python's ast.walk by 220x for their AI code generation linter by removing generator overhead, inlining functions, and implementing a Rust binding.

A new open-source tool called codebase-memory-mcp indexes entire codebases like the Linux kernel in minutes using AST knowledge graphs, achieving massive efficiency gains for AI agents with 99% token reduction and 83% answer quality.

This paper investigates neural circuits in a sparse 8-layer Python transformer, finding dedicated circuitry for 106 programming concepts and decomposing them into concept-specific and token-driven components, with implications for understanding structural encoding in code models.

Introduces ast-guard, an open-source AST-based security tool that prevents malicious code execution from LLM-generated Python strings by parsing them into an abstract syntax tree and applying node-level whitelisting and context-aware safety checks.

This article explores using Zig's comptime to create tagged union subsets, inspired by Mitchell Hashimoto's work, and applies the technique to a MyST parser's AST traversal.