Programmable Property-Based Testing
Summary
The article discusses programmable property-based testing, a software testing technique that enables customizable test case generation based on defined properties.
Similar Articles
What your agent's green test suite actually proves
This article argues that standard test suites with fixed inputs and expected outputs are insufficient for AI agents due to infinite input spaces and non-deterministic behavior, advocating for property-based testing instead.
PaT: Planning-after-Trial for Efficient Test-Time Code Generation
This paper introduces PaT (Planning-after-Trial), an adaptive test-time computation strategy for code generation that reduces inference costs by approximately 69% while maintaining performance comparable to larger models.
BP-TTA: Balanced and Prototype-Guided Test-Time Adaptation in Dynamic Scenarios
Proposes BP-TTA, a test-time adaptation method that handles both class imbalance and continual domain shifts by combining batch-balanced sampling with prototype-guided constraints, achieving state-of-the-art performance in dynamic streaming scenarios.
Composable Tests
The article discusses composable tests in software testing, explaining how composing tests can improve readability, maintainability, and efficiency while preserving properties like isolation and specificity.
FVSpec: Real-World Property-Based Tests as Lean Challenges
This paper presents FVSpec, a benchmark for AI-assisted formal verification that translates real-world property-based tests from Python into Lean 4 specifications using a multi-agent LLM pipeline, aiming to drive progress on formal verification of real-world software.