Tag
Devin's automated UI testing feature autonomously creates test plans, runs tests on macOS and Linux environments, and generates video artifacts, making testing feel like AGI.
Devin, an AI tool, now provides video receipts for app testing by generating test plans, executing user flows, and delivering annotated recordings to visually verify work.
An online hackathon from Aug 28 to 31 challenges developers to build web apps with AI coding agents and use Kane CLI for real-browser verification to close the development loop, with prizes totaling $4,000.
The author discusses challenges in automated regression testing for AI agent tool calling in CI/CD due to LLM non-determinism and seeks community insights on effective setups and frustrations.
A new tool claimed to enable writing and running automated UI tests for web pages (and iOS/Android apps) 100x faster.
OpenAI developed GPT-Red, an LLM trained via self-play to automatically red-team other models, finding vulnerabilities like a novel 'fake chain of thought' prompt injection. The approach improved the robustness of GPT-5.6.
The author describes using Fable and Codex to port Conductor (a Mac-only tool) to Linux and automate QA with a screen recording; the goal is to enable automated bug triage and fixing.
Proposes SAGE, a framework for autonomously uncovering latent failure patterns in LLM-based Text-to-SQL generation by generating vulnerability hypotheses and iteratively verifying them. Experiments show SAGE reveals significant model fragility and discovered patterns transfer across models, with preliminary fine-tuning showing promising remediation.
RedCoder is an automated red-teaming agent designed to probe the security of coding agents, presented at ACL2026.
Greptile introduces TREX, an AI code reviewer that executes code and detects runtime bugs, going beyond static analysis by spinning up parallel agents to investigate issues and generate artifacts like screenshots.
The article introduces 'backpressure'—using automated tests and type systems—as a third way to use AI coding agents, making them safer and more autonomous by reducing the need for constant human review.
TDDev automates test-driven development for web application generation by integrating requirement analysis, browser-based validation, and structured repair, improving code quality by 34-48 percentage points over baselines and reducing human intervention to zero.
Drizz is a mobile testing tool that autonomously writes, runs, and fixes tests.