fantastic: latest llama.cpp server webui can now run commands for tools into rootless sandboxed containers
Summary
llama.cpp server build 10423 adds an experimental --tools-runtime option that lets the webui run tool shell commands inside rootless sandboxed containers (e.g., podman:alpine or docker:alpine), downloading and instantiating the image automatically.
Similar Articles
llama.cpp server have built-in native tools (exec_shell, edit_file, etc.)
llama.cpp server now includes built-in native tools via an experimental flag, enabling file operations, shell commands, and more without external wrappers.
llama.cpp's web UI now supports executing model generated JavaScript in the browser, through Web Workers (opt in)
llama.cpp's web UI now supports executing model-generated JavaScript in a sandboxed iframe via Web Workers, enabling lightweight agentic code execution as an opt-in feature.
LLC: lightweight OpenWebUI alt - now with chat converter + custom tool calls
LLC, a lightweight alternative to OpenWebUI for running local LLMs, updates to v0.6 with a chat converter to import OpenWebUI history and custom tool calls for user-defined tools.
Fully in-browser container builds
A web application that builds containers entirely in the browser using client-side code, demonstrating the power of custom container tooling. Users can pick a base image, run a shell script, and export the resulting image as a tar file.
@llama_index: Ever wished your agent could read PDFs, images, and Office documents as easily as plain text? Or combine the safety of …
sandboxed-lit is a Rust CLI agent that parses PDFs, images, and Office documents securely via LiteParse and microsandbox, combining local file access with a sandboxed Bash environment.