datasette-ip-rate-limit 0.1a0

Simon Willison's Blog Tools
rate-limiting datasette plugin python open-source configurable crawler

Summary

datasette-ip-rate-limit 0.1a0 is a configurable rate-limiting plugin for Datasette, built to block aggressive crawlers.

No content available
Original Article
View Cached Full Text

Cached at: 05/14/26, 08:19 PM

# Release: datasette-ip-rate-limit 0.1a0 Source: [https://simonwillison.net/2026/May/14/datasette-ip-rate-limit/](https://simonwillison.net/2026/May/14/datasette-ip-rate-limit/) The[datasette\.io](https://datasette.io/)site was being hammered by poorly\-behaved crawlers, so I had Codex \(GPT\-5\.5 xhigh\) build a configurable rate limiting plugin to block IPs that were hammering specific areas of the site too quickly\. Here's[the production configuration](https://github.com/simonw/datasette.io/blob/b6022bf9987661b94a26d3143028193a6cabfdcf/datasette.yml#L103-L116)I'm using on that site for the new plugin: ``` datasette-ip-rate-limit: header: Fly-Client-IP max_keys: 10000 exempt_paths: - "/static/*" - "/-/turnstile*" rules: - name: demo-databases paths: - "/global-power-plants/*" - "/legislators/*" window_seconds: 60 max_requests: 60 block_seconds: 20 ```

Similar Articles

datasette-llm-limits 0.1a0

Simon Willison's Blog

datasette-llm-limits 0.1a0 is a new plugin for Datasette that allows configuring per-user or global spending limits for LLM usage, working alongside datasette-llm and datasette-llm-accountant.

datasette 1.0a27

Simon Willison's Blog

Datasette 1.0a27 released with major security improvements (modern CSRF headers), new RenameTableEvent for plugin compatibility, and various API enhancements including improved upsert handling and database locking fixes.

datasette 1.0a29

Simon Willison's Blog

Datasette 1.0a29 is released with new utility methods, UI improvements for empty tables, and bug fixes including a race condition resolved with help from Codex CLI.

datasette-referrer-policy 0.1

Simon Willison's Blog

Release of datasette-referrer-policy 0.1, a Datasette plugin to fix OpenStreetMap tile display by overriding the default no-referrer header.

datasette 1.0a28

Simon Willison's Blog

Datasette 1.0a28 alpha release fixes compatibility bugs and resource management issues discovered in the previous alpha, including fixes for execute_write_fn() callbacks, database cleanup methods, and a new pytest plugin for automatic cleanup in tests.