2026-05-16

Engineering Reads — 2026-05-16#

The Big Idea#

The defining challenge of modern engineering is resource management at the extremes—whether that means reclaiming CI/CD compute cycles from vendor lock-in via lower-level orchestration, or driving down the inference costs of long-context LLMs through architectural optimization.

Deep Reads#

Slowly going mad with power using Tekton · xeiaso.net · Source The author outlines a strategic migration away from GitHub Actions to mitigate platform lock-in, replacing it with Tekton, a Kubernetes-native CI/CD operator. Instead of relying on a managed platform’s implicit state and runner lifecycles, Tekton forces you to model CI as a series of lower-level Kubernetes primitives: Tasks, TaskRuns, Pipelines, and PipelineRuns. This requires explicitly managing the grimy details of distributed builds, such as configuring Persistent Volume Claims (PVCs) for repository clones and shared Go module caches. The explicit tradeoff here is operational overhead—like debugging vague VCS errors or manually configuring Kaniko forks for Docker builds—in exchange for leveraging idle homelab compute and achieving absolute vendor neutrality. Engineers looking to future-proof their deployment pipelines against platform decay should read this to understand the true operational cost of infrastructure independence.

2026-05-16

Simon Willison — 2026-05-16#

Highlight#

The standout update today is the release of datasette-llm-limits 0.1a0, which introduces a practical way to manage LLM API costs directly within Datasette. It’s a highly useful piece of infrastructure for anyone building and exposing AI tools, solving the very real problem of managing usage limits for local or hosted LLM integrations.

Posts#

[datasette-llm-limits 0.1a0](https://simonwillison.net/2026/May/15/datasette-llm-limits/#atom-everything) Simon released an alpha version of datasette-llm-limits, a new plugin that works alongside the datasette-llm and datasette-llm-accountant packages. It allows administrators to configure per-user or global spending limits for LLM usage inside of Datasette. This is a crucial addition for safely scaling AI-assisted database workflows by keeping API usage costs strictly under control.

2026-05-17

Simon Willison — 2026-05-17#

Highlight#

The NHS recently decided to close its open-source repositories in response to AI-discovered vulnerabilities, but the UK Government Digital Service (GDS) is publicly pushing back. Simon highlights this rare public clash between UK civil service branches over the critical issue of AI security and open-source by-default policies.

Posts#

GDS weighs in on the NHS’s decision to retreat from Open Source · Source Simon points to Terence Eden’s continued coverage of the NHS’s poorly considered decision to lock down access to open-source repositories following vulnerabilities flagged by Project Glasswing. The UK Government Digital Service (GDS) has stepped in with a new publication on AI and open code, strongly recommending that public sector code remain “open by default” because closing everything adds delivery costs and reduces both code reuse and scrutiny. Terence Eden observes that this public disagreement—described as a frosty “meeting without biscuits”—represents a major escalation within the civil service over how to handle open-source security in the age of AI.

2026-05-18

Engineering Reads — 2026-05-18#

The Big Idea#

The limits of engineering capability—whether writing new software with AI or comprehending legacy systems—are ultimately dictated by the quality and tightness of our feedback loops. The tools we build to verify correctness or surface the context of past decisions will become far more critical than the raw generation of code or text.

Deep Reads#

[What’s Easy Now? What’s Hard Now?] · Marc Brooker · Source Coding agents will eventually excel at deeply technical systems programming while struggling with UI/UX, directly inverting current conventional wisdom. Brooker argues that AI agents are fundamentally feedback loops wrapped around open-loop LLMs. Tasks with rigorous automated feedback—like writing a database storage engine verified by Rust, TLA+, or property-based tests—can be solved entirely by an agent iterating without human intervention. Conversely, front-end development relies on slow, inconsistent human feedback, making it a inherently difficult problem for autonomous agents. Engineering leaders and systems programmers should read this to understand why mastering formal specification tools will be their highest-leverage skill in an AI-assisted future.

2026-05-18

Simon Willison — 2026-05-18#

Highlight#

Today’s update takes a brief step away from developer tooling as Simon shares some bird sightings from a morning walk along the Los Angeles River as he wraps up his time at PyCon US.

Posts#

[Glaucous-winged Gull, Brown Pelican, Snowy Egret, Canada Goose] · Source In a brief personal update, Simon recounts his final morning walk before traveling home from PyCon US. He explored the Los Angeles River specifically hoping to spot a pelican, which he successfully found, alongside other birds including a Glaucous-winged Gull, a Snowy Egret, and some Canada Goose goslings near the swan boat lake.

2026-05-19

Simon Willison — 2026-05-19#

Highlight#

Simon’s annotated PyCon US 2026 lightning talk provides a sharp, insightful retrospective on the “November 2025 inflection point,” identifying exactly when coding agents became reliable daily drivers and laptop-grade local models started wildly overperforming. It is a quintessential Willison post that perfectly frames the recent tectonic shifts in AI developer tooling.

Posts#

[The last six months in LLMs in five minutes] · Source Simon shares his annotated slides from a PyCon US 2026 lightning talk summarizing the past six months of LLM developments. He zeroes in on two main themes: coding agents crossing the threshold from “often-work” to “mostly-work” driven by Reinforcement Learning from Verifiable Rewards, and the astonishing capability of local models like the 20.9GB Qwen3.6-35B-A3B and Gemma 4. The post also tracks the recent surge of “Claws” (personal AI assistants running locally on Mac Minis) and features his ongoing “pelican riding a bicycle” SVG visual benchmark to compare models.

2026-05-20

Simon Willison — 2026-05-20#

Highlight#

Simon takes a critical look at Google I/O’s Gemini Spark announcement, digging into the opaque “Antigravity” stack and questioning how Google plans to mitigate prompt injection risks for a tool with deep access to user data. This highlights the growing industry tension between powerful workspace AI agents and fundamental security vulnerabilities.

Posts#

[Google I/O, Gemini Spark, Antigravity] · Source Sticking to his rule of only reviewing generally available tools, Simon breaks down the announcement of Gemini Spark, Google’s new OpenClaw competitor that natively integrates with Workspace apps. He notes a strange FAQ detail claiming Spark runs on “Antigravity”—a moniker applied to a desktop app, a Go-based CLI, and a VS Code fork. Crucially, Simon questions whether Google’s isolated VM approach and Agent Gateway will actually be enough to prevent an “agent security challenger disaster” when handling sensitive data via prompt injection. He also highlights that Google is deprecating its open-source Gemini CLI on June 18th in favor of a closed-source Antigravity CLI.

Simon Willison

Simon Willison — 2026-05-29#

Highlight#

Today’s most significant update is the release of Datasette 1.0a31, a massive paradigm shift for the project that introduces UI support for executing write queries directly against the database.

Posts#

datasette 1.0a31 Simon has released a major alpha for Datasette, bringing a highly-requested evolution: users with the right permissions can now execute write queries and save “stored queries” (formerly “canned queries”) directly in the UI. This allows developers to set up templated insert, update, and delete operations against their databases. This release also marks the third post on the recently launched Datasette blog, highlighting his ongoing push for better project documentation.

Simon Willison

Simon Willison — Week of 2026-05-16 to 2026-05-22#

Highlight of the Week#

The most impactful milestone this week is the official announcement of Datasette Agent, merging Simon’s three years of work on his LLM library directly into Datasette. This conversational AI interface allows users to naturally interrogate their databases, boasting an extensible plugin architecture for charts, image generation, and secure code execution.

Key Posts#

[The last six months in LLMs in five minutes] · Source Simon shared annotated slides from his PyCon US 2026 lightning talk capturing a major inflection point in AI developer tooling. He highlights how coding agents crossed the threshold to become reliable daily drivers, and points to the astonishing capabilities of massive local models running on consumer hardware like Mac Minis.

Daily Digest

AI-curated news and insights, organized so you never miss what matters

Today's Digest
  • What Is This#

    A daily briefing that pulls from dozens of sources — tech blogs, social media, news outlets, and video channels — then distills them into concise, readable summaries you can scan in minutes.

  • How It Works#

    Content is collected and summarized on a rolling basis: today for the freshest takes, this week for catch-up, and monthly/archive views for deeper review.