Learn AI by Building

From your first dataset to production agents โ€” deep-dive series, hands-on notebooks, and experiments you can rerun yourself.

Paper of the Week

All Issues โ†’
Issue #10 ยท WeeklyNov 13, 2026

Paper of the Week #10 โ€” Reorganize the Agent's Workspace, and Haiku 4.5 Runs at a Quarter of the Cost

This week: EnvOpt (UC Berkeley, UChicago, Bespoke Labs) lets one agent rebuild the workspace another agent works in, without answer keys. On AutomationBench, Claude Haiku 4.5's cost fell 72.7% and its pass rate rose from 2.33% to 16.67%. The same workspace cut Opus 5's cost by 68.1%, with pass rate moving from 33.83% to 35.17%. We checked every number against the paper's tables and note where the shared figures need context. Also: SlackBench, from the same group, where the best of 33 agent setups scored 80.25% on questions about a research team's Slack, and reading the workspace as plain files beat Slack tools by 7.85 points on average.

Premium Series

Our Products

Courses and code built from what we measure here

Latest Posts

View All โ†’
Serve llama.cpp as an API for curl, Python and Open WebUI, and Stop Cut-Off Answers

Serve llama.cpp as an API for curl, Python and Open WebUI, and Stop Cut-Off Answers

Run llama-server on an 8 GB budget and call it from curl, Python and Open WebUI. Open WebUI attached 38 tool definitions to a one-line question, a 7,217-token prompt, and answers stopped with \"Context size has been exceeded.\" Turning the thinking off fixed it; switching the tools off alone did not.

- Models & Algorithms
Read More
The Transformer Block from 2017 to Mamba Hybrids: 15 Changes, 13 Rebuilt in Code

The Transformer Block from 2017 to Mamba Hybrids: 15 Changes, 13 Rebuilt in Code

Fifteen changes to the Transformer block, from Post-LN to Mamba hybrids, each drawn as one diagram and explained with what the paper reported and what it costs. We rebuilt one layer from seven real models as short PyTorch functions; all seven match the Hugging Face output. On the same sentence, the residual stream grows 98-fold from the first layer to the last in Qwen3-0.6B and only 1.1-fold in BERT.

- Models & Algorithms
Read More
Before voting on truth, let the model calculate: testing Against All Likelihood

Before voting on truth, let the model calculate: testing Against All Likelihood

Across 18 arithmetic questions and three frames, direct answers scored 0/54; an exploratory calculation-first follow-up scored 54/54. We examine floor and ceiling effects, a scoring repair, and what invariance can establish.

- AI Research
Read More
Before mapping thought: 18 of 128 step labels changed when markers disappeared

Before mapping thought: 18 of 128 step labels changed when markers disappeared

We collected 16 local reasoning traces, checked annotation stability and compared transitions with shuffled order. Marker removal changed 18/128 comparable labels; this is a measurement audit, not a Mole-Syn training replication.

- AI Research
Read More
The harness improved. The arithmetic did not: a fixed-model repair experiment

The harness improved. The arithmetic did not: a fixed-model repair experiment

A local Qwen3.5 9B harness search improved 36/72 to 50/72 correct attempts, mainly by fixing JSON escaping. We inspect frozen selection, unchanged arithmetic failures, and a full-development evidence ablation.

- AI Research
Read More
We connected PaperOrchestra to a local model. The PDF compiled; its evidence still needed checking.

We connected PaperOrchestra to a local model. The PDF compiled; its evidence still needed checking.

A constrained run of official PaperOrchestra components produced a PDF with one changed numeric cell and two unresolved citation keys. A second seed failed at outline parsing. We audit the logs, manuscript and simulated review.

- AI Research
Read More