Learn AI by Building
From your first dataset to production agents — deep-dive series, hands-on notebooks, and experiments you can rerun yourself.
Paper of the Week
All Issues →Paper of the Week #8 — Agents Beat All 20 Science Benchmarks, and None of 135 Follow-up Papers Passed
This week's roundup. Agent4Sci reports that frontier agents beat human-verified baselines on all 20 scientific ML benchmarks it collected, mostly through engineering; Into the Unknown reports that none of 135 agent-written follow-up papers met every condition set by the scientists who posed the problems. Also: BizAgentBench, which grades goals and procedure separately on payment-company workflows, and CarryOn, which rebuilds an agent's context from what it has produced instead of its chat history.
Premium Series
Our Products
Courses and code built from what we measure here
Video Courses
13 hands-on courses — quantization, diffusion, RAG, on-device AI, decision models. $199 lifetime bundle, first 3 lectures of every course free
LLM Quantization and Compression Hands-On
GPTQ, AWQ, GGUF, QLoRA — fit LLMs into the memory you have. The course behind our KV-cache measurements
Free Benchmark Code
The scripts and raw results behind the measurement posts, starting with the KV cache harness. Free with an account
Premium Series
140 deep-dive posts across 21 series, bilingual KO/EN, with production-ready code and notebooks
Latest Posts
View All →
Can an 8 GB GPU Turn One Photo Into a 3D Model? Idol Peaked at 7,380 MiB on a Capped A100
We ran Speridlabs' Idol on an A100 capped at 8 GB, with no real 8 GB card. A real photo peaked at 7,380 MiB in nvidia-smi: 300 MiB left counting 8,192 MiB with a 512 MiB desktop, 263 MiB over counting 8 × 10⁹ bytes. Commands and the step that adds 762 MiB.
Which Local Coding Model Should You Run on Your GPU? 8, 12, 16 and 24 GB on 4 Python Tasks: Qwen3.5-9B, gpt-oss-20b, Flint, Qwen3.5-27B
On four Python tasks: Qwen3.5-9B for 8 and 12 GB, Flint for 16 GB (we built the agent with it), Flint or Qwen3.5-27B for 24 GB. Measured on an A100 against the capacities of the RTX 4060, 3060 12GB, 4070 Ti Super and 4090.
How to Run Multimodal Models on an 8 GB GPU: All Four LFM3 Models Peak Under 5 GiB
A model-by-model guide to running LiquidAI's LFM3 text, vision, audio and omni models with llama.cpp. At full context, with an image or audio clip going in (a long prompt for the text model), the heaviest moment for each model took 3.7 to 4.8 GiB, inside an 8 GB card's usable memory (measured on an A100). Also: how to size a model for your card from two short test runs, and why the VL model can hand back an empty answer.
autoharness: "Summarize the Chat for Next Time" Is One Line. Why Is the Code 3,104 Lines?
We traced autoharness (3,104 lines of Python) from one conversation to a skill a later session reads, then ran it in Claude Code connected to Qwen3.8 Flash Next on Strata. The model only proposes; Python checks and writes. In our run, 5 of 11 proposals were sent back at submit time, the promoter wrote the other 6, and one reflection prompt used 64,655 of 65,536 tokens.
Anthropic Says Fold Your Subagents Into One Loop. We Ran Its Kit: 2.5x Faster on Average, 18 of 19 Tasks vs 16
We ran Anthropic's single-agent-loop-kit on a local model (Qwen3.8 Flash Next). Over 19 tasks the router app completed 16 and the single loop 18, at 19.7 s vs 8.0 s mean per task. The router looped between three team rules into an empty reply; the single loop failed one return question (t05) because of tool design. One model, deterministic decoding, so no significance claim.
Why LLMs Forget, and How Google's 'Sleep' Moves Memories Into a New Slot
Teach a model a second set of facts and it loses the first. Google's Sleep paper copies the fast memory into a new small slot before it is overwritten, then practices on examples it writes itself. In our 100-fact toy, a sleep step kept 73.2% of the old facts against 50.1% without it, better in all 20 runs, although our first attempt made forgetting worse. The paper reports AIME 2024 at 79.2 vs 73.8 for the base Qwen3-8B and has not released code.