Learn AI by Building

From your first dataset to production agents โ€” deep-dive series, hands-on notebooks, and experiments you can rerun yourself.

Paper of the Week

All Issues โ†’
Issue #1 ยท WeeklyAug 26, 2026

Paper of the Week #1 โ€” Sparse Is Not the Same as Interpretable

I trained BDH and counted more than 4.8 billion activations across three controls. Training moved its single-latent sparsity from 49.98% to 81.65%, but a similar-budget ReLU baseline reached 91.04%. Sparsity is real; by itself, it is not evidence of interpretability.

Premium Series

Our Products

Tools we built for developers and job seekers

Starter Kits

View All โ†’

Practice notebooks, interview questions, and project solutions โ€” ready to download.

Browse Starter Kits

Latest Posts

View All โ†’
TurboQuant in vLLM on One A100 โ€” Capacity, Speed, and Accuracy of All Four Presets on an 8B Model

TurboQuant in vLLM on One A100 โ€” Capacity, Speed, and Accuracy of All Four Presets on an 8B Model

vLLM 0.28, Qwen3-8B bf16, one A100 80GB: KV capacity, batched throughput, 32K decode, needle-in-haystack, and GSM8K for bf16, fp8, and all four TurboQuant presets โ€” the 8B size vLLM's own study skipped.

- Models & Algorithms
Read More
Hybrid Mamba-Transformer, Measured โ€” Qwen3.5-9B Fits 4.4x More Context and 3.6x More Requests on the Same A100

Hybrid Mamba-Transformer, Measured โ€” Qwen3.5-9B Fits 4.4x More Context and 3.6x More Requests on the Same A100

Cache memory of Qwen3.5-9B (24 linear + 8 attention layers) vs Qwen3-8B measured from 2K to 64K context on one A100: 4.4x smaller at 64K, +37% prefill and 3.6x concurrency in vLLM โ€” Part 1's claims confirmed, with a guide to which measurements can legitimately show it.

- AI Research
Read More
TurboQuant From Scratch on Real KV Tensors โ€” What 3 Bits Actually Cost, and Why the Forks Beat the Paper's Layout

TurboQuant From Scratch on Real KV Tensors โ€” What 3 Bits Actually Cost, and Why the Forks Beat the Paper's Layout

PolarQuant in 60 lines of PyTorch on real KV from Llama-3.2-1B and Qwen3-8B: 3-bit costs +10% perplexity, k8v4 +0.2%, QJL only pays below 4 bits, and the block-32 layout explains half the forks' edge.

- Models & Algorithms
Read More
TurboQuant llama.cpp CUDA Fork, Measured on an A100 โ€” turbo4 Matches q4_0, turbo3 Breaks at Long Context

TurboQuant llama.cpp CUDA Fork, Measured on an A100 โ€” turbo4 Matches q4_0, turbo3 Breaks at Long Context

Qwen3-8B Q4_K_M on one A100, six KV types: perplexity, prefill, decode-at-depth, and VRAM measured. turbo4 matches q4_0 quality and beats q8_0 decode 2.5x at depth; turbo3 triples perplexity at 32K context.

- Models & Algorithms
Read More
TurboQuant Status Check, August 2026 โ€” What Actually Shipped in vLLM, llama.cpp, and Ollama

TurboQuant Status Check, August 2026 โ€” What Actually Shipped in vLLM, llama.cpp, and Ollama

vLLM shipped it in v0.20 and published a sobering benchmark; llama.cpp upstream rejected it in June; Ollama's implementation is dead. We also correct our own earlier "merged in llama.cpp" claim โ€” with links.

- Models & Algorithms
Read More
CLAUDE.md Templates for Five Project Types โ€” Copy, Paste, and the Rules That Actually Change Agent Behavior

CLAUDE.md Templates for Five Project Types โ€” Copy, Paste, and the Rules That Actually Change Agent Behavior

Five CLAUDE.md/AGENTS.md templates โ€” Next.js, Python ML, monorepo, data pipeline, research notebook โ€” plus which lines agents actually obey and how to use a rules file to govern side effects.

- AI Tools
Read More