Google TurboQuant: 3-Bit KV Cache With Zero Accuracy Loss
A deep dive into Google TurboQuant's PolarQuant and QJL techniques — 6x KV cache memory reduction and 8x attention speedup, and what that actually means in practice.
Tags
ai-ml
4 posts
Vibe Physics — A Physics Professor Had Claude Write a Paper
Analyzing Anthropic's Science blog debut where Harvard physicist Matthew Schwartz supervised Claude as an 'AI grad student.' 110 drafts, 36M tokens, and a paper completed in two weeks.
Gemini Embedding 2 — How Multimodal Embeddings Change RAG
Google's first native multimodal embedding model: what shifts from text-only embeddings, how retrieval changes, and how to use it in a production RAG pipeline.
Recommendation System Optimization: From 78K Tokens to Zero
Eliminated 78K tokens and reduced execution time 99% using metadata caching and hash-based updates. Guide to building a near-zero cost recommendation system.