This week, we’re diving into the hidden challenges of AI infrastructure with David Driggers, CEO of Cirrascale. David and I chat about the surprising failure points that traditional data center planning often misses when it comes to large-scale AI deployments, why old assumptions about power, cooling, and networking simply don’t hold up anymore and why the “just add GPUs” strategy can be a recipe for disaster without a true systems-thinking approach. Also this week, I check out a massive breakthrough where physicists are using AI to uncover entirely new laws … Read More → "The Hidden Truths of AI Infrastructure: Why “Just Add GPUs” Always Fails"

This week, I’m excited to welcome Sandra Rivera from VSORA! We dive into a discussion on why AI inference is essential for deployment at scale, specifically focusing on how VSORA’s patented software architecture addresses the “memory wall” by collapsing memory layers. We explore their recent tape-out,  the need for low latency and high determinism, future plans for OEM modules and MLPerf benchmarking, and even get a brief look into Sandra’s family llama farm.

… Read More → "Solving the Memory Wall: A Deep Dive into AI Inference with Sandra Rivera"