Blog

The Throughput Trap: Benchmarking vLLM on OpenXLA and the Reality of Production LLM Serving featured image

The Throughput Trap: Benchmarking vLLM on OpenXLA and the Reality of Production LLM Serving

vLLM Systems · DevLab 2026, Deep Dive I was recently invited by the Google TPU team to speak at the OpenXLA Summer DevLab 2026 . This post breaks down our deep-dive evaluation of …

avatar
Rabimba Karanjai
Splitting the Brain to Beat the Clock featured image

Splitting the Brain to Beat the Clock

→ paste between BEGIN END markers.

avatar
Rabimba Karanjai
Teaching the Coach to Read the Driver featured image

Teaching the Coach to Read the Driver

→ paste between BEGIN END markers.

avatar
Rabimba Karanjai
The 800-Millisecond Problem featured image

The 800-Millisecond Problem

Paste everything between the BEGIN END markers below.

avatar
Rabimba Karanjai
Racecraft (Project Koru) · Prologue — The Origin Story featured image

Racecraft (Project Koru) · Prologue — The Origin Story

The origin story of Project Koru — building an AI Race Coach at Sonoma Raceway with Google Developer Experts, Antigravity, and Gemini.

avatar
Rabimba Karanjai
The Blind Spot Horizon: Why Your AI Benchmarks Are Lying to You featured image

The Blind Spot Horizon: Why Your AI Benchmarks Are Lying to You

"If you measure the wrong thing, you optimize for the wrong thing. And when dealing with frontier, multimodal models, the wrong thing might just break your entire system without …

avatar
Rabimba Karanjai
My Friend's MRI Didn't Come with a Manual, So I Built One with AI featured image

My Friend's MRI Didn't Come with a Manual, So I Built One with AI

A wrapper to apply our enhancements without affecting other posts h3

avatar
Rabimba Karanjai
The Hidden Performance Trap in Causal Ring Attention featured image

The Hidden Performance Trap in Causal Ring Attention

button), not Compose view. Replace #REPO_URL with your GitHub URL and #COLAB_URL with the Colab notebook link before publishing.--> When I set out to implement Ring Attention for …

avatar
Rabimba Karanjai
Unboxing Gemma: High-Throughput Sparse Autoencoder (SAE) Training on Google Cloud TPU v5e featured image

Unboxing Gemma: High-Throughput Sparse Autoencoder (SAE) Training on Google Cloud TPU v5e

A blog post about unboxing gemma: high-throughput sparse autoencoder (sae) training on google cloud tpu v5e

avatar
Rabimba Karanjai
The Gemma 4 E2B Fine-Tuning Cookbook featured image

The Gemma 4 E2B Fine-Tuning Cookbook

content:'COOKBOOK' position:absolute right:-10px top:20px font-size:5r......

avatar
Rabimba Karanjai
Building a Multimodal Document Intelligence Pipeline with Gemma 4 E2B featured image

Building a Multimodal Document Intelligence Pipeline with Gemma 4 E2B

and it works automatically --> Scoped to to avoid fighting the theme background:#5b5c60 color:#fff padding:3re...

avatar
Rabimba Karanjai
Write Once, Scale Everywhere featured image

Write Once, Scale Everywhere

End-to-End Gemma 2B LoRA Fine-Tuning and Serving on GPU & TPU If you have ever prototyped a Large Language Model LLM on your local GPU and then s......

avatar
Rabimba Karanjai
Visualizing the Invisible: How Nano Banana 2 Turns Dense Science into Stunning Art featured image

Visualizing the Invisible: How Nano Banana 2 Turns Dense Science into Stunning Art

Disclaimer: As a Google Developer Expert (GDE), I was incredibly fortunate to be invited by Google DeepMind to test these models internally before their public release. The …

avatar
Rabimba Karanjai
Fine-Tuning at the Redline: Architecting a Trustable AI Racing Coach featured image

Fine-Tuning at the Redline: Architecting a Trustable AI Racing Coach

= " AI in a Jupyter notebook is safe.

avatar
Rabimba Karanjai
A Split‑Brain Neuro‑Symbolic Training Method for High‑Velocity Autonomous Coaching from Telemetry featured image

A Split‑Brain Neuro‑Symbolic Training Method for High‑Velocity Autonomous Coaching from Telemetry

A blog post about a split‑brain neuro‑symbolic training method for high‑velocity autonomous coaching from telemetry

avatar
Rabimba Karanjai
The Context Trap: Why Scaling Laws Can’t Break the Ceiling of Uncertainty featured image

The Context Trap: Why Scaling Laws Can’t Break the Ceiling of Uncertainty

We are currently living through the “ Post-Reasoning ” phase of the AI hype cycle. By now, models like Gemini 2.0 and the latest iterations of Gemini have normalized the idea that …

avatar
Rabimba Karanjai
Building Production AI Systems with Free Cloud GPUs featured image

Building Production AI Systems with Free Cloud GPUs

Rabimba's Technical Blog Style .rabimba-blog Header with gradient .blog-header background: linear-gradien......

avatar
Rabimba Karanjai
🎤 SpeakWise: Build an AI Public Speaking Coach with Gemma 3n featured image

🎤 SpeakWise: Build an AI Public Speaking Coach with Gemma 3n

SpeakWise: Build an AI Public Speaking Coach with Gemma 3n body h1, h2, h3 pre code font-family: monospace

avatar
Rabimba Karanjai
From Models to Agents: Shipping Enterprise AI Faster with Google’s MCP Toolbox & Agent Development Kit featured image

From Models to Agents: Shipping Enterprise AI Faster with Google’s MCP Toolbox & Agent Development Kit

This article is an expanded write-up of the talk I recently delivered as a Google Developer Expert during a talk in Denver. The full slide deck is embedded below for easy …

avatar
Rabimba Karanjai
Deep Dive into the Google Agent Development Kit (ADK): Features and Code Examples featured image

Deep Dive into the Google Agent Development Kit (ADK): Features and Code Examples

In our previous overview, we introduced the Google Agent Development Kit (ADK) as a powerful Python framework for building sophisticated AI agents. Now, let's dive deeper into some …

avatar
Rabimba Karanjai
Build Smarter AI Agents Faster: Introducing the Google Agent Development Kit (ADK) featured image

Build Smarter AI Agents Faster: Introducing the Google Agent Development Kit (ADK)

The world is buzzing about AI agents – intelligent entities that can understand goals, make plans, use tools, and interact with the world to get things done. But building truly …

avatar
Rabimba Karanjai
My Google I/O 2024 Adventure: A GDE's Front-Row Seat to the Gemini Era featured image

My Google I/O 2024 Adventure: A GDE's Front-Row Seat to the Gemini Era

body h1, h2 Hey tech enthusiasts!

avatar
Rabimba Karanjai
MovieBuff: Dive Deeper into Movies with Generative AI featured image

MovieBuff: Dive Deeper into Movies with Generative AI

MovieBuff: Dive Deeper into Movies Before You Watch MovieBuff: Dive Deeper into Movies Before You Watch Have you ever spent two hours watching a movie only to be disappointed? …

avatar
Rabimba Karanjai
Curious case of Cisco AnyConnect and WSL2 featured image

Curious case of Cisco AnyConnect and WSL2

One thing Covid has taught me is the importance of VPN. Also one other thing COVID has taught me while I work from home  is that your Windows Machine can be brilliant  as long as …

avatar
Rabimba Karanjai
Immersive Payment: Second Update featured image

Immersive Payment: Second Update

This is the second update to the Immersive Payment project update under the Grant For Web Fellowship. You can read the last report here: …

avatar
Rabimba Karanjai
Immersive Payment: First Update featured image

Immersive Payment: First Update

It has been more than 6 months now that I have had the Immersive Payments, Spark Grant. Since then I have worked on realizing the scope of the project and finally, I am here to …

avatar
Rabimba Karanjai
Road to the Grant : Immersive Payment featured image

Road to the Grant : Immersive Payment

  This is a news close to my heart. My project "Immersive Payment" has been awarded with Grant for the Web , and I will be focusing on using Web Monetization to enable Micro …

avatar
Rabimba Karanjai
Attack of the Clones (Part 1): Drishti and vMeet featured image

Attack of the Clones (Part 1): Drishti and vMeet

Background : India recently banned certain Chinese Apps from being used and also with that launched a campaign of being vocal for local . Essentially promoting industries and app …

avatar
Rabimba Karanjai
Handling Web Server file permission: The Last Guide featured image

Handling Web Server file permission: The Last Guide

If you have to work with a LAMP stack one of the first things you do is setting up permission for your user and web server so that you can deploy files correctly and securely and …

avatar
Rabimba Karanjai
Help finding a cure for COVID19: Set up Folding@Home featured image

Help finding a cure for COVID19: Set up Folding@Home

COVID-19 has been already assigned as a pandemic worldwide now. It is now a global problem affecting all of our day to day lives. Almost all the methods of combating the virus at …

avatar
Rabimba Karanjai
Blocking Communication - Breaking Out featured image

Blocking Communication - Breaking Out

I disapprove of what you say, but I will defend to the death your right to say it If you have been following my previous post you will realize how quickly a state actor can just …

avatar
Rabimba Karanjai
Blocking Communication - A perspective from India : The Beginning featured image

Blocking Communication - A perspective from India : The Beginning

Update: If you want to know how to circumvent this kind of blocking. head over to my second part of the blog post.  If liberty means anything at all, it means the right to tell …

avatar
Rabimba Karanjai
Visualizing large scale Uber Movement Data featured image

Visualizing large scale Uber Movement Data

New York's cab data visualization from Uber's Engineering blog Last month one of my acquaintances in LinkedIn pointed me to a very interesting dataset. Uber's Movement Dataset. It …

avatar
Rabimba Karanjai