TPU

OpenXLA Summer DevLab 2026 — Benchmarking vLLM on XLA Backends featured image

OpenXLA Summer DevLab 2026 — Benchmarking vLLM on XLA Backends

Invited by Google's ML and TPU teams to speak at Dev Lab Summer 2026 on "Benchmarking vLLM on XLA Backends: From CUDA to OpenXLA for LLM Serving", alongside engineers from Google, …

avatar
Rabimba Karanjai
The Throughput Trap: Benchmarking vLLM on OpenXLA and the Reality of Production LLM Serving featured image

The Throughput Trap: Benchmarking vLLM on OpenXLA and the Reality of Production LLM Serving

vLLM Systems · DevLab 2026, Deep Dive I was recently invited by the Google TPU team to speak at the OpenXLA Summer DevLab 2026 . This post breaks down our deep-dive evaluation of …

avatar
Rabimba Karanjai
TPU as Cryptographic Accelerator featured image

TPU as Cryptographic Accelerator

Rabimba Karanjai