# Google’s C++ XSE engine serves machine-learning models without Python runtime

- URL: https://talkfuse.com/story/google-gooses-python-ai-performance-by-removing-python/
- Published: 2026-11-11T11:30:00+00:00
- Updated: 2026-11-11T11:48:27+00:00
- Original publisher: The Register
- Original article: https://www.theregister.com/devops/2026/11/11/google-gooses-python-ai-performance-by-removing-python/5308995
- Topics: AI, Technology, Trending, Weird & Viral

## Key points

- Google has open-sourced its C++ XSE model-serving engine.
- It handles over six million queries per second across Google services.
- Tests showed up to five times the throughput using a quarter of the memory.

## Summary

Google has open-sourced XSE, a C++ engine that serves machine-learning models without running a Python interpreter for each request. It is designed for smaller, task-focused models such as ranking and recommendations, where high request volumes and tight latency requirements make serving speed important.

Google says XSE handles more than six million queries per second across YouTube Shorts, Google Ads and Search. In tests on short requests, it achieved two to five times the throughput of Google’s best optimised Python server while using a quarter of the memory. Models can be written in Python with JAX, exported with their computations and trained weights, then compiled by XLA for CPUs or GPUs; Google also plans support for exporting PyTorch models to serve on TPUs.

---
Summarised by TalkFuse (https://talkfuse.com/). Quote the original publisher for the reporting and link this page for the summary and discussion.