# Aiven plans customer gateway after cutting AI costs by 80 per cent

- URL: https://talkfuse.com/story/euro-open-source-specialist-proposes-llm-gateway-to-ease-token-bills/
- Published: 2026-10-26T10:15:00+00:00
- Updated: 2026-10-26T10:28:25+00:00
- Original publisher: The Register
- Original article: https://www.theregister.com/ai-and-ml/2026/10/26/euro-open-source-specialist-proposes-llm-gateway-to-ease-token-bills/5305170
- Topics: AI, Technology

## Key points

- Aiven reports an 80 per cent spending reduction for heavy users.
- Its gateway helps developers switch between different AI models.
- The company plans to offer the service to customers.

## Summary

Aiven says its internal gateway has cut AI spending on heavy users by about 80 per cent, by making it easier for developers to use lower-cost open-weight models. The Finland-based open-source database provider plans to offer the gateway to customers, as organisations look for ways to manage rising costs from large language models.

The gateway is built around the open-source LiteLLM framework and adds budgeting and access controls. Aiven runs models on rented GPUs and also hosts them itself; it still uses more powerful frontier models to plan work, while open-weight models handle much of the execution. The company says teams should also compare cost per task, since model performance varies.

---
Summarised by TalkFuse (https://talkfuse.com/). Quote the original publisher for the reporting and link this page for the summary and discussion.