Technology news and discussion on TalkFuse.
Marvell and Penguin develop optical appliance to pool memory across 16 servers
Marvell Technology and Penguin Solutions are developing an appliance that uses optical links to pool memory for as many as 16 servers. The approach could let servers share large memory resources instead of each needing as much local DRAM, and may help meet demand for memory in AI systems.
The first appliances are designed for up to 16 TB of DDR5 and 1 TB of high-bandwidth memory (HBM), with 57.6 Tbps of bandwidth across the system. Software developed by Penguin lets connected servers access the shared memory and supports tiering, including using HBM as a cache for DDR5. The companies also see the appliance as a way to keep AI inference caches in memory rather than offloading them to storage; Marvell acquired the underlying technology from Celestial AI for $3.5 billion in February.
In short
- Marvell and Penguin are building an optical memory-sharing appliance.
- It can connect up to 16 servers.
- The first system supports up to 16 TB of DDR5 and 1 TB of HBM.
Read the full article at the source →
Originally published by The Register as “Marvell and Penguin Solutions aim to end the RAMpocalypse with photonic memory fabric”.