New Deep-tech Semiconductor Startup Tackling AI's Compute Memory Bottleneck
imec-int.com, Jan. 14, 2025 –
Vertical Compute’s technology will have a transformative impact, enabling next-generation applications with unparalleled efficiency and privacy. By minimizing data movement and bringing large data closer to computation, the innovation ensures energy savings of up to 80%, unlocks hyper-personalized AI solutions, and eliminates the need for remote data transfers, protecting user privacy.
“Memory technologies face limitations in both density and performance scaling, while processor performance continues to surge. The extreme data access requirements of AI workloads exacerbate this challenge, making it imperative to overcome the memory wall to enable the next wave of AI innovations. We believe going Vertical is the path to 100X gains”
Sébastien Couet, CTO of Vertical Compute.
The rapid advancements in large language models and generative AI are transforming virtually all industries at an unprecedented pace. However, these large-scale AI models still heavily rely on complex cloud infrastructure and high bandwidth memories, leading to data transfer latency, high energy consumption and sending sensitive data to distant servers. Edge computing can address these issues, but inferencing large AI models on smartphones, PCs or smart home devices faces significant cost, power and scalability constraints.