InstaDeep powers AI as a Service with shared NVMe

Excelero NVMesh feeds unlimited streams of data to GPU-based systems with local performance for AI and ML customers.

Global Artificial Intelligence (AI) innovator, InstaDeep, has deployed Excelero’s NVMesh® software on Boston Ltd. Flash-IO Talyn storage systems to create a highly efficient data centre infrastructure using a scalable pool of high-performance NVMe flash that ensures full utilisation of GPU processing power and maximum ROI.


Headquartered in London, InstaDeep offers a pioneering AI as a Service solution enabling organisations of any size to leverage the benefits of AI and Machine Learning (ML) without the time, costs and expertise required to run their own AI stacks. Excelero’s NVMesh®, in turn, allows InstaDeep to access the low-latency, high-bandwidth performance that is essential for running customer AI and ML workloads efficiently – and gain the scalability vital to InstaDeep’s own rapid growth.

"Finding a storage infrastructure that would scale modularly and was highly efficient for AI and ML workflows is no small challenge," explained Amine Kerkeni, Head of AI Product at InstaDeep. "Our clients simply will not achieve the performance they need if an infrastructure starves the GPUs with slow storage or wastes time copying data to and from systems. Excelero NVMesh ticked all the boxes for us and more."


By allowing the GPU optimised servers to access remote scalable, high-performance NVMe flash storage drives as if they were local flash - with full IOPs and bandwidth capabilities, the InstaDeep team is achieving highly efficient usage of the GPUs themselves and the associated NVMe flash. The end-result is higher ROI, easier workflow management and faster time to results.


InstaDeep’s first Excelero system includes a 2U Boston Flash-IO Talyn server with Micron NVMe flash and Excelero NVMesh software that provides access to up to 100TB external high-performance storage. Leveraging the Mellanox 100GB Infiniband network cards in the DGX, the GPUs use the NVMe storage with local performance. The ability to choose any file system to run on NVMesh was an immense benefit. Early tests immediately indicated that external NVMe storage with Excelero gives equal or better performance than local cache in the NVIDIA DGX.


"The GPU systems powering the AI and ML explosion have an amazing appetite for data, but many organisations are finding they quickly create a storage bottleneck,” explained Yaniv Romem, Excelero's CTO. "The only storage that is fast enough to keep up with these GPUs is local NVMe flash, due to the high competition for valuable PCIe connectivity amongst GPUs, networking and storage. Excelero’s NVMesh eliminates the need to compromise between performance and storage functionality by unifying remote NVMe devices into a logical block pool that performs the same as local NVMe flash with the ability to easily share data and protect it.”


“We’re excited to provide essential capabilities to help propel InstaDeep’s growth as the company elevates its game to meet AI demands,” Romem said.

ATTO Technology has published the findings of an independent survey of IT decision-makers from across the UK and Germany conducted by Vanson Bourne.
NetApp extends its collaboration to accelerate Ducati Corse’s digital transformation and deliver fast, reliable access to real-time data from anywhere in the world.
Delivering on the promise of SSDs that address future enterprise infrastructure requirements KIOXIA Europe GmbH has announced production-ready availability of its 9.5mm XD6 Series Enterprise and Datacenter Standard Form Factor (EDSFF) E1.S data center class SSDs. Introduced in late 2020, KIOXIA XD6 drives were the first EDSFF E1.S SSDs to address the specific requirements of hyperscale applications, including the performance, power and thermal requirements of the Open Compute Platform (OCP) NVMe® Cloud SSD Specification.
FlashBlade at Equinix with Azure for EDA: industry first validated solution to leverage cloud-adjacent storage for EDA workloads.
Infinidat says that Richard Bradbury has been appointed SVP, EMEA & APJ. Leveraging his extensive experience in storage at Hitachi and EMC, Bradbury will be responsible for accelerating growth and scaling Infinidat’s enterprise business across the UK, Europe, the Middle East, Japan, Australia, New Zealand and emerging markets. Bradbury reports to Infinidat’s CEO Phil Bullinger, effective immediately.
New storage automation and delivery platform and cloud native Database-as-a-Service offering bring infrastructure operations and applications closer together.
Leveraging its strength and leadership in flash, Western Digital has launched the new WD Red SN700 NVMe SSD, a high-endurance, fast-caching solution that accelerates NAS performance for SMB customers.
Nutanix has added new capabilities to the Nutanix® Cloud Platform that make it easier for customers to simplify data management, and optimise database and big data workload performance for the most critical applications.