Lightbits and Crusoe AI Announce Collaboration to Expand Elastic Block Storage Service for AI Workloads
SAN JOSE, Calif., Oct. 30, 2024 -- Lightbits Labs has announced that Crusoe Energy Systems LLC, a vertically-integrated AI infrastructure company, has expanded its AI cloud service with Lightbits' high-performance, software-defined block storage. The collaboration between Crusoe and Lightbits provides expanded access to high-performance, readily available, and durable block storage solutions for customers with AI workloads at scale.
Crusoe is a leading AI cloud pioneer, powering its data centers with a combination of wasted, stranded, and clean energy resources to lower the cost and environmental impact of AI cloud computing. The Crusoe AI data center is constructed to industry-leading efficiency and reliability standards, advancing the frontier of data center design and scale for AI training and inference workloads.
“Lightbits’ comprehensive suite of enterprise-grade functionality has been instrumental in helping us build a high-performance, climate-aligned AI cloud platform, addressing performance and operational gaps that other block storage solutions struggle with,” said Patrick McGregor, Crusoe’s Chief Product Officer. “From data preprocessing to real-time inference, the advantages of lower and more consistent latency, higher throughput, and linear scalability make Lightbits' high-performance block storage an excellent offering for Crusoe Cloud’s customers to optimize their AI workflows. The Lightbits team continues to be a great partner, providing continual improvements in product usability and high-quality, hands-on support for our team.”
Lightbits leverages NVMe/TCP to enable direct access to NVMe storage over standard Ethernet TCP/IP networks. This innovative architecture significantly reduces latency and maximizes throughput, making it ideal for demanding AI and ML workloads. Lightbits delivers up to 4x higher performance compared to other vendors and open-source solutions like Ceph, particularly notable for smaller IO sizes. Additionally, Lightbits scales IOPS with increased load while consistently maintaining latencies under 500μs. The clustered architecture provides up to 3 replicas per volume across multiple availability zones for high availability.
Lightbits delivers an unmatched combination of scalability, high performance, and cost efficiency. The flexibility delivered by Lightbits' software-defined and API architecture cannot be understated, allowing Crusoe’s Cloud users to choose the most optimized environment for their production workloads. Users can resize their VMs and consume high-performance storage in the form of persistent disks on demand while leveraging the OS images pipeline to generate their workload-specific images, e.g., LLM training with Jax or Generative AI with Stable Diffusion. Additionally, Lightbits’ solution is integrated with Kubernetes, OpenStack, and VMware to support modern cloud-native apps and traditional virtualized apps.
“Our collaboration with Crusoe has reached new heights, underscoring Lightbits’ commitment to providing cloud infrastructure optimized for AI workloads,” said Kam Eshghi, Lightbits’ Co-founder and CSO. “The expanded partnership reflects the tangible results Crusoe has seen and demonstrates our crucial role in shaping the future of AI cloud technology.”
This expansion with Lightbits enables Crusoe Cloud to continue to provide unparalleled performance and scalability to meet the needs of AI and ML, scientific computing, and graphics customers from now and into the future.
To learn more about how Crusoe built an AI Cloud service with Lightbits' software-defined storage, read Crusoe's blog.
About Lightbits Labs
Lightbits Labs (Lightbits), invented the NVMe over TCP protocol and are pioneers in software-defined block storage that enables service providers and enterprise organizations to architect agile and efficient cloud infrastructure. Built from the ground up for high performance, scalability, resiliency, and cost-efficiency at scale, Lightbits software delivers the best price/performance for real-time analytics, transactional, and AI/ML workloads. Lightbits Labs is backed by enterprise technology leaders (Cisco Investments, Dell Technologies Capital, Intel Capital, Lenovo, and Micron) and is on a mission to deliver the most cost-efficient cloud data storage for performance-sensitive workloads.
Source: Lightbits Labs
