WEKA and Stability AI Partner to Maximize Cloud Benefits for AI Model Training
CAMPBELL, Calif., Sept. 14, 2023 – WekaIO announced today that it is pioneering a new solution in collaboration with its customer Stability AI, a leading open-source generative AI company. The WEKA Data Platform Converged Mode for Cloud solution will enhance Stability AI’s ability to train multiple AI models in the cloud, including its popular Stable Diffusion model, and extend efficiency, cost and sustainability benefits to its customers.
AI processes such as training and inference require significant energy and computing resources. Few companies, especially those pioneering the next frontier of generative AI (GenAI) solutions, can invest the time or expense needed to acquire and deploy the necessary horsepower on-premises, and training and inference of AI models in the cloud is often prohibitively expensive.
WEKA has developed a unique way to dramatically improve this equation for cloud-first GenAI customers. The WEKA Data Platform’s Converged Mode solution is the first scale-out storage on deep learning capable instances available to users running workloads in the cloud. It uses ephemeral local storage and memory in cloud AI instances to yield exponential cost savings and performance improvements for large-scale generative AI resources compared to traditional data architectures.
Stability AI is always seeking to use existing cloud resources more efficiently. The company began working with WEKA to develop a “converged cloud” approach with the WEKA data platform and recently concluded a successful trial of the solution. Its converged architecture provides a single, high-performing set of resources to support the application and data platform simultaneously. The result is more optimal training of Stability AI’s models and better utility for its research teams.
“As the only independent, open, and multimodal generative AI company, we understand the limitations of running converged workloads on-premises,” said Tom Mason, CTO at Stability AI. “WEKA gives our customers more options by enabling training on converged mode in the public cloud. Our hope is that this partnership will increase our hardware utilization and scale to thousands of instances and essentially, do more with less, more sustainably.”
Once deployed, Stability AI hopes to be able to extend the benefit of performance gains and significant cloud cost-savings from WEKA’s data platform, all while lowering carbon emissions and energy consumption. The company expects to use the WEKA solution to underpin its forthcoming sustainability initiatives as its deployment matures and grows.
“The WEKA Data Platform can increase GPU-stack storage efficiency by 10-50x, driving a significant cost advantage for generative AI companies by helping to maximize resources they’ve already paid for,” said WEKA cofounder and CEO Liran Zvibel. “At the same time, WEKA makes it simple and affordable to run AI model training and inference in the public cloud, helping to shrink their data infrastructure and energy and carbon footprint, delivering a double-bottom line benefit for customers that want to harness the power of AI without compromising their corporate sustainability goals.”
WEKA’s Converged Mode for Cloud solution will be released as a public preview this year, initially on AWS, with other clouds to follow. Interested customers should contact their WEKA sales rep to join the waitlist.
About Stability AI
Headquartered in London with developers distributed across the globe, Stability AI was founded to build the foundation to activate humanity’s potential through artificial intelligence (AI). As the leader in multimodal, open generative AI model development and deployment, Stability AI collaborates with public and private sector partners to bring this next-generation infrastructure to a global audience. For more information, visit https://stability.ai.
About WEKA
WEKA is leading a paradigm shift in how data is stored, managed, and processed in the cloud and AI era. The WEKA Data Platform is a software solution transforming stagnant data silos into dynamic data pipelines that power GPUs efficiently and fuel performance-intensive workloads seamlessly and sustainably. Its advanced cloud-native architecture is optimized to solve complex data challenges at scale, delivering 10-100x performance improvements across edge, core, cloud, hybrid and multicloud environments. WEKA helps the world’s leading data-driven organizations accelerate research and discovery breakthroughs and business outcomes – including eight of the Fortune 50. The company operates in over 20 countries globally and is backed by dozens of world-class investors. For more information, visit www.weka.io.
Source: WEKA
