Covering Scientific & Technical AI | Sunday, December 22, 2024

SiMa.ai Expands ONE Platform for Edge AI with MLSoC Modalix 

SAN JOSE, Calif., Sept. 10, 2024 -- SiMa.ai, the software-centric, embedded edge machine learning system-on-chip (MLSoC) company, has announced MLSoC Modalix, the industry’s first multi-modal edge AI product family. SiMa.ai MLSoC Modalix supports CNNs, Transformers, LLMs, LMMs and Gen AI at the edge, and delivers industry leading performance – more than 10X the performance per watt of alternatives.

The rise of generative AI is changing the way humans and machines work together. The next wave of the AI technology revolution will advance multi-modal machines with the ability to understand and process multiple forms of inputs across text, image, audio and visual. This shift will ripple across every industry, from agriculture and logistics, to medicine, defense, transportation and more. SiMa.ai is the breakthrough multi-modal edge AI platform that organizations can now rely on for the ultra-responsive, power-efficient, reliable and secure insights their critical innovations demand – in any modality they prefer.

MLSoC Modalix will enable developers to push the envelope on performance with a small power envelope and physical footprint across a wide breadth of applications. They will be able to run end to end GenAI application-pipelines on just a single chip while delivering measurable contributions to business top and bottom lines.

SiMa.ai MLSoC Modalix is the second generation of the successful, commercially deployed first generation MLSoC. MLSoC Modalix is offered in 25 (Modalix 25 or “M25”), 50 (Modalix 50 or “M50”), 100 (Modalix 100 or “M100”) and 200 (Modalix 200 or “M200”) TOPS configurations, in multiple form factors, and is purpose-built to provide effortless deployment of Generative AI for the embedded edge ML market. Fully software compatible with first generation MLSoC, the MLSoC Modalix product family was designed to enable the capability to run DNNs, as well as advanced Transformer models, including LLMs, LMMs and Generative AI. Samples of MLSoC Modalix will be available to customers in Q4 of 2024.

“SiMa.ai is leading the edge AI market and building increasing momentum as customers around the world continue to adopt our (first generation) MLSoC. We are excited to introduce the MLSoC Modalix family to give customers even greater choice and flexibility to embrace multi-modal AI,” said Krishna Rangasayee, Founder and CEO at SiMa.ai. “With the introduction of MLSoC Modalix, SiMa.ai’s ONE Platform for Edge AI now provides coverage from CNNs to Gen AI and everything in between with industry leading performance and power efficiency.”

SiMa.ai Broadens ONE Platform for Edge AI with New MLSoC Modalix Family

SiMa.ai ONE Platform for Edge AI is a software-centric framework offering compatibility across the entire MLSoC platform family to provide a seamless experience for upgrades, transitions and mix-and-match, minimizing TCO for adopters of SiMa.ai at the edge.

First generation SiMa.ai MLSoC is a market leader in performance and power efficiency, validated most recently by MLCommons MLPerf Inference benchmark (4.0) results in March 2024. First generation SiMa.ai MLSoC will continue to support CNN-based models across Industrial Inspection, Retail, Aerospace and Defense, and Smart Vision (Ethernet-based cameras only).

Customers leveraging MLSoC Modalix will be able to accelerate deep learning, transformer, and Generative AI models - pushing the envelope on models like Llama2 7B to beyond 10 tokens per second. With an on-chip application processor, integrated ISP, vision and digital signal processors, and innovations like BF16 in the hardware, MLSoC Modalix will accelerate all known CNN and transformer models: language, vision and speech, delivering inference-accuracy close to fp32 at significantly lower cost and power.

Generative AI applications running on MLSoC Modalix will:

  • Benefit from the SiMa.ai Palette software patented Compiler with layered direct proactive data prefetch, ensuring each data layer is always available, on time, when it is needed;
  • Leverage the improved Machine Learning Accelerator to run DNNs and Large Multi-Modal Models at high performance without sacrificing power.

In addition new hardware components of MLSoC Modalix include:

  • An integrated ISP module supporting 4 x 4 lanes of MIPI CSI 2, allowing the chip to interface with MIPI cameras as well as Ethernet-based cameras via 4 x 10G Ethernet ports on-chip;
  • Eight lanes of PCIe Gen 5 facilitating quicker ingress and egress of data to and from the chip;
  • 8 Arm Cortex-A65 dual-threaded CPUs, further extending SiMa.ai’s reach to customers with specialized use cases through Arm’s unrivaled and diverse software partner ecosystem;
  • TSMC’s N6 technology.

“The launch of the SiMa.ai ONE Platform with the MLSoC Modalix family has the potential to be a great enabler for Elementary’s applications," said Arye Barnehama, CEO of Elementary. "Elementary is at the forefront of deploying AI-based vision inspection systems for global manufacturers dedicated to leading-edge innovation. The Modalix family's high performance and energy efficiency, coupled with the ONE Platform approach, aligns with our commitment to delivering modular, uncompromising solutions to both our partners and end users. As Elementary continues to scale in the industrial sector, the SiMa.ai MLSoC Modalix product family has the potential to power solutions that are integral to the high-speed production processes of global enterprises."

SiMa.ai is presenting at the AI Hardware & Edge AI Summit 2024, September 9-12, in San Jose, California. Stop by booth 10 to meet the SiMa.ai team or listen to SiMa.ai CEO Krishna Rangasayee at the summit on Monday, September 9, from 2:20-2:45 pm PT in a presentation about how MLSoC Modalix broadens the SiMa.ai ONE Platform for Edge AI. To learn more about SiMa.ai’s products, visit https://sima.ai/mlsoc.

About SiMa.ai

SiMa.ai is the software-centric, embedded edge machine learning system-on-chip (MLSoC) company. SiMa.ai’s hardware to software stack flexibly adjusts to any framework, network, model, sensor, or modality all in one platform. Edge ML applications that run completely on the SiMa.ai MLSoC see a tenfold increase in performance and energy efficiency, bringing higher fidelity intelligence to ML use cases spanning computer vision to generative AI, in minutes. With SiMa.ai, customers unlock new paths to revenue and significant cost savings to innovate at the edge across industrial manufacturing, retail, aerospace, defense, agriculture, and healthcare. SiMa.ai was founded in 2018, has raised $270M and is backed by Fidelity Management & Research Company, Maverick Capital, Point72, MSD Partners, VentureTech Alliance and more.


Source: SiMa.ai

AIwire