MLCommons

Untether AI Reports High Throughput for PCIe Cards in MLPerf Benchmarks

TORONTO, Aug. 28, 2024 -- Untether AI, a leader in energy-centric AI inference acceleration, today announced its world-leading verified submission to the MLPerf Inference benchmarks, version 4.1. The speedAI 240 ...Full Article

MLPerf Training 4.0 – Nvidia Still King; Power and LLM Fine Tuning Added

There are really two stories packaged in the most recent MLPerf Training 4.0 results, released today. The first, of course, is the results. Nvidia (currently king of accelerated computing) wins ...Full Article

MLCommons and AI Verify to Collaborate on AI Safety Initiative

May 31, 2024 -- Today in Singapore, MLCommons and AI Verify signed a memorandum of intent to collaborate on developing a set of common safety testing benchmarks for generative ...Full Article

MLCommons Announces AI Safety v0.5 Proof of Concept

April 16, 2024 -- Today, the MLCommons AI Safety working group – a global group of industry technical experts, academic researchers, policy and standards representatives, and civil society advocates ...Full Article

New MLPerf Inference Benchmark Results Highlight the Rapid Growth of Generative AI Models

SAN FRANCISCO, March 27, 2024 -- Today, MLCommons announced new results from its industry-standard MLPerf Inference v4.0 benchmark suite, which delivers industry standard machine learning (ML) system performance benchmarking in ...Full Article

MLPerf Releases Latest Inference Results and New Storage Benchmark

MLCommons this week issued the results of its latest MLPerf Inference (v3.1) benchmark exercise. Nvidia was again the top performing accelerator, but Intel (Xeon CPU) and Habana (Gaudi1 and ...Full Article

MLPerf Training 3.0 Showcases LLM; Nvidia Dominates, Intel/Habana Also Impress

As promised, MLCommons added a large language model (based on GPT-3) to its MLPerf training suite (v3.0) and released the latest round of results yesterday. Only two chips took ...Full Article

MLPerf Inference 3.0 Highlights – Nvidia, Intel, Qualcomm and…ChatGPT

MLCommons today released the latest MLPerf Inferencing (v3.0) results for the datacenter and edge. While Nvidia continues to dominate the results – topping all performance categories – other companies ...Full Article

AI Modeling Reinvented: It’s Time to Shift to Better Data, Rather Than Just Building Better Models

For several years, AI model building has been centered on creating better models to further push the envelope of increased performance and broader AI capabilities in enterprise computing and ...Full Article