New ‘Test-Time Training’ method lets AI keep learning without exploding inference costs

By allowing models to actively update their weights during inference, Test-Time Training (TTT) creates a "compressed memory" ...
Business Wire

MLPerf Results Show Advances in Machine Learning Inference Performance and Efficiency

SAN FRANCISCO--(BUSINESS WIRE)--Today MLCommons™, an open engineering consortium, released new results for three MLPerf™ benchmark suites - Inference v2.0, Mobile v2.0, and Tiny v0.7. These three ...
Business Wire

MLPerf Inference Delivers Power Efficiency and Performance Gains

SAN FRANCISCO--(BUSINESS WIRE)--Today, MLCommons®, the leading open AI engineering consortium, announced new results from the industry-standard MLPerf™ Inference v3.0 and Mobile v3.0 benchmark suites, ...
insideHPC

MLCommons: Latest MLPerf AI Benchmark Results Show Machine Learning Inference Advances

SAN FRANCISCO – September 8, 2022 – Today, the open engineering consortium MLCommons announced results from MLPerf Inference v2.1, which analyzes the performance of inference — the application of a ...
Semiconductor Engineering

Mixed-Precision DL Inference, Co-Designed With HW Accelerator DPU (Intel)

A new technical paper titled “StruM: Structured Mixed Precision for Efficient Deep Learning Hardware Codesign” was published by Intel. “In this paper, we propose StruM, a novel structured ...