Xiaomi Releases Xuanjie O100 Chip, With the Highest Edge-side Large Model Inference Speed of 330 TPS
Xiaomi unveiled its first on-device LLM AI accelerator chip, Xuanjie O100. Built on 6nm wafer-level vertical stacking and hybrid bonding with 1.4μm pitch, it delivers 1.22TB/s bandwidth—16x that of flagship phones—and up to 330 TPS inference, boosting on-device LLM throughput and reasoning.....
27.1K