BitNet 1.58-bit support is a different quantisation regime rather than simply a smaller integer, and a separate compute-in-memory block shifts the pitch from peak throughput to running a model continuously at very low power. A 128K on-device context is a step change over the previous generation. Treat the circulating 100 TOPS figure with care: it is attributed to MediaTek by a third party but appears nowhere in MediaTek’s own press release, product page, blog or launch infographic, and no one states its precision.
MediaTek Dimensity 9500
Two genuine firsts: hardware support for 1.58-bit ternary models, and a compute-in-memory NPU for always-on work.