Quadric is a company that has developed a hardware/software architecture specifically designed for on-device machine learning inference. Their GPNPU is a licensable processor IP core that offers high ML inference performance and can run C++ code without the need for developers to partition application code between multiple processors. The GPNPU scales from 1 to 64 TOPs and supports scalar, vector, and matrix code seamlessly.