Co-founders behind Reface and Prisma join hands to improve on-device model inference with Mirai

Mirai, a London-based startup founded by the co-founders of Reface and Prisma, is developing technology to improve how AI models run on devices like phones and laptops rather than in cloud data centers. The company has built an inference engine (the part of software that runs AI models) for Apple Silicon written in Rust that claims to speed up model generation by up to 37%, and is creating an SDK (software development kit, a package of tools for developers) so app creators can integrate this technology with just a few lines of code. To handle tasks that can't be done on-device, Mirai is also building an orchestration layer (a system that directs requests) to send complex work to the cloud when needed.