Apple AI researchers have achieved a major breakthrough in deploying large language models (LLMs) on iPhones and other Apple devices with limited memory. This breakthrough involves an innovative flash memory utilization technique, allowing LLMs to function efficiently on devices with restricted memory capacity. The new technique cleverly uses flash memory to store the AI model’s data, overcoming the challenge of memory constraints. By employing windowing and row-column bundling techniques, the AI models can run up to twice the size of the iPhone’s available memory, resulting in significantly faster processing speeds. This breakthrough opens up new possibilities for future iPhones, including more advanced Siri capabilities, real-time language translation, and sophisticated AI-driven features in photography and augmented reality. It also sets the stage for iPhones to run complex AI assistants and chatbots on-device, expanding the applicability and accessibility of advanced LLMs in resource-limited environments.
Read the full story: MacRumors
How will Apple’s breakthrough in running large language models on iPhones impact the future of AI on mobile devices?
Share your opinion in the comments below..
