Generative AI – Tiny Tutee Tactic Tutor
Facebook X-twitter Instagram Linkedin This blog is all about Optimizing Generative AI Models for Mobile. Generative Models are usually setup on large processing units and hence the access is via APIs or any kind of interfaces. Given the current trend of Mobile devices everywhere, the need for GenAI systems to be easily accessible has become an obvious requirement. While the research and trials are happening towards this, let’s take a peek in the details. Mobile devices and their fitment. First let’s have a look at what are the real constraints in executing AI Models in mobile devices. Constraints on Mobile Devices Mobile devices face several constraints when running AI models: Limited Computational Power: Mobile devices typically have less processing power compared to cloud servers. For instance, an iPhone with 6 GB of RAM or an Android device with up to 12 GB of RAM cannot match the capabilities of cloud servers