Qualcomm CEO Cristiano Amon highlighted the next phase for generative AI, emphasizing its shift to consumer electronics devices during a keynote speech at CES 2024. Amon described this stage as the "second inning" in the development of generative AI, envisioning large language models operating on devices like smartphones.
Amon explained that this shift involves AI models running pervasively on smartphones, utilizing data from the device to continuously learn and predict user behavior. This on-device approach allows for a personalized AI assistant tailored to an individual's life, leveraging information such as location, behaviors, and personal preferences.
In the cloud, generative AI lacks access to specific personal details. However, Amon emphasized the potential of an on-device AI that could interpret user queries, offering real-time suggestions and assistance. For example, if a user texts a friend about getting together, the AI could check availability and suggest venues based on past locations visited. The on-device AI aims to provide transformative and instantaneous assistance while maintaining user privacy.
Amon introduced Qualcomm's X Elite PC platform, featuring the Oryon CPU capable of running generative AI models with up to 13 billion parameters on the device. This platform is expected to power PCs shipping from manufacturers in mid-2024. Amon noted that this on-device generative AI is a significant advancement, especially in collaboration with Microsoft to build next-generation PCs.
The X Elite PCs are equipped to run Microsoft's generative AI assistant, Copilot, marking a shift toward a more AI-centric and Copilot-oriented Windows experience. Amon positioned the X Elite platform as instrumental in delivering this next-generation Windows experience to consumers, emphasizing the transformative potential of on-device generative AI.
