Apple CEO Tim Cook confidently stated that "Apple Intelligence" would be a game-changer. Recently, Apple unveiled "Apple Intelligence," which incorporates on-device AI technology, providing features like generative AI and ChatGPT. Apple also announced a partnership with OpenAI, planning to integrate ChatGPT into their voice assistant, Siri. Apple aims to expand AI applications, starting with Apple Intelligence.

On-device AI has become a crucial feature in the smartphone competition. Samsung's recently launched Galaxy S24, which includes on-device AI capabilities, has been a big hit. Despite stagnating smartphone sales, the shipment volume has significantly increased compared to the previous model, Galaxy S23. Additionally, Google has implemented on-device AI technology in its own Pixel 8 smartphones and Chinese brands like Xiaomi. On-device AI is also being applied to PCs, incorporating NPUs to create AI PCs. Unlike smartphones, AI PCs are designed with on-device AI technology suitable for work environments, enhancing productivity. The integration of on-device AI technology into our electronic devices seems to be an imminent future.

Domestic startups are actively developing on-device AI technology. One notable company is ZETIC.ai, led by CEO Yeonseok Kim. ZETIC.ai has developed ZETIC.Melange, an AI solution that enables the execution of on-device AI on mobile devices without the need for expensive GPU servers. This innovative technology has attracted investment (seed, undisclosed), and the company plans to use the funds to expand its workforce, including Android and iOS service developers and AI developers, to prepare for global market expansion.

Another active player in developing on-device AI solutions is AI solutions company Nota, led by CEO Myungsoo Chae. Nota has addressed the issues of certain nodes and hardware not supporting specific functions within on-device AI by applying appropriate AI models. This ensures optimal AI environments within on-device systems. Korea Advanced Institute of Science and Technology (KAIST), led by Professor Daeyoung Kim from the Department of Computer Science, has developed serverless computing technology that optimizes GPU resources by applying virtual GPU technology in a serverless computing environment. Efforts to advance on-device AI technology are actively underway across academia, industry, and research institutions.

The government is also actively supporting the development of on-device AI technology. The Ministry of SMEs and Startups is facilitating the "On-Device AI Gap Challenge," which aims to discover on-device AI startups. The challenge includes technical verification (PoC) and support from global expert companies like LG Electronics (devices), Intel (chipsets), and Microsoft (software). The government plans to further expand its support for on-device AI technology development.

BLT Patent & Law Firm's research center stated, "On-device AI technology presents new opportunities for companies." They added, "Securing rights for various technologies related to computing technology and resource allocation for on-device AI will be a good strategy."