Large Language Models (LLMs) are being distributed across many devices and platforms. Having these models available on-device can help reduce the need for sending private data to cloud-hosted systems.

At the @w3c member meeting last month in #Hiroshima 🇯🇵, Chunhui Mo (Huawei) explored what it would take to expose these LLMs to #WebApps through a Web #API and the advantages it could bring in terms of #privacy, #security and #performance.

🎬 Watch the video: youtu.be/7S60LNBAFj0