Developers will be able to integrate Microsoft's AI applications into their own apps through Copilot Runtime, which includes libraries with many AI APIs.
It's no secret that Microsoft has very high expectations for the AI applications it's bringing to Windows. The company wants developers to take full advantage of all the new and existing AI applications behind Windows 11, and has announced that Copilot Runtime will enable developers to use this AI in their own applications.
This runtime primarily ensures the smooth operation of the more than 40 AI models that Windows runs in the background. However, it also provides opportunities for developers who want to use Microsoft's AI applications in their own software. In the company's own words, this makes Windows “the most open platform for AI.”
Developers can use Windows AI features in their own apps
The Windows Copilot Runtime includes an API library that developers can integrate when developing their own apps, providing access to Windows AI applications and associated frameworks and toolchains (i.e. the set of utilities, debuggers, compilers, and other components required for software development).
With all this available on the device, developers can create applications with local AI, without relying on internet access or remote servers to process data. This approach leads to faster response times, better privacy and an overall better user experience, but it also requires high-performance hardware.
Hint: These major computer brands have already introduced their own Copilot+ PCs.
According to Pavan Davuluri, head of Microsoft's Windows and Surface division, developers can use Studio Effects, Live Captions Translations, OCR (document digitization), user activity recall, and the 3.3 billion parameter small language model Phi. It is said that it will be possible to use Silica. Among other things, through Copilot Runtime's API library. All of this will be available in his June, according to The Verge.
Studio Effects integrated into Whatsapp
For example, Meta already integrates Windows Studio Effects into WhatsApp, which makes it possible to blur the background and simulate constant eye contact on video calls (so the speaker appears to be looking at the audience, when in fact their eyes are focused on their notes).
Microsoft introduced the recall feature ahead of the Build conference. This feature allows Copilot+ PC to document and recall user activity through a semantic index that understands relationships between documents. Developers can use this technology to incorporate similar functionality into their own applications.
Microsoft says this will allow app users to pick up where they left off more quickly. “This integration will allow users to pick up where they left off within the app, increasing app engagement and improving the seamless flow of users between Windows and apps,” he Davuluri claimed. Masu.
Also read: Microsoft announces Copilot+ AI PC and Recall GenAI feature
