NPUs can’t do all of it, although. Whereas Gemini Nano is getting extra succesful, it will possibly’t compete with fashions that run on huge, high-wattage servers. That is likely to be why some AI options, just like the temporarily unavailable Each day Temporary, don’t do a lot on the Pixels. Magic Cue, which surfaces private information based mostly on display screen context, might be in the same place. Google now says that Magic Cue will get “much more useful” due to the Personal AI Compute system.
Credit score:
Ryan Whitwam
Magic Cue debuted on the Pixel 10, nevertheless it doesn’t do a lot but.
Credit score:
Ryan Whitwam
Google has additionally launched a Pixel feature drop at the moment, however there aren’t many new options of word (except you’ve been hankering for Depraved themes). As a part of the replace, Magic Cue will start utilizing the Personal AI Compute system to generate ideas. The extra highly effective mannequin may have the ability to tease out extra actionable particulars out of your information. Google additionally notes the Recorder app will have the ability to summarize in additional languages due to the safe cloud.
So what Google is saying right here is that extra of your information is being offloaded to the cloud in order that Magic Cue can generate helpful ideas, which might be a change. Since launch, we’ve solely seen Magic Cue seem a handful of instances, and it’s not providing something fascinating when it does.
There are nonetheless causes to make use of native AI, even when the cloud system has “the identical safety and privateness assurances,” as Google claims. An NPU provides superior latency as a result of your information doesn’t need to go anyplace, and it’s extra dependable, as AI options will nonetheless work with out an Web connection. Google believes this hybrid strategy is the way in which ahead for generative AI, which requires important processing even for seemingly easy duties. We are able to anticipate to see extra AI options reaching out to Google’s safe cloud quickly.
