Apple’s Live Texts With Custom AI Can Extract Texts From Images

Apple’s enlisted keynotes also include its Live Texts, a newly digitize method of extracting texts from an image. This tool appears to be a handy tool that converts handwritten recipes or photographed recipes into digitizing content.

In contrast, handwritten notes can also be converted into emails and messages, rather than manually typing texts word for word. Although this feature has reportedly existed on several other smartphone platform such as Samsung, and Android devices.

Still, Apple’s Live Texts seems more responsive than the similar tool other tech companies have used in previous years. The simplicity of this tool depicts the extraction of texts from images or camera roll folder in a click, then Live Texts does the rest.

Afterward, the texts on images can be copied, searched for, or suggest a dial, if it’s a mobile number contact — after your click. Nonetheless, Live Texts is powered by machine learning and artificial intelligence the tech company will rather term “on-device intelligence” or “deep neural networks.”

Apple’s Live Text also depicts its Privacy-first policy towards accessing artificial intelligence — this tool processes users’ commands directly on the device rather than send this data to the cloud to process the result data, according to WWDC announcement.

Apple also integrated its Live Text with its Spotlight search exclusive for iOS 15 platforms — this allows you to search for texts in images, focusing on media files located in the camera roll folder. By the time iOS 15 is released, users can also visually search for content to extract.

Visually searching for content to process via Live Text is similar to the tool Google developed and called ‘Lens’ — this same Google product is what the iPhone maker labeled as a Visual Look Up.

Still, Apple only dropped a hint about is Live Text during WWDC like it truly worth noting — according to the tech company’s vague presentation, Live Text can detect texts from “art, books, nature, pets, and landmarks,” that appears in photos.

This tool seems to be interesting and iPhone users are already anticipating testing the responsiveness of this app. The interest grows stronger as Apple initially integrated AI tech with its devices and software which makes information handier.

It worth noting that Apple’s Live Text is exclusive for its custom-built devices such as MacBooks, iPhones, and iPads. For now, Live Text can only detect seven languages, including, English, Italian, Espana, French, Portuguese, German, and both traditional and simplified Chinese languages.