27 September 2023

iOS 17 can suggest recipes for similar dishes from a photo on your iPhone

Start the conversation

Sarah Perez* says a range of new features has popped up on an Apple teaser page for iOS 17.

Apple didn’t announce any significant AI updates during its Worldwide Developers Conference keynote today, but it did quietly roll out some minor computer vision upgrades with its latest iPhone software, iOS 17.

In addition to now letting users turn their own photos into stickers by cutting out the subject of their photos, another new feature called Visual Look Up will allow users to search for recipes directly from a photo.

The addition wasn’t among those previewed during the keynote itself, but rather popped on a teaser page for iOS 17 on Apple’s website after the fact.

There isn’t much detail about how it will work, though it appears to be fairly straightforward from the looks of it.

In iOS 17, photos of food will be identified, and you’ll then be able to search for similar dishes.

For instance, in the photo illustrating this on the page, photos of bowls of quinoa lead to suggested recipes for other quinoa meals, and specifically breakfast foods, as shown in the photo.

If this works as described, it could be a handy way to get inspiration about what to cook, without having to search across the web, though it likely won’t be able to guide you to the specific recipe for the dish pictured.

The addition, however, is another example of how Apple is subtly redirecting users away from Google Search by having them start their queries directly on the iPhone.

In this case, the search results provided would link users to the recipe’s website, bypassing Google, while in years past Spotlight improvements saw users skipping a Google search to reach Wikipedia pages or to look up information on actors, movies, shows, and musicians from special cards that appear in Spotlight’s search results.

Spotlight’s only major update this year isn’t focused on web searches, though, but rather showcases something called “Top Hits” — or common app shortcuts — when you search for an app.

For instance, a search for Photos may suggest shortcuts like Recent or Favorites.

Elsewhere in iOS 17, the Visual Look Up improvements will allow users to pause videos to then look up information on the subject by tapping on an info icon.

The same tool will let you look up info on the subject that you cut out of your own photo — a feature introduced last year with iOS 16.

One of the more entertaining additions at the time, you can “pick up” an object from a photo with the press of your finger.

The system can identify pets, plants, landmarks, and other objects in your photos.

The image can then be pasted into a text message or in other applications.

With iOS 17, Apple will let you turn these cutouts into a sticker.

Through the new Live Stickers feature, users can cut out the subject of their own photos, or now, paused videos, to save as stickers, which can also include effects.

The stickers can then be accessed across iOS 17, including in third-party apps.

*Sarah Perez has worked as a reporter for TechCrunch since August 2011.

She joined the company after having previously spent over three years at ReadWriteWeb.

This article first appeared at techcrunch.com

Start the conversation

Be among the first to get all the Public Sector and Defence news and views that matter.

Subscribe now and receive the latest news, delivered free to your inbox.

By submitting your email address you are agreeing to Region Group's terms and conditions and privacy policy.