Tuesday, August 16, 2016

How third-party apps integrate with Siri in iOS 10

How does Siri work with apps on iOS 10?

Siri's got a new bag of tricks in iOS 10, allowing her to integrate with and perform certain functions within third-party apps.

Apple's 2016 software updates — iOS 10, watchOS 3, tvOS 10, and macOS Sierra — are currently available as closed developer previews and as public betas for iPhone, iPad, and Mac. While the betas contain new features, they also contain pre-release bugs that can prevent the normal use of your iPhone, iPad, Apple Watch, Apple TV, or Mac, and are not intended for everyday use on a primary device. That's why we strongly recommend staying away from the developer previews, and using the public betas with caution. If you depend on your devices, wait for the final release this fall.

Can Siri control all my apps?

Siri won't work with every single app you download; you can't get her to launch your Angry Birds for you.

There are six types of apps that Siri will work with:

  • Ride booking apps: Uber, Lyft, etc.
  • Messaging apps
  • Photo and video apps – searching for photos or videos within a particular app
  • Payment apps – commands for paying or accepting payments via apps like Square Register or Square Cash
  • VoIP calling apps: Skype, WhatsApp, etc.
  • Workout apps

If you're not sure about an app, just try it. Ask Siri to find something for you in the app. If it works, great; if not, Siri will say, "I wish I could, but (app) hasn't set that up with me yet."

How does it work?

Apple has essentially taken all the complications of voice dictation and removed that burden from app developers.

Siri now accepts voice commands and decides whether it's something she can outsource to a third-party app or something she should take care of in iOS.

This means that you have a consistent voice command service at your beck and call; no trying to get various dictation apps to learn your habits.

The best part? So long as you're using one of the six types of apps mentioned above, they'll reply to Siri with "rich UI", which means you can do everything you want to do right in the Siri conversation – no need to jump into the app!

What does that mean for my privacy?

Do all these third party apps get to record the things you say and use them for nefarious targeted advertising?

Nope!

Since Siri is the one that's processing your voice commands, only Apple hears what you say; Siri is merely delegating and only sending out enough information to get the task taken care of – no more, no less.

What does this mean for the future of Siri?

For now, Siri integration is limited to ride booking, messaging, payment, VoIP, and workout apps, but Apple may one day open her up to many more popular app types.

For example, the only music streaming service that works with Siri right now is Apple Music. No podcasts apps (aside from Podcasts) presently work, nor do any email apps.

What would you like to see?

What apps would you like to see integrate with Siri? Are there any you use all the time that you think need some Siri love?

Sound off in the comments below!