26

auto-setup-768x576.png

During the setup of a new iPhone 8 / iPhone 8 Plus / iPhone X, there is a step for migrating the settings from another iOS 11 device.

On the old device, it says:

Set Up New iPhone

Use your Apple ID "[email protected]" to set up your new iPhone.

On the new device, it says:

Quick Start

If you have an iPhone or iPad running iOS 11, bring it nearby to sign in automatically.

If you want, you can also set up this iPhone manually.

After tapping "Continue" on the old device, on the old device, it says:

Hold Your New iPhone Up to the Camera

Position the pattern in the circle

On the new device, it says:

Waiting for Other iPhone...

Position this image in the frame of your other iPhone.

A pattern of moving blue dots appears in the new device, as shown in this picture:

http://www.idownloadblog.com/2017/06/05/automatic-setup-feature-ios-11/

And in this video:

https://youtu.be/tHxhZu97pXc

I believe it works like QR code, but it is not. Does anybody know what the name of this technology is?

5
  • Did you get an answer for this? I've been looking for ways to implement a similar data visualization control but I have no idea how they did it.
    – damjandd
    Commented Feb 5, 2018 at 9:47
  • Sorry, I didn't. It seems that nobody cares about this fantastic technology! Commented Feb 5, 2018 at 10:06
  • 2
    Yeah, I know, there is virtually no info about it anywhere, and it's a shame, because it really is amazing. I have set a bounty on the question so maybe somebody will notice it now.
    – damjandd
    Commented Feb 5, 2018 at 11:08
  • I don't even know the name of this technology. But I guess instead of tracking the "positions", it tracks the "velocities". It is like a "second order QR code", which should be more secure and harder to replicate (you need a video instead of an image). I guess it is time-limited too, so the code only works in a certain period, and will expire. Commented Feb 5, 2018 at 11:49
  • @damjandd - Code level questions and bounties should be on Stack Overflow. I'll refund your bounty here due to that, but if you want to issue it again, feel free with the above caveat.
    – bmike
    Commented Feb 6, 2018 at 3:33

4 Answers 4

17

The technology can be thought of very much like an animated QR-code. The main principle of data encoding is very much like QR-codes, but obviously with the difference that as time goes forward, the displayed data changes as an animation.

In addition there seems to be the use of a neat trick with two different colors shown in quick alternation, which makes it possible for Apple to "hide" or make less obvious the clues that are used for the receiver of the data to synchronize with the signal (i.e. figure out where the boundaries of the encoded data is).

With a traditional QR code these sync markers are much more evident as they are big black square boxes with white borders that are set different places in the code to make it easy for the receiver to figure out what's encoded data, and what's not part of the code.

Much more details are available in these two patent applications by Apple:

US Patent 9,022,291 US Patent 9,022,292

3
  • This is a very nice look into the actual technology behind the code. Now only to find out how this thing was implemented, at least the UI part.
    – damjandd
    Commented Feb 5, 2018 at 13:18
  • So sad there seems to be no API available for the developers to implement the same thing. This function seems to be exclusive to Apple, and they just used it in one place - settings migration. Commented Feb 6, 2018 at 3:51
  • 1
    Actually they have used it more places - it is the same method used when pairing an Apple Watch for example. The functionality is not as such exclusive to Apple as any app could implement their own QR-code type system. For example Snapchat has its own type of code that looks different than everyone else.
    – jksoegaard
    Commented Feb 6, 2018 at 12:46
8

I skimmed the patents linked above and here’s my naive interpretation of the technology. It’s essentially a finely detailed QR code, or similar, but rather than using coloured squares, the information is encoded by rapidly alternating complimentary colours such that the human eye doesn’t notice. This also allows higher information density by allowing the subtleties of the particular alternating colours chosen to encode additional degrees of freedom. Neither the rounded density distribution nor the wandering, orbiting movement of the particles is mentioned in the patent, it might be just for aesthetics which would be an Apple thing to do. What is mentioned is that this code can be embedded into a background image (and presumably an animation), without the image appearing different to the human eye. I wonder how much of the spherical orbiting “galaxy” shape is just smoke and mirrors to give you something to point your camera at while the real magic happens invisibly? We need someone to film the code up close, with a high speed camera - the patent mentions a flicker rate of 60hz so any footage above 120fps should do the trick.

-2

Apple's proximity-based process for transferring data

Automatic Setup is Apple's proximity-based process for transferring data, settings, and content from an old device to a new one. You can use Automatic Setup on your iPhone, Apple Watch, or Apple TV.

Apple's Automatic Setup feature began as an easier way for users to set up the Apple TV with "tap-to-set-up," which let you use your iPhone's sensors to quickly connect to your Apple TV and automatically enter in data like an Apple ID and Wi-Fi network. Since then, the feature has evolved and expanded to cover not only the Apple TV, but new iPhone, iPad, and Apple Watch models as well.

Automatic Setup is great because it lets users skip much of the form-filling present in older versions of setting up new devices — you shouldn't have to manually enter Wi-Fi network names and passwords, Apple IDs, or settings from previous devices. It's also proximity-based, keeping that data secure by requiring you to physically have both old and new devices in the same location.

Apple uses a slightly different method to automatically set up each device, depending on whether it's an iPhone or iPad, Apple Watch, or Apple TV.

Visit this site for how different devices are setup.

1
  • 2
    As my origin question specified, I am looking for the technical details of the technology. It is not a "how to do this" kind of question. Instead, it is a "how Apple did this" kind of question. Commented Feb 6, 2018 at 3:39
-2

Could it be a lot simpler than assumed above? Maybe just basic image recognition, meaning it's the same image/animation for everyone/every phone. Not sure, but thinking something like the below;

We know the process starts with a bluetooth connection "bring your other device nearby". This tells us that there's a handshake and pairing between the new and current device. Once connected, the new device presents the image and asks the current device "are you seeing the image", (or maybe just the current device tells without being asked). If yes, start process.

There's likely some security challenges above that someone will realise. However, the animation etc does feel like smoke and mirrors.

1
  • I'm not sure how it goes today, as I didn't buy any phone since last year. In the original dialogues in iPhone 8 / iOS 11, it didn't have a screen for bluetooth. The dialogues mentioned in the question are already all the messages shown. As you mentioned, bluetooth may be used during the process, but I'm not sure. But one thing I'm sure is that the animation ISN'T the same for everyone. It definitely acts as a means to identify the device. Try migrating 2 devices at the same time at the same place, then you'll know what I mean. Please see other answers. Apple doesn't patent dumb things. Commented Oct 11 at 16:08

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .