SVP Craig Federighi Explains how Apple Created Scribble for iPad

Scribble, a new iPadOS 14 feature, means users can handwrite almost any field and the device will convert it to typed text. Speaking with Popular Mechanics, Craig Federighi, Apple’s senior vice president of software engineering, explained how the company created the tool. It takes a much more complex approach than just scanning and analyzing existing handwriting.

Scribble for iPad – Different traits from different people

The first element is to understand the traits people make when they write. “When it comes to understanding [handwriting] shots, we do data collection. We find people all over the world and make them write things, ”Federighi explained. “We give them a pencil and make them write quickly, make them write slowly, write at an angle. All this variation. “This then goes further. According to the Apple executive, the company wanted the device to learn the traits that formed each letter.” If you understand the traits and how they went down, this can be used to clarify what was written. ” he said.

The statistical calculations that make the Scribble function work occur on the device, not in a data center. “It has to happen in real time, right now, on the device you’re holding. Which means that the computing power of the device must be such that it can perform that level of processing locally, “Fedirighi said.