The Philadelphia Inquirer was among the first, adding interactive features that bridged the print edition to a reader's smart device in 2012 (see News & Tech, May 2012). AR technology, although not as widely adopted as the industry may have envisioned it would be by now, continues to evolve and make inroads with newspaper publishers.
The New York Times in February became the latest newspaper to exploit AR when it rolled out immersive storytelling just in time for the Winter Olympics. Through a smartphone's camera, NYT has endeavored to make big things possible on a small screen and allow its readers to explore information in new ways.
The publisher's first AR-enabled article was a preview piece for the Winter Olympics in which readers were able to meet Olympic athletes, including figure skater Nathan Chen, big air snowboarder Anna Gasser and short track speed skater J.R. Celski. The feature allowed readers to
pause the athletes in mid-performance to get to know more about them.
"The Olympics project — a major collaboration among the newsroom, design and product staffs that I led, as NYT's director of immersive platforms — demonstrates one of AR's richest benefits: deepening the explanatory value of visual journalism," NYT's Graham Roberts told readers in February. "Scale, for example, is incredibly difficult to represent on your phone screen. By conjuring athletes as if they were in the room, scale is conveyed by the context of your surroundings."
Advertisers get involved
Olympic sponsor Ralph Lauren partnered with The Times for an AR experience that included Team USA ice dancers Maia and Alex Shibutani in AR modeling the official Ralph Lauren Team USA Opening Ceremony Parade uniforms.
The Ralph Lauren AR feature was produced by NYT Co.'s experiential design agency Fake Love, and marked the first AR experience from an advertiser to live inside the NYT app for iOS. NYT said it developed the AR experience leveraging Apple's ARKit, which is available to iPhone and iPad users with devices running iOS 11. The publisher said it will soon bring the AR experience to Android as well, and that it will be based on ARCore.
Roberts explained that rather than asking readers to interact with pinch-to-zoom, swipe, or click, the AR features ask readers to treat graphics as physical objects.
"If you want to see the form from another angle, you simply walk around to that area," he said. "If you want to see something up close, simply lean in to that spot. News becomes something you can see, literally, from all sides."
To that end, bringing Olympic athletes into AR required finding a way to capture them not only photographically, but also three-dimensionally. To do so, NYT created photo-real scans that could be viewed from any angle.
"We asked each athlete to demonstrate his or her form at specific moments," Roberts said.
He explained how Olympic skater Nathan Chen held a pose showing exactly how he positions his arms tightly to his body during his quads to allow an incredible speed of rotation. Team USA women's hockey player Alex Rigsby, meantime, showed NYT how she positions her pads to guard the net from a puck traveling at 70 miles per hour.
After getting these scans, the NYT team placed them into contextual settings.
"For example, placing Nathan Chen at the 20-inch height off the ground he would be midquad, based off photo reference and sometimes motion capture,” Roberts said. "In your space, this will truly be a distance of 20 inches because this is all true to scale."
Because interacting with AR is unfamiliar to most people, Robertson said the challenge of the project was developing an intuitive way to display information around these graphic features.
"Just as readers know how to read a text story on a phone because we're conditioned to read left to right, and from the top down, we decided to organize information around how one would naturally interact with a space, which is simply to walk around inside it," he said.
NYT will continue to leverage AR features in the future in a bid to remain on the cutting edge of innovation — and the industry will continue watching and launching its own AR features in order to better engage readers that increasingly expect these types of advancements in digital storytelling (see sidebar).
"There’s no question that these are early days for AR, but our work so far suggests that this emerging technology has real potential to help our readers experience the news differently, helping them understand the world more deeply," Steve Duenes, assistant masthead editor for NYT, said in a statement about the project.
Northern California paper launches AR
The Ledger Dispatch of Jackson, California, also harnessed the power of augmented reality to bring its pages to life in February. The publisher's interactive news initiative allows readers of the twice-weekly paper to use their smartphones to "see" trigger images in the newspaper and access a deeper level of content.
The Ledger Dispatch's AR experience is compatible with both iOS and Android devices. By downloading an app, readers simply hold their Android or iPhone over photos or blocks of text to launch the interactive experience. This is a similar AR project to what The Philadelphia Inquirer did back in 2012.
"With this tool, readers can use their newspaper as a launch pad to watch movie trailers, read the local crime log, shop for a new car, view the last few minutes of a high school basketball game, or just explore different dimensions of a news story," Jack Mitchell, publisher of the Ledger Dispatch, said in a statement. "The possibilities are endless. With just a smartphone, the traditional newspaper becomes a 21st Century interactive experience."
Mitchell said the technology also holds tremendous appeal for advertisers. With AR, advertisers can layer video, audio and other features behind an advertisement in the pages of the paper, enhancing their ability to woo customers, he said.
"We believe newspapers are the glue that holds communities together, and we know they are struggling," said Rich Hoffman, CEO of the Jackson Rancheria Band of Miwuk Indians, which owns the Ledger Dispatch.
"We think the AR experience can help newspapers win back readers, and we want to make this technology accessible to them on a wide scale."