Hello,

We noticed you're browsing in private or incognito mode.

To continue reading this article, please exit incognito mode or log in.

Not a subscriber? Subscribe now for unlimited access to online articles.

A View from Kristina Bjoran

Augmenting Reality with Poetry

Readers can hold a physical book of images and a web-based application to create 3-dimensional poems.

  • June 23, 2011

The increasing prevalence of e-readers has left many wondering where the future of the book is headed. Some even preemptively mourn the tangible book, with a pressing nostalgia for the classic book-reading experience.

Credit: Amaranth Borsuk

But others see ubiquitous technology as a means of appending the book-reading experience, rather than replacing it altogether. “While some bemoan the death of the book, I saw in augmented reality the possibility for page and screen to coexist,” says Amaranth Borsuk, a Mellon Postdoctoral Fellow in Comparative Media Studies at MIT. After studying the role of books in the digital age, her project Between Page and Screen was born—and it can only be described as a novel experience.

Between Page and Screen has three prime components. The first is the physical book, hard-covered and filled with large, geometric images rather than words. The second component is a computer, equipped with a Web camera.

Credit: Amaranth Borsuk

The third, and final, component is an almost liminal space, the augmented reality that springs to life “between” the book and the screen. Once the reader goes to the accompanying website, she must then hold the book at an angle—almost extending the book forward like an offering, so the webcam can register the chunky geometric image. What happens next is seen in the image above. A simulated 3-dimensional poem or object appears and moves when the reader moves the book, creating an engaging experience. Between Page and Screen documents the exchange of cryptic letters between two lovers, “P” and “S.”

Interactive literature isn’t a new idea; fans of the Goosebumps series might recall “Choose Your Own Adventure”—type stories that represented an earlier kind of interactive fiction. What is novel about Between Page and Screen is the way it integrates technology so that the book and website can’t be meaningful without the other.

Borsuk and her partner, interactive application developer Brad Bouse, are now working on other literary-technological projects, including one involving the Microsoft Kinect and another interactive book that features “mutating poems.”

“For me the relationship between form and content is paramount,” Borsuk says. “Rather than interaction for its own sake, I would like to create work that calls out for its medium.”

Keep up with the latest in intelligent machines at EmTech Digital.

The Countdown has begun.
March 25-26, 2019
San Francisco, CA

Register now
More from Intelligent Machines

Artificial intelligence and robots are transforming how we work and live.

Want more award-winning journalism? Subscribe to Print + All Access Digital.
  • Print + All Access Digital {! insider.prices.print_digital !}*

    {! insider.display.menuOptionsLabel !}

    The best of MIT Technology Review in print and online, plus unlimited access to our online archive, an ad-free web experience, discounts to MIT Technology Review events, and The Download delivered to your email in-box each weekday.

    See details+

    12-month subscription

    Unlimited access to all our daily online news and feature stories

    6 bi-monthly issues of print + digital magazine

    10% discount to MIT Technology Review events

    Access to entire PDF magazine archive dating back to 1899

    Ad-free website experience

    The Download: newsletter delivery each weekday to your inbox

    The MIT Technology Review App

/3
You've read of three free articles this month. for unlimited online access. You've read of three free articles this month. for unlimited online access. This is your last free article this month. for unlimited online access. You've read all your free articles this month. for unlimited online access. You've read of three free articles this month. for more, or for unlimited online access. for two more free articles, or for unlimited online access.