Everything Augmented: On the Real in Augmented Reality

Hanna Schraffenberger; Edwin van der Heide

doi:10.7559/citarj.v6i1.125

Hanna Schraffenberger Media Technology Research Group, LIACS, Leiden University
Edwin van der Heide Media Technology Research Group, LIACS, Leiden University & Studio Edwin van der Heide, Rotterdam

DOI: https://doi.org/10.7559/citarj.v6i1.125

Keywords: Augmented Reality, Augmentation, Real, Virtual, Media Art, Media Theory, Perception, Interaction

Abstract

What is augmented in Augmented Reality (AR)? In this paper, we review existing opinions and show how little consensus exists on this matter. Subsequently, we approach the question from a theoretical and technology-independent perspective. We identify spatial and content-based relationships between the virtual and the real as being decisive for AR and come to the conclusion that virtual content augments that to which it relates. Subsequently, we categorize different forms of AR based on what is augmented. We distinguish between augmented environments, augmented objects, augmented humans and augmented content and consider the possibility of augmented perception. The categories are illustrated with AR (art) works and conceptual differences between them are pointed out. Moreover, we discuss what the real contributes to AR and how it can shape (future) AR experiences. A summary of our findings and suggestions for future research and practice, such as research into multimodal and crossmodal AR, conclude the paper.

Author Biographies

Hanna Schraffenberger, Media Technology Research Group, LIACS, Leiden University

Hanna Schraffenberger is a PhD student and researcher at the Media Technology Research Group at Leiden University. Her research interests include interactivity, interactive art and Augmented Reality. She is particularly interested in multimodal Augmented Reality and its applications in the arts. Besides doing research, Hanna is interested in communicating scientific topics to a broader public. She is the Editor-in-Chief of AR[t], an inspiring magazine series about Augmented Reality, art and technology.

Edwin van der Heide, Media Technology Research Group, LIACS, Leiden University & Studio Edwin van der Heide, Rotterdam

Edwin van der Heide is an artist and researcher in the field of sound, space and interaction. He extends the terms composition and musical language into spatial, interactive and interdisciplinary directions. His work comprises installations, performances and environments. In his pieces, the audience members are placed in the middle of the work and challenged to actively explore, interact and relate themselves to the artwork. Besides running his own studio, he is a part-time Assistant Professor at Leiden University (Media Technology MSc programme) and heading the Spatial Interaction Lab at the ArtScience Interfaculty of the Royal Conservatoire and Royal Academy of Art in the Hague.

References

Archer, N. (2010, February 14). Augmented Reality Tattoo . Designboom. Retrieved October 7, 2014, from http://www.designboom.com/technology/augmented-reality-tattoo/

Augmented reality. (2014, May 10). Wikipedia. Retrieved October 7, 2014, from http://en.wikipedia.org/wiki/Augmented_reality

Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.

Billinghurst, M., Kato, H., & Poupyrev, I. (2001). The magicbook-moving seamlessly between reality and virtuality. Computer Graphics and Applications, IEEE, 21(3), 6-8.

Craig, A. B. (2013). Understanding Augmented Reality: Concepts and Applications. Newnes.

Erens, C. (n.d.). The Audible Space. Cilia Erens. Retrieved October 7, 2014, from http://www.cilia-erens.nl/cilia-erens-2/

Erens, C. (2006). Hollands Doorzicht [sound walk], see http://www.cilia-erens.nl/portfolio-2/hollands-doorzicht-berlijn-2006/?lang=en, accessed October 7, 2014.

Gómez-Maureira, M. A., Teunisse, C., Schraffenberger, H., & Verbeek, F. (2014). Illuminating Shadows: Introducing Shadow Interaction in Spatial Augmented Reality. Creating the Difference, Proceedings of the Chi Sparks 2014 Conference 9 (pp. 11-18).

Gradman, E. (2010). Cloud Mirror [interactive art installation], see http://www.gradman.com/cloudmirror, accessed October 7, 2014.

Harrison, C., Tan, D., & Morris, D. (2010, April). Skinput: appropriating the body as an input surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 453-462).

van der Heide, E. (2000-). Radioscape [immersive electromagnetic environment], see http://www.evdh.net/radioscape/, accessed October 7, 2014.

van der Heide, E., & Rekveld, J. (Curators). (2008-2009). Wormhole Dordrecht [sound worlds in public space], see http://www.evdh.net/wormhole/, accessed October 7, 2014.

van der Heide, E. (2014). Radioscape, Wormhole Dordrecht and Beyond. AR[t], Augmented Reality, Art and Technology, 5, 97-99.

Hugues, O., Fuchs, P., & Nannipieri, O. (2011). New augmented reality taxonomy: Technologies and features of augmented environment. In Handbook of augmented reality (pp. 47-63). Springer New York. http://dx.doi.org/10.1007/978-1-4614-0064-6_2

Mackay, W. E. (1996). Augmenting reality: A new paradigm for interacting with computers. La recherche, 284. (Accessed at http://www-ihm.lri.fr/~mackay/pdffiles/LaRecherche.English.pdf, 1-9).

Manovich, L. (2006). The poetics of augmented space. Visual Communication, 5(2), 219-240. http://dx.doi.org/10.1177/1470357206065527

Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE TRANSACTIONS on Information and Systems, 77(12), 1321-1329.

Nagel, S. K., Carl, C., Kringe, T., Märtin, R., & König, P. (2005). Beyond sensory substitution—learning the sixth sense. Journal of neural engineering, 2(4), R13-R26. http://dx.doi.org/10.1088/1741-2560/2/4/R02

Normand, J. M., Servières, M., & Moreau, G. (2012, March). A new typology of augmented reality applications. In Proceedings of the 3rd Augmented Human International Conference (p. 18). http://dx.doi.org/10.1145/2160125.2160143

Ross, C. (2005). New Media Arts Hybridity: The Vases (Dis)communicants Between Art, Affective Science and AR Technology. Convergence: The International Journal of Research into New Media Technologies, 11(4), 32-42. http://dx.doi.org/10.1177//1354856505061051

Sandor, C., Cunningham, A., Dey, A., & Mattila, V. V. (2010, October). An augmented reality x-ray system based on visual saliency. In ISMAR 2010 (pp. 27-36).

Scherrer, C., Pilet, J., Fua, P., & Lepetit, V. (2008). The haunted book. In ISMAR 2008 (pp. 163-164).

Schraffenberger, H., & van der Heide, E. (2013a). Towards Novel Relationships between the Virtual and the Real in Augmented Reality. In ArtsIT 2013, LNICST 116 (pp. 73-80).

Schraffenberger, H., & van der Heide, E. (2013b). From coexistence to interaction: influences between the virtual and the real in augmented reality. In Proceedings 19th International Symposium of Electronic Art, ISEA2013 (pp. 1-3).

Schraffenberger, H., & van der Heide, E. (2014). The Real in Augmented Reality. In Proceedings of the Second Conference on Computation, Communication, Aesthetics and X, xCoAx 2014 (pp. 64-74).

Valbuena, P. (2008). N 520437 E 041900 [the hague city hall] [site-specific large scale intervention], see http://www.pablovalbuena.com/selectedwork/n-520437-e-041900/, accessed October 7, 2014.

Verlinden, J.C., de Smit, A., Peeters, A.W.J., van Gelderen, M.H. (2003). Development of a flexible augmented prototyping system. Journal of WSCG, 11(3), 496–503.

Walker, W. F. (1997, March). A computer participant in musical improvisation. In CHI 97 (pp. 123-130).

Zhou, F., Duh, H. B. L., & Billinghurst, M. (2008). Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. In ISMAR 2008 (pp. 193-202).