Towards Augmented Reality Driven Human-City Interaction: Current Research on Mobile Headsets and Future Challenges

Interaction design for Augmented Reality (AR) is gaining attention from both academia and industry. This survey discusses 260 articles (68.8% of articles published between 2015–2019) to review the field of human interaction in connected cities with emphasis on augmented reality-driven interaction. We provide an overview of Human-City Interaction and related technological approaches, followed by reviewing the latest trends of information visualization, constrained interfaces, and embodied interaction for AR headsets. We highlight under-explored issues in interface design and input techniques that warrant further research and conjecture that AR with complementary Conversational User Interfaces (CUIs) is a crucial enabler for ubiquitous interaction with immersive systems in smart cities. Our work helps researchers understand the current potential and future needs of AR in Human-City Interaction.

Unpacking Non-Dualistic Design: The Soma Design Case

We report on a somaesthetic design workshop and the subsequent analytical work aiming to demystify what is entailed in a non-dualistic design stance on embodied interaction and why a first-person engagement is crucial to its unfoldings. However, as we will uncover through a detailed account of our process, these first-person engagements are deeply entangled with second- and third-person perspectives, sometimes even overlapping. The analysis furthermore reveals some strategies for bridging the body-mind divide by attending to our inner universe and dissolving or traversing dichotomies between inside and outside ; individual and social ; body and technology . By detailing the creative process, we show how soma design becomes a process of designing with and through kinesthetic experience, in turn letting us confront several dualisms that run like fault lines through HCI’s engagement with embodied interaction.

Brain-Computer Interfaces and Creative Expression: Interface Considerations for Rehabilitative and Therapeutic Interactions

By translating brain signals into new kinds of outputs, Brain-Computer Interface (BCI) systems hold tremendous potential as both transformative rehabilitation and communication tools. BCIs can be considered a unique technology, in that they are able to provide a direct link between the brain and the external environment. By affording users with opportunities for communication and self-expression, BCI systems serve as a bridge between abled-bodied and disabled users, in turn reducing existing barriers between these groups. This perspective piece explores the complex shifting relationship between neuroadaptive systems and humans by foregrounding personal experience and embodied interaction as concepts through which to evaluate digital environments cultivated through the design of BCI interfaces. To underscore the importance of fostering human-centered experiences through technologically mediated interactions, this work offers a conceptual framework through which the rehabilitative and therapeutic possibilities of BCI user-system engagement could be furthered. By inviting somatic analysis towards the design of BCI interfaces and incorporating tenets of creative arts therapies practices into hybrid navigation paradigms for self-expressive applications, this work highlights the need for examining individual technological interactions as sites with meaning-making potentiality, as well as those conceived through unique exchanges based on user-specific needs for communication. Designing BCI interfaces in ways that afford users with increased options for navigation, as well as with the ability to share subjective and collective experiences, helps to redefine existing boundaries of digital and physical user-system interactions and encourages the reimagining of these systems as novel digital health tools for recovery.

Bodies-in-Relation: Fine-Tuning Group-Directed Empathy

In this paper I analyze Alessandro Salice and Joona Taipale’s account of ‘group-directed empathy.’ I am highly sympathetic to Salice and Taipale’s account and intend this paper to be an endorsement of their project. However, I will argue that a more fine-grained account of group-directed empathy can be offered, and I seek to contribute to this discussion by outlining at least one way in which different types of group-directed empathy may be identified. I argue that while Salice and Taipale are right to claim that an account of group-directed empathy requires a corresponding account of ‘collective bodiliness,’ there is an important form of collective bodiliness that their account does not fully incorporate, namely embodied interaction between others. I argue that a closer look at the perceivability of interactions between others offers a richer and more complete account of how we can empathetically perceive shared emotions between groups of people.

Emergent Interfaces: Vague, Complex, Bespoke and Embodied Interaction between Humans and Computers

Most Human–Computer Interfaces are built on the paradigm of manipulating abstract representations. This can be limiting when computers are used in artistic performance or as mediators of social connection, where we rely on qualities of embodied thinking: intuition, context, resonance, ambiguity and fluidity. We explore an alternative approach to designing interaction that we call the emergent interface: interaction leveraging unsupervised machine learning to replace designed abstractions with contextually derived emergent representations. The approach offers opportunities to create interfaces bespoke to a single individual, to continually evolve and adapt the interface in line with that individual’s needs and affordances, and to bridge more deeply with the complex and imprecise interaction that defines much of our non-digital communication. We explore this approach through artistic research rooted in music, dance and AI with the partially emergent system Sonified Body. The system maps the moving body into sound using an emergent representation of the body derived from a corpus of improvised movement from the first author. We explore this system in a residency with three dancers. We reflect on the broader implications and challenges of this alternative way of thinking about interaction, and how far it may help users avoid being limited by the assumptions of a system’s designer.

Embodiment in 18th Century Depictions of Human-Machine Co-Creativity

Artificial intelligence has a rich history in literature; fiction has shaped how we view artificial agents and their capacities in the real world. This paper looks at embodied examples of human-machine co-creation from the literature of the Long 18th Century (1,650–1,850), examining how older depictions of creative machines could inform and inspire modern day research. The works are analyzed from the perspective of design fiction with special focus on the embodiment of the systems and the creativity exhibited by them. We find that the chosen examples highlight the importance of recognizing the environment as a major factor in human-machine co-creative processes and that some of the works seem to precede current examples of artificial systems reaching into our everyday lives. The examples present embodied interaction in a positive, creativity-oriented way, but also highlight ethical risks of human-machine co-creativity. Modern day perceptions of artificial systems and creativity can be limited to some extent by the technologies available; fictitious examples from centuries past allow us to examine such limitations using a Design Fiction approach. We conclude by deriving four guidelines for future research from our fictional examples: 1) explore unlikely embodiments; 2) think of situations, not systems; 3) be aware of the disjunction between action and appearance; and 4) consider the system as a situated moral agent.