Computing and Information Systems - Theses

Permanent URI for this collection

Search Results

Now showing 1 - 10 of 15
  • Item
    No Preview Available
    Reflected Reality: Augmented Reality Interaction with Mirror Reflections
    Zhou, Qiushi ( 2023-11)
    Mirror reflections enable a compelling visuomotor experience that allows people to simultaneously embody two spaces: through the physical body in front of the mirror and through the reflected body in the illusory space behind the mirror. This experience offers unique affordances for Augmented Reality (AR) interaction that leverages the natural human perception of the relationship between the two bodies. This thesis explores possibilities of AR interaction with mirror reflections through unpacking and investigating this relationship. Through a systematic literature review of Extended Reality interaction that is not from the first-person perspective (1PP), we identify opportunities for novel AR interaction techniques from second-person perspective (2PP) using the reflected body in the mirror (Article I). Following this, we contribute Reflected Reality: a design space for AR interaction with mirror reflections that covers interaction from different perspectives (1PP/2PP), using different spatial frames of reference (egocentric/allocentric), and under different perceptions of the use of the space in the mirror (as reflection/extension of the physical space) (Article II). Previous work and the evaluation results of reflected reality interaction suggest that most of its novel interaction affordances revolve around the physical and the reflected bodies in the egocentric spaces. Following this observation, we conduct two empirical studies to investigate how users perceive virtual object locations around their physical bodies through a target acquisition task (Article III), and to understand how users can perform bodily interaction using their reflected bodies in the mirror through a movement acquisition task following a virtual instructor (Article IV). Together, results from these studies provide a fundamental knowledge base for designing reflected reality interaction in different task scenarios. After investigating the spatial affordance of mirror reflections for AR interaction, this thesis further explores the affordance for embodied perception through the mediation of the reflected user. Intuiting from results of Article IV, we conduct a systematic review of dance and choreography in HCI that reveals opportunities for using AR with mirror reflections to mediate the integration of the visual presentation and kinaesthetic sensation of body movement (Article V). We present the findings and discussions from a series of workshops on dance improvisation with a prototype AR mirror, which reveals the affordance of a multi-layered embodied presence across the mirror perceived by dancers (Article VI). We conclude this thesis with a discussion that summarises the knowledge gained from the empirical studies, elucidates the implications of the design space and novel interaction techniques, and illuminates future research directions inspired by its empirical and theoretical implications.
  • Item
    Thumbnail Image
    Designing Proactive Smart Speakers and Their Application in Voice Surveys
    Wei, Jing ( 2023-05)
    Smart speakers are an emerging technology in recent years. They provide an interface that allows users to request information or control smart devices via natural languages. Most existing smart speakers exhibit a passive interaction mode. They need to be activated by voice commands first before acting upon user requests. This passive way of interaction limits the potential application scenarios of smart speakers. If smart speakers can proactively approach users, they can actively engage users through offering suggestions, sending well-timed reminders, and assisting users to collect self-reports for reflection by conversations. Hereby, this thesis investigates the implementation of proactive smart speakers and their use case in data collections through voice surveys. We build a proactive smart speaker prototype for this research and investigate the opportune moments and user perception of proactive interactions. We further explore the interaction errors and user obstacles with proactive smart speakers through an in-depth quantitative analysis of various in-situ interaction data. Drawing upon our own findings and prior work, we deploy voice surveys on smart speakers and evaluate the reliability and validity of different question types. Through building a proactive smart speaker prototype, evaluating user experience in the wild, and developing a voice survey application, this thesis presents findings from empirical data of proactive smart speaker and voice applications and discusses corresponding design implications.
  • Item
    Thumbnail Image
    Task assignment using worker cognitive ability and context to improve data quality in crowdsourcing
    Hettiachchi Mudiyanselage, Danula Eranjith ( 2021)
    While crowd work on crowdsourcing platforms is becoming prevalent, there exists no widely accepted method to successfully match workers to different types of tasks. Previous work has considered using worker demographics, behavioural traces, and prior task completion records to optimise task assignment. However, optimum task assignment remains a challenging research problem, since proposed approaches lack an awareness of workers' cognitive abilities and context. This thesis investigates and discusses how to use these key constructs for effective task assignment: workers' cognitive ability, and an understanding of the workers' context. Specifically, the thesis presents 'CrowdCog', a dynamic online system for task assignment and task recommendations, that uses fast-paced online cognitive tests to estimate worker performance across a variety of tasks. The proposed task assignment method can achieve significant data quality improvements compared to a baseline where workers select preferred tasks. Next, the thesis investigates how worker context can influence task acceptance, and it presents 'CrowdTasker', a voice-based crowdsourcing platform that provides an alternative form factor and modality to crowd workers. Our findings inform how to better design crowdsourcing platforms to facilitate effective task assignment and recommendation, which can benefit both workers and task requesters.
  • Item
    Thumbnail Image
    Supporting the User Experience of Running with Mixed Reality Stories
    Kan, Aleksandr ( 2019)
    Mixed reality stories (MRS) are stories designed to create a mixed reality experience with particular activities, such as running. A wide commercial success of a mixed reality stories designed for running suggested that such a format could provide unique benefits compared to other kinds of mixed reality systems. Yet little is known about how the user experience of running with mixed reality stories can be supported. This thesis aims to address this problem. To reach this aim I conducted three empirical qualitative studies. Study 1 explores the experience of running with an existing commercially successful mixed reality story. In this study, 11 participants ran with the MRS for three weeks and reported on their experience via semi-structured open-ended interviews before and after the trial, along with keeping a running diary throughout the study. The study helped to evaluate which aspects are most significant for constructing the user experience of MRS, how runners balance different aspects on the go, the importance of participants’ attitudes towards running, and also indicated that MRS format is different from both conventional audiobooks and traditional mixed reality systems. Study 2 focuses on how creative writers address running when working on the stories. During this study, three writers created three distinct stories with different approaches to connecting the physical and virtual worlds. Semi-structured discussions with the writers, along with the analysis of the stories they created helped to understand the differences between the approaches they used, and how writers repurpose familiar story mechanics for addressing running. Finally, Study 3 examines how runners perceive mixed reality stories. In it, 36 participants completed 45 runs with the three MRS created in the previous study. Similarly to Study 1, their experience was captured via semi-structured open-ended interviews after their runs. The findings of the study introduced four stages of story perception and revealed how such perceptions depend on participants’ personal relationships with running. Moreover, Study 3 validated, clarified, connected and extended findings from the first two studies, thus bringing the thesis to closure. Overall, this thesis addresses the gap in our understanding in how the user experience of running with mixed reality stories can be supported by clarifying how MRS are different from both traditional stories and other mixed reality systems, and how they enhance running by providing welcome distractions and by changing the meaning of the running. It suggests how runners balance different aspects of a complex experience by voluntarily engaging when it suits them. Finally, it breaks down the three most significant aspects of the MRS experience—running, story and MRS elements—to provide more understanding of how they work, and suggests how these insights could be used in practice.
  • Item
    Thumbnail Image
    Digital technologies and encounters with zoo animals
    Webber, Sarah Ellen ( 2019)
    Zoos worldwide are beginning to deploy digital technologies for both visitors and animals. Such installations include interactive signage for visitors and touchscreen computers for animal cognition research. Zoos present animals in carefully crafted settings, with the aim of inspiring visitors’ respect and concern for wildlife. However, little is known about the effects that digital technologies can have on visitors’ encounters with zoo animals. This thesis addresses this knowledge gap by investigating the design of digital technology that might support zoos in shaping visitors’ perceptions of animals. Through four studies, different methodological approaches are brought to bear on this question. This thesis commences by surveying the broader context of the zoo, through a first study which investigates digital technologies at a selected zoo. This case study examines the deployment and use of interactive systems against deeper themes relating to the zoo’s mission and exhibit design intentions. The outcomes of this study reveal tensions related to the introduction of digital displays within the naturalistic setting that zoos construct. The second study focuses on a particular design project to identify the special considerations relating to design of animal interactives, digital technologies to be used by zoo animals. Research through design approaches are adopted to examine the co-design of an interactive installation for use by orangutans. From this study emerge twelve considerations for designing animal interactives in zoos. These considerations respond to zoos’ visitor engagement strategies, animal interaction aims, and constraints associated with conducting iterative design in the zoo setting. The third study continues the trajectory of design, providing a formative evaluation of the animal interactive. This study, conducted as part of the design process, examines how the design intentions manifest in Study 2 were realised in visitors’ responses to the installation. Interviews conducted with visitors at the exhibit reveal a variety of cognitive and emotional forms of empathetic responses. Study 3 brings into focus the concept of belief in animal mind as a significant aspect of people’s responses to seeing animal interaction, motivating the subsequent evaluation of effects on perceptions of animal minds. The fourth study comprises a systematic evaluation of the effects of the animal interactive on visitors’ perceptions of animals. Study 4 combines qualitative methods to probe deeper notions of belief in animal mind, and quantitative methods to measure the effects of the animal interactive. This final study of the thesis entails a field experiment, to compare perceptions of visitors who witnessed use of the animal interactive to those of a control group who did not. In the final Discussion, four themes are developed which transect the studies. Addressing the social dimensions of animal-human-computer interaction, digital technology in naturalistic settings, anthropomorphism, and interactive design with animals, these themes respond to contemporary challenges for the field of animal-computer interaction.
  • Item
    Thumbnail Image
    Designing video-mediated technologies to cultivate indigenous knowledge over distance
    Awori, Kagonya ( 2017)
    Technology design influences what users know about the world, and how they construct that knowledge. This is especially true for technologies that underlie the communication and representation of information and knowledge. Relatedly, how designers understand and prioritise certain ways of knowing over others influences how technologies are designed for people within a given context. From these premises, this thesis investigates how video-mediated technologies may be designed to support transnationals in cultivating the indigenous knowledge (IK) of their homeland, while they live elsewhere in the world. Through three field studies between Australia and Kenya, this thesis investigates how digital technologies currently used by indigenous members support or alienate the cultivation of IK, and how the design of video-mediated communication technologies in particular can be grounded in indigenous ways of knowing. In Study 1, I conduct field interviews with 8 Kenyan transnationals in Melbourne, Australia about the practice of their indigenous culture while in the diaspora, and the role that current digital technologies play in supporting them to do so. Next in Study 2, I travel to Kenya to conduct a field study of 10 video-mediated sessions between rural elders and remotely-located youth. Based on findings from Study 1 and Study 2, I generate design themes that guide the design and evaluation of Study 3. Here, I investigate the use of the new medium of 360º video-conferencing to connect learners of indigenous knowledge in Australia, with elders in rural Kenya. Through findings from these studies, this thesis makes three contributions to technology research on indigenous knowledge. First, I propose a People-Place-Praxis lens as a productive conceptual framework in which to design for IK. The lens facilitates an understanding that aligns with indigenous ways of knowing; and motivates technology design in ways that support indigenous knowledge. Secondly, I demonstrate a way by which epicentres of indigenous knowledge can be extended through use of custom video-mediated sessions. This thesis makes explicit the need to design effective deployments of the technology, that is to design what I call ViMik sessions to effectively facilitate learners in the diaspora to cultivating IK from indigenous epicentres. Lastly, this thesis extends knowledge on how to enhance the experience of ViMik sessions for learners, over distance. The approach involves supporting an individual-yet-communal experience of the ViMik session, and mediating a sense of mobility for the learners at the remote indigenous location. This thesis concludes with opportunities for future research in this area.
  • Item
    Thumbnail Image
    Understanding the role of technology in supporting parent–child reunion
    KAZAKOS, KONSTANTINOS ( 2017)
    Parent–child reunion is one of the most prevalent yet less explored areas of family life. During reunions, parents and children can strengthen their bonds and reaffirm their ties. Earlier works on Human–Computer Interaction (HCI) have highlighted the value of digital technologies in supporting the parent–child relationship during physical separation or collocation, but little work has focused on parent–child reunion. This thesis investigates the role of digital technology in supporting a specific type of parent– child reunion: a reunion following separation for work-related reasons that has a pre-, upon and post-phase. This investigation was conducted with the participation of three types of families: academic, defence and mining. This thesis presents three studies that examined the role of digital technologies in supporting parent–child reunion. The first study focused on technological shortcomings of current technology use in parent–child reunion. This study found that current technologies lack certain elements of support during the anticipation to reunite in prereunion, the initial engagement upon reunion and the sharing of experiences in postreunion. The second study identified the interactional qualities of digital technologies that aim to support parent–child reunion that led to the design of Rendezvous—the first reunion-oriented artefact. The insights from this study emphasised the importance of stimulating co-creation in pre-reunion, motivating co-engagement upon reunion and inspiring co-sharing in post-reunion. The third study evaluated Rendezvous through its field deployment with the participation of academic and mining families. The findings demonstrated the significance of Rendezvous in supporting parent–child reunion by augmenting the anticipation to reunite in pre-reunion, heightening the initial engagement upon reunion and strengthening the experience of sharing in post-reunion. The knowledge generated by this thesis has three main contributions. First, it uncovers the necessity for digital technologies to support parent–child reunion by focusing on the anticipation in pre-reunion, the engagement upon reunion and the sharing of experiences in post-reunion. Second, the thesis calls attention to the merit of asynchronous technologies in supporting parent–child reunion. Finally, it expands the current knowledge by highlighting materiality and temporality as key design considerations for reunion-oriented technologies.
  • Item
    Thumbnail Image
    Designing digital memorials: commemorating the Black Saturday Bushfires
    Mori, Joji Cyrus ( 2015)
    Digital memorials are novel technologies used for commemorative purposes. There is a growing interest in their design amongst HCI researchers. Existing studies focus on commemorating deceased loved ones, where personal and familial remembrance is emphasised. However, there are fewer examples where digital memorials play a wider social and cultural role. Commemorating a war, terrorist attack, natural disaster or death of somebody of special significance such as a leader or even celebrity, are examples where commemoration extends beyond the personal and familial, and into broader social contexts. In these instances, it is likely that large numbers of people may wish to participate, from those with deeply personal reasons, to others with only a passing interest. This thesis examines the design of digital memorials for use in contexts where these diverse audiences come together in commemoration. This thesis presents three studies, in which commemoration following the Black Saturday bushfires was used as the setting for the research. The fires occurred in 2009 in Victoria, Australia. Asides the devastation caused to the natural environment, there were 173 fatalities and massive destruction caused to homes and other infrastructure. The first study was an exploratory study examining how people commemorated Black Saturday within the first two years after the fires. The findings extend current understandings of commemoration using technology by showing similarities between how people engage with physical and web-based memorials. The second study involved participants in fire-affected communities who were asked to generate design ideas for digital memorials to commemorate Black Saturday. The study contributed a novel craft-based approach to designing technology in the commemorative context. For the third study, a digital memorial was developed that included a website and internet-connected tablet computer app to commemorate the fourth anniversary of the fires. This technology was designed for both those within the fire-affected communities and those outside. The findings report on an evaluation of the experiences of those who engaged with the digital memorial. Selected findings from the three thesis studies are expressed as a set of five design considerations intended for future designers and researchers interested in digital memorials. These are: privacy, control and context collapse; considerations for symbolism and metaphoric representations; utilising physical locations; having sensitivity towards temporal patterns; and, designing for pace and asynchronicity.
  • Item
    Thumbnail Image
    Audience experience in domestic videogaming
    DOWNS, JOHN ( 2014)
    Videogames are frequently played socially, but not all participants actively play. Audience members observe gameplay, often participating and experiencing the game indirectly. While the existence of non-playing audience members has been previously acknowledged, there have been few attempts to understand what activities audience members engage in while watching videogames, or how their experience is affected by different aspects of the game and social situation. This thesis presents the first substantial body of empirical work on audience behaviour and experience in social videogaming sessions. Existing work was reviewed in a number of areas of literp.ature including the sociality of gameplay, the increasing role of physicality and physical actions in gameplay, and the role of audiences in HCI. Three studies were then conducted based on the research question: How do the sociality and physicality of videogaming sessions influence audience experience? An initial exploratory observational study (N = 6 families) examined the types of activities that audiences engage in while watching highly physical videogames in their homes. This study indicated that audience members can adopt a variety of ephemeral roles that provide them with opportunities to interact with one another, the players, and the game technology. Additionally, participants reported that the physicality of the gameplay heavily influenced their experience. The second study, a naturalistic experimental study (N = 134) consisted of a mixed-model analysis of the factors of game physicality and turn anticipation. Study 2 found that anticipation of a turn affects experience of both audience and player, and similarly found that highly physical games result in more positive audience experiences, although the relationship between physicality and experience is not straightforward. A third study, also an experiment (N = 24), examined the influence of game physicality and visual attention on audience experience within a mediated setting, and a cross-study comparison identified that there appears to be a strong interplay between social context and the experience of physicality. Overall, this thesis contributes an understanding of how sociality, physicality, and the interplay between the two can influence audience behaviour and experience. These findings can be used to inform the design of novel game and interactive experiences that incorporate physicality, turn anticipation, and opportunities for different types of participation in order to influence and enhance audience experience.
  • Item
    Thumbnail Image
    Indexing to situated interactions
    Paay, Jeni ( 2006-02)
    Computing is increasingly pervading the activities of our everyday lives: at work, at home, and out on the town. When designing these pervasive systems there is a need to better understand and incorporate the context of use and yet there are limited empirical investigations into what constitutes this context. The user’s physical and social situation is an important part of their context when operating in an urban environment and thus needs to be understood and included in the interaction design of context-aware pervasive computing. This thesis has combined ideas from human computer interaction (HCI) and architecture to investigate indexicality in interface design as an instrument for incorporating physical and social context of the built environment into context-aware pervasive computing. Indexicality in interface design is a new approach to designing HCI for pervasive computing that relies on knowledge of current context to implicitly communicate between system and user. It reduces the amount of information that needs to be explicitly displayed in the interface while maintaining the usefulness and understandability of the communication.