Computing and Information Systems - Research Publications

Permanent URI for this collection

Search Results

Now showing 1 - 10 of 14
  • Item
    No Preview Available
    Understanding How to Administer Voice Surveys through Smart Speakers
    Wei, J ; Jiang, W ; Wang, C ; Yu, D ; Goncalves, J ; Dingler, T ; Kostakos, V (Association for Computing Machinery (ACM), 2022-11-11)
    Smart speakers have become exceedingly popular and entered many people's homes due to their ability to engage users with natural conversations. Researchers have also looked into using smart speakers as an interface to collect self-reported health data through conversations. Responding to surveys prompted by smart speakers requires users to listen to questions and answer in voice without any visual stimuli. Compared to traditional web-based surveys, where users can see questions and answers visually, voice surveys may be more cognitively challenging. Therefore, to collect reliable survey data, it is important to understand what types of questions are suitable to be administered by smart speakers. We selected five common survey questionnaires and deployed them as voice surveys and web surveys in a within-subject study. Our 24 participants answered questions using voice and web questionnaires in one session. They then repeated the same study session after 1 week to provide a "retest'' response. Our results suggest that voice surveys have comparable reliability to web surveys. We find that, when using 5-point or 7-point scales, voice surveys take about twice as long as web surveys. Based on objective measurements, such as response agreement and test-retest reliability, and subjective evaluations of user experience, we recommend that researchers consider adopting the binary scale and 5-point numerical scales for voice surveys on smart speakers.
  • Item
    No Preview Available
    Emotion trajectories in smartphone use: Towards recognizing emotion regulation in-the-wild
    Tag, B ; Sarsenbayeva, Z ; Cox, AL ; Wadley, G ; Goncalves, J ; Kostakos, V (ACADEMIC PRESS LTD- ELSEVIER SCIENCE LTD, 2022-10)
  • Item
    No Preview Available
    Impact of the global pandemic upon young people's use of technology for emotion regulation
    Tag, B ; van Berkel, N ; Vargo, AW ; Sarsenbayeva, Z ; Colasante, T ; Wadley, G ; Webber, S ; Smith, W ; Koval, P ; Hollenstein, T ; Goncalves, J ; Kostakos, V (ELSEVIER, 2022-05)
  • Item
    Thumbnail Image
    A System for Computational Assessment of Hand Hygiene Techniques
    Wang, C ; Jiang, W ; Yang, K ; Sarsenbayeva, Z ; Tag, B ; Dingler, T ; Goncalves, J ; Kostakos, V (SPRINGER, 2022-05-06)
    The World Health Organization (WHO) recommends a six-step hand hygiene technique. Although multiple studies have reported that this technique yields inadequate skin coverage outcomes, they have relied on manual labeling that provided low-resolution estimations of skin coverage outcomes. We have developed a computational system to precisely quantify hand hygiene outcomes and provide high-resolution skin coverage visualizations, thereby improving hygiene techniques. We identified frequently untreated areas located at the dorsal side of the hands around the abductor digiti minimi and the first dorsal interosseous. We also estimated that excluding Steps 3, 6R, and 6L from the six-step hand hygiene technique leads to cumulative coverage loss of less than 1%, indicating the potential redundancy of these steps. Our study demonstrates that the six-step hand hygiene technique could be improved to reduce the untreated areas and remove potentially redundant steps. Furthermore, our system can be used to computationally validate new proposed techniques, and help optimise hand hygiene procedures.
  • Item
    Thumbnail Image
    Electronic Monitoring Systems for Hand Hygiene: Systematic Review of Technology
    Wang, C ; Jiang, W ; Yang, K ; Yu, D ; Newn, J ; Sarsenbayeva, Z ; Goncalves, J ; Kostakos, V (JMIR PUBLICATIONS, INC, 2021-11-01)
    BACKGROUND: Hand hygiene is one of the most effective ways of preventing health care-associated infections and reducing their transmission. Owing to recent advances in sensing technologies, electronic hand hygiene monitoring systems have been integrated into the daily routines of health care workers to measure their hand hygiene compliance and quality. OBJECTIVE: This review aims to summarize the latest technologies adopted in electronic hand hygiene monitoring systems and discuss the capabilities and limitations of these systems. METHODS: A systematic search of PubMed, ACM Digital Library, and IEEE Xplore Digital Library was performed following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Studies were initially screened and assessed independently by the 2 authors, and disagreements between them were further summarized and resolved by discussion with the senior author. RESULTS: In total, 1035 publications were retrieved by the search queries; of the 1035 papers, 89 (8.60%) fulfilled the eligibility criteria and were retained for review. In summary, 73 studies used electronic monitoring systems to monitor hand hygiene compliance, including application-assisted direct observation (5/73, 7%), camera-assisted observation (10/73, 14%), sensor-assisted observation (29/73, 40%), and real-time locating system (32/73, 44%). A total of 21 studies evaluated hand hygiene quality, consisting of compliance with the World Health Organization 6-step hand hygiene techniques (14/21, 67%) and surface coverage or illumination reduction of fluorescent substances (7/21, 33%). CONCLUSIONS: Electronic hand hygiene monitoring systems face issues of accuracy, data integration, privacy and confidentiality, usability, associated costs, and infrastructure improvements. Moreover, this review found that standardized measurement tools to evaluate system performance are lacking; thus, future research is needed to establish standardized metrics to measure system performance differences among electronic hand hygiene monitoring systems. Furthermore, with sensing technologies and algorithms continually advancing, more research is needed on their implementation to improve system performance and address other hand hygiene-related issues.
  • Item
    Thumbnail Image
    Team Dynamics in Hospital Workflows: An Exploratory Study of a Smartphone Task Manager
    Hettiachchi, D ; Hayes, L ; Goncalves, J ; Kostakos, V (JMIR PUBLICATIONS, INC, 2021-08)
    BACKGROUND: Although convenient and reliable modern messaging apps like WhatsApp enable efficient communication among hospital staff, hospitals are now pivoting toward purpose-built structured communication apps for various reasons, including security and privacy concerns. However, there is limited understanding of how we can examine and improve hospital workflows using the data collected through such apps as an alternative to costly and challenging research methods like ethnography and patient record analysis. OBJECTIVE: We seek to identify whether the structure of the collected communication data provides insights into hospitals' workflows. Our analysis also aims to identify ways in which task management platforms can be improved and designed to better support clinical workflows. METHODS: We present an exploratory analysis of clinical task records collected over 22 months through a smartphone app that enables structured communication between staff to manage and execute clinical workflows. We collected over 300,000 task records between July 2018 and May 2020 completed by staff members including doctors, nurses, and pharmacists across all wards in an Australian hospital. RESULTS: We show that important insights into how teams function in a clinical setting can be readily drawn from task assignment data. Our analysis indicates that predefined labels such as urgency and task type are important and impact how tasks are accepted and completed. Our results show that both task sent-to-accepted (P<.001) and sent-to-completed (P<.001) times are significantly higher for routine tasks when compared to urgent tasks. We also show how task acceptance varies across teams and roles and that internal tasks are more efficiently managed than external tasks, possibly due to increased trust among team members. For example, task sent-to-accepted time (minutes) is significantly higher (P<.001) for external assignments (mean 22.10, SD 91.45) when compared to internal assignments (mean 19.03, SD 82.66). CONCLUSIONS: Smartphone-based task assignment apps can provide unique insights into team dynamics in clinical settings. These insights can be used to further improve how well these systems support clinical work and staff.
  • Item
    Thumbnail Image
    Quantifying the Effect of Social Presence on Online Social Conformity
    Wijenayake, S ; Van Berkel, N ; Kostakos, V ; Goncalves, J (ACM, 2020-05-28)
    Social conformity occurs when individuals in group settings change their personal opinion to be in agreement with the majority's position. While recent literature frequently reports on conformity in online group settings, the causes for online conformity are yet to be fully understood. This study aims to understand how social presencei.e., the sense of being connected to others via mediated communication, influences conformity among individuals placed in online groups while answering subjective and objective questions. Acknowledging its multifaceted nature, we investigate three aspects of online social presence: user representation (generic vs.user-specific avatars), interactivity (discussion vs.no discussion ), and response visibility (public vs.private ). Our results show an overall conformity rate of 30% and main effects from task objectivity, group size difference between the majority and the minority, and self-confidence on personal answer. Furthermore, we observe an interaction effect between interactivity and response visibility, such that conformity is highest in the presence of peer discussion and public responses, and lowest when these two elements are absent. We conclude with a discussion on the implications of our findings in designing online group settings, accounting for the effects of social presence on conformity.
  • Item
    Thumbnail Image
    Impact of contextual and personal determinants on online social conformity
    Wijenayake, S ; van Berkel, N ; Kostakos, V ; Goncalves, J (Elsevier, 2020-07-01)
    Despite decades of research concerning social conformity and its effects on face-to-face groups, it is yet to be comprehensively investigated in online contexts. In our work, we investigate the impact of contextual determinants (such as majority group size, the number of opposing minorities and their sizes, and the nature of the task) and personal determinants (such as self-confidence, personality and gender) on online social conformity. In order to achieve this, we deployed an online quiz with subjective and objective multiple-choice questions. For each question, participants provided their answer and self-reported confidence. Following this, they were shown a fabricated bar chart that positioned the participant either in the majority or minority, presenting the distribution of group answers across different answer options. Each question tested a unique group distribution in terms of the number of minorities against the majority and their corresponding group sizes. Subsequently, participants were given the opportunity to change their answer and reported confidence. Upon completing the quiz, participants undertook a personality test and participated in a semi-structured interview. Our results show that 78% of the participants conformed to the majority's answers at least once during the quiz. Further analysis reveals that the tendency to conform was significantly higher for objective questions, especially when a participant was unsure of their answer and faced an opposing majority with a significant size. While we saw no significant gender differences in conformity, participants with higher conscientiousness and neuroticism tended to conform more frequently than others. We conclude that online social conformity is a function of majority size, nature of the task, self-confidence and certain personality traits.
  • Item
    No Preview Available
    CrowdCog: A Cognitive Skill based System for Heterogeneous Task Assignment and Recommendation in Crowdsourcing
    Hettiachchi, D ; Van Berkel, N ; Kostakos, V ; Goncalves, J (Association for Computing Machinery, 2020-10-14)
    While crowd workers typically complete a variety of tasks in crowdsourcing platforms, there is no widely accepted method to successfully match workers to different types of tasks. Researchers have considered using worker demographics, behavioural traces, and prior task completion records to optimise task assignment. However, optimum task assignment remains a challenging research problem due to limitations of proposed approaches, which in turn can have a significant impact on the future of crowdsourcing. We present 'CrowdCog', an online dynamic system that performs both task assignment and task recommendations, by relying on fast-paced online cognitive tests to estimate worker performance across a variety of tasks. Our work extends prior work that highlights the effect of workers' cognitive ability on crowdsourcing task performance. Our study, deployed on Amazon Mechanical Turk, involved 574 workers and 983 HITs that span across four typical crowd tasks (Classification, Counting, Transcription, and Sentiment Analysis). Our results show that both our assignment method and recommendation method result in a significant performance increase (5% to 20%) as compared to a generic or random task assignment. Our findings pave the way for the use of quick cognitive tests to provide robust recommendations and assignments to crowd workers.
  • Item
    Thumbnail Image
    Effect of Conformity on Perceived Trustworthiness of News in Social Media
    Wijenayake, S ; Hettiachchi, D ; Hosio, S ; Kostakos, V ; Goncalves, J (IEEE COMPUTER SOC, 2021-01-01)
    A catalyst for the spread of fake news is the existence of comments that users make in support of, or against, such articles. In this article, we investigate whether critical and supportive comments can induce conformity in how readers perceive trustworthiness of news articles and respond to them. We find that individuals tend to conform to the majority's opinion of an article's trustworthiness (58%), especially when challenged by larger majorities who are critical of the article's credibility, or when less confident about their personal judgment. Moreover, we find that individuals who conform are more inclined to take action: To report articles they perceive as fake, and to comment on and share articles they perceive as real. We conclude with a discussion on the implications of our findings for mitigating the dispersion of fake news on social media.