From Oversight to Insight: Transforming Cybersecurity Governance in BoardroomsCybersecurity governance is increasingly critical in a digital economy, with board directors playing a central role in shaping organisational resilience. Directors are pivotal in setting cybersecurity strategies and carrying fiduciary obligations that extend to digital risk oversight. This study examines the cybersecurity literacy and governance practices of Australian board directors through a qualitative interview study with 13 participants. Findings reveal a substantial gap in directors’ knowledge and confidence, undermining effective oversight and informed decision-making. This deficit limits their ability to interrogate risk reports, challenge assumptions, and steer investment in line with organisational resilience goals. In response, we propose a Board Cyber Governance Model that integrates targeted education, strategic interventions, and structured board–CISO engagement to improve governance capability. By situating cyber governance at the intersection of executive decision-making, risk perception, and digital security, this work contributes to human-computer interaction by highlighting socio-organisational challenges and offering actionable insights for stronger board-level engagement.2026TATooba Aamir et al.CSIROPrivacy by Design & User ControlPrivacy Perception & Decision-MakingCybersecurity Training & AwarenessCHI
New Enactions of Expertise: Software Engineers’ Evaluation and Demonstration of Coding Expertise with AI Coding Assistants AI coding assistants are changing how software engineers engage in coding work. This shift raises a key question: does the changing of coding work also alter how software engineers evaluate and demonstrate coding expertise? We explore this question through a simulated live coding interview involving two software engineers, one as evaluator and the other as candidate, with AI tools allowed. Participants continued to rely on familiar criteria but adjusted the evidence they sought, as AI assistants both introduced new forms of demonstrating expertise and obscured some established workflows. The importance of these evolving enactions varied with evaluators’ emphasis on implementation versus planning. Lacking a clear link to expertise, heightened productivity expectations created additional tensions around these evolving enactions. We conclude by discussing how extended enactions can be supported through AI-focused tools and training, and how tensions between diminished enactions and productivity call for collaborative attention.2026YJYeonju Jang et al.Cornell UniversityHuman-LLM CollaborationAI-Assisted Decision-Making & AutomationGenerative AI (Text, Image, Music, Video)CHI
Users’ Strategies for Ensuring Trust, Privacy, and Safety on Facebook Marketplace: Challenges and RecommendationsWe engaged in semi-structured interviews with Facebook Marketplace users to gain insights into their strategies for ensuring Trust, Privacy, and Safety (TPS). Our investigation uncovered a range of approaches participants employed. We discovered that users actively sought to convey their trustworthiness to other users while also assessing the trustworthiness of others. Furthermore, they took steps to safeguard their privacy by selectively sharing information and making thoughtful decisions regarding payments. Moreover, participants implemented various strategies to mitigate the risks of physical harm and financial losses, sometimes resulting in conflicting preferences between buyers and sellers. Drawing from these findings, we developed recommendations to aid users in evaluating others' trustworthiness, effectively communicating their own trustworthiness, achieving a more optimal balance between privacy and trust, and increasing awareness of potential risks associated with different payment methods.2025AMAzadeh Mokhberi et al.Trust, Safety, and Privacy in Online CommunitiesCSCW
Seeing the Sound: Supporting Musical Collaboration with Augmented RealityIn musical collaboration, digital musical instruments often hinder effective communication and engagement by restricting visibility and limiting gestural and non-verbal interactions. These challenges reduce musicians’ situational awareness and complicate cohesive performance. To address this, we developed a head-mounted augmented reality (AR) system to enhance collaborative musical experiences by visualising musicians’ hand movements, eye gaze positions, and instrument interactions in real-time. We conducted a user study involving four pairs of musicians performing live music using different AR interface configurations. The results suggest that the AR system can enhance situational awareness and assist collaboration, as reflected in questionnaire responses. Interviews indicated that real-time visualisations of bodily movements and interactions helped participants better understand the collaborative process and anticipate their collaborators’ actions. These findings point to the potential of AR-assisted visualisation to support creative collaboration by tailoring visual information to different needs. Future research could explore its application in broader contexts of real-time creative cooperation.2025YWYichen Wang et al.Social & Collaborative VRAR Navigation & Context AwarenessImmersion & Presence ResearchC&C
From Diagrams to Experience: Data Visceralisation of Ecosystem State-and-Transition Models in Virtual RealityCommunicating complex scientific concepts to non-experts is a persistent challenge. State-and-transition models (STMs), often shown as box-and-arrow diagrams, exemplify well this difficulty. This paper explores how virtual reality (VR) can make STMs more accessible. Using ecosystem STMs as a case study, we present a proof-of-concept system enabling users to viscerally experience model content. We followed a three-phased participatory design process: first, 2 ecology experts guided the development of a VR prototype. Next, 17 government environmental management professionals evaluated its utility and features. Finally, after refining the system, 12 VR researchers informed design considerations and improvements. Our findings provide practical insights for visualising STMs in VR and contribute to the emerging concept of "data visceralisation". We found this approach engages users and supports understanding of qualitative aspects of real-world phenomena. However, complex models like ecosystem STMs require creating accurate and extensive simulations. We conclude with a discussion for future directions.2025AGAdélaïde Genay et al.Medical & Scientific Data VisualizationContext-Aware ComputingDIS
Text-to-Image Generation for Vocabulary Learning Using the Keyword MethodThe 'keyword method' is an effective technique for learning vocabulary of a foreign language. It involves creating a memorable visual link between what a word means and what its pronunciation in a foreign language sounds like in the learner's native language. However, these memorable visual links remain implicit in the people's mind and are not easy to remember for a large number of words. To enhance the memorisation and recall of the vocabulary, we developed an application that combines the keyword method with text-to-image generators to externalise the memorable visual links into visuals. These visuals represent additional stimuli during the memorisation process. To explore the effectiveness of this approach we first run a pilot study to investigate how difficult it is to externalise the descriptions of mental visualisations of memorable links, by asking participants to write them down. We used these descriptions as prompts for text-to-image generator (DALL-E2) to convert them into images and asked participants to select their favourites. Next, we compared different text-to-image generators (DALL-E2, Midjourney, Stable and Latent Diffusion) to evaluate the perceived quality of the generated images by each. Despite heterogeneous results, participants mostly preferred images generated by DALL-E2, which was used also for the final study. In this study, we investigated whether providing such images enhances the retention of vocabulary being learned, compared to the keyword method alone. Our results indicate that people did not encounter difficulties describing their visualisations of memorable links and that providing corresponding images significantly increases memory retention.2025NANuwan T Attygalle et al.Generative AI (Text, Image, Music, Video)Intelligent Tutoring Systems & Learning AnalyticsIUI
Systemization of Knowledge (SoK): Goals, Coverage, and Evaluation in Cybersecurity and Privacy GamesThis paper systematized existing knowledge on cybersecurity and privacy game-based approaches, exploring their goals, scope, and evaluation methods. Our review of 93 academic papers revealed that these approaches serve multiple purposes and target diverse player types. We identified 11 key aspects of cybersecurity and privacy that these approaches addressed, such as threats, defensive strategies, and data privacy. Additionally, we analyzed the effectiveness evaluation methods of these approaches, emphasizing the connections between evaluation techniques, types of data used, and their alignment with the approaches' goals. We also summarized the aspects of user experience evaluated in the literature and the types of questions used to capture these experiences. Reflecting on these methods, we provide guidance for future research and practice in designing and evaluating game-based approaches. Finally, we identify key gaps and propose opportunities to enhance user understanding, foster adaptability, and address emerging cybersecurity and privacy challenges.2025YHYue Huang et al.CSIRO's Data61Accessible GamingCybersecurity Training & AwarenessDark Patterns RecognitionCHI
Vision-Based Multimodal Interfaces: A Survey and Taxonomy for Enhanced Context-Aware System DesignThe recent surge in artificial intelligence, particularly in multimodal processing technology, has advanced human-computer interaction, by altering how intelligent systems perceive, understand, and respond to contextual information (i.e., context awareness). Despite such advancements, there is a significant gap in comprehensive reviews examining these advances, especially from a multimodal data perspective, which is crucial for refining system design. This paper addresses a key aspect of this gap by conducting a systematic survey of data modality-driven Vision-based Multimodal Interfaces (VMIs). VMIs are essential for integrating multimodal data, enabling more precise interpretation of user intentions and complex interactions across physical and digital environments. Unlike previous task- or scenario-driven surveys, this study highlights the critical role of the visual modality in processing contextual information and facilitating multimodal interaction. Adopting a design framework moving from the whole to the details and back, it classifies VMIs across dimensions, providing insights for developing effective, context-aware systems.2025YHYongquan 'Owen' Hu et al.University of New South WalesContext-Aware ComputingUbiquitous ComputingCHI
Trust, Privacy, and Safety Factors Associated with Decision Making in P2P Markets Based on Social Networks: A Case Study of Facebook Marketplace in USA and CanadaAs peer-to-peer (P2P) marketplaces have grown rapidly, concerns related to trust, privacy, and safety (TPS) have also increased. While previous studies have explored these aspects in various P2P marketplaces, there has been limited research on Facebook Marketplace (FM), which is distinguished by dramatic growth and intricate entanglement with the Facebook social networking site (SNS). To address this knowledge gap, we conducted interviews with 42 FM users in the US and Canada, investigating TPS factors associated with trading decisions. We identified four categories of factors: pre-existing concerns, signals, interactions, and perceived benefits. We uncover the challenges arising from the interplay of these factors, offer design recommendations for SNS–based marketplaces like FM, and suggest directions for future research. Our study advances the understanding of decision-making processes in SNS–based marketplaces, informs future design improvements for such platforms, and ultimately contributes to a better user experience related to trust, privacy, and safety.2024AMAzadeh Mokhberi et al.The University of British ColumbiaPrivacy by Design & User ControlPrivacy Perception & Decision-MakingContent Moderation & Platform GovernanceCHI
Exploring Opportunities for Augmenting Homes to Support ExercisingAlthough exercising at home has benefits, it is not always engaging or motivating. Augmented Reality (AR) head-mounted displays (HMDs) offer the potential to make in-home exercising and exergaming more inclusive and immersive, but there is limited research investigating how such systems can be designed. We employed a participatory design approach involving semi-structured interviews to investigate how homes can be augmented to facilitate exercising experiences. We developed 10 recommendations for developing home-based exercising experiences using AR HMDs. Our results further contribute to the existing body of research on the use of AR for exercising, home applications, and everyday objects by presenting the first foundational study investigating the wide range of exercises that can be supported through AR HMDs in home environments and the different ways home elements may support these exercises, and laying the groundwork for future work developing home-based exergaming through AR HMDs to increase people's physical activity levels.2024MAMichelle Adiwangsa et al.Australian National UniversityAR Navigation & Context AwarenessFitness Tracking & Physical Activity MonitoringCHI
MicroCam: Leveraging Smartphone Microscope Camera for Context-Aware Contact Surface Sensing"The primary focus of this research is the discreet and subtle everyday contact interactions between mobile phones and their surrounding surfaces. Such interactions are anticipated to facilitate mobile context awareness, encompassing aspects such as dispensing medication updates, intelligently switching modes (e.g., silent mode), or initiating commands (e.g., deactivating an alarm). We introduce MicroCam, a contact-based sensing system that employs smartphone IMU data to detect the routine state of phone placement and utilizes a built-in microscope camera to capture intricate surface details. In particular, a natural dataset is collected to acquire authentic surface textures in situ for training and testing. Moreover, we optimize the deep neural network component of the algorithm, based on continual learning, to accurately discriminate between object categories (e.g., tables) and material constituents (e.g., wood). Experimental results highlight the superior accuracy, robustness and generalization of the proposed method. Lastly, we conducted a comprehensive discussion centered on our prototype, encompassing topics such as system performance and potential applications and scenarios." https://doi.org/10.1145/36109212023YHYongquan Hu et al.Context-Aware ComputingUbiquitous ComputingUbiComp
Iris: Passive Visible Light Positioning Using Light Spectral Information"We propose a novel Visible Light Positioning (VLP) method, called Iris, that leverages light spectral information (LSI) to localize individuals in a completely passive manner. This means that the user does not need to carry any device, and the existing lighting infrastructure remains unchanged. Our method uses a background subtraction approach to accurately detect changes in ambient LSI caused by human movement. Furthermore, we design a Convolutional Neural Network (CNN) capable of learning and predicting user locations from the LSI change data. To validate our approach, we implemented a prototype of Iris using a commercial-off-the-shelf light spectral sensor and conducted experiments in two typical real-world indoor environments: a 25 m2 one-bedroom apartment and a 13.3m × 8.4m office space. Our results demonstrate that Iris performs effectively in both artificial lighting at night and in highly dynamic natural lighting conditions during the day. Moreover, Iris outperforms the state-of-the-art passive VLP techniques significantly in terms of localization accuracy and the required density of light sensors. To reduce the overhead associated with multi-channel spectral sensing, we develop and validate an algorithm that can minimize the required number of spectral channels for a given environment. Finally, we propose a conditional Generative Adversarial Network (cGAN) that can artificially generate LSI and reduce data collection effort by 50% without sacrificing localization accuracy."https://doi.org/10.1145/36109132023JHJiawei Hu et al.Context-Aware ComputingUbiquitous ComputingUbiComp
Spectral-Loc: Indoor Localization Using Light Spectral Information"For indoor settings, we investigate the impact of location on the spectral distribution of the received light, i.e., the intensity of light for different wavelengths. Our investigations confirm that even under the same light source, different locations exhibit slightly different spectral distribution due to reflections from their localised environment containing different materials or colours. By exploiting this observation, we propose Spectral-Loc, a novel indoor localization system that uses light spectral information to identify the location of the device. With spectral sensors finding their way into the latest products and applications, such as white balancing in smartphone photography, Spectral-Loc can be readily deployed without requiring any additional hardware or infrastructure. We prototype Spectral-Loc using a commercial-off-the-shelf light spectral sensor, AS7265x, which can measure light intensity over 18 different wavelength sub-bands. We benchmark the localization accuracy of Spectral-Loc against the conventional light intensity sensors that provide only a single intensity value. Our evaluations over two different indoor spaces, a meeting room, and a large office space, demonstrate that the use of light spectral information significantly reduces the localization error for the different percentiles. https://dl.acm.org/doi/10.1145/3580878"2023YWYanxiang Wang et al.Geospatial & Map VisualizationContext-Aware ComputingUbiComp
Voicify Your UI: Towards Android App Control with Voice CommandsNowadays, voice assistants help users complete tasks on the smartphone with voice commands, replacing traditional touchscreen interactions when such interactions are inhibited. However, the usability of those tools remains moderate due to the problems in understanding rich language variations in human commands, along with efficiency and comprehensibility issues. Therefore, we introduce Voicify, an Android virtual assistant that allows users to interact with on-screen elements in mobile apps through voice commands. Using a novel deep learning command parser, Voicify interprets human verbal input and performs matching with UI elements. In addition, the tool can directly open a specific feature from installed applications by fetching application code information to explore the set of in-app components. Our command parser achieved 90% accuracy on the human command dataset. Furthermore, the direct feature invocation module achieves better feature coverage in comparison to Google Assistant. The user study demonstrates the usefulness of Voicify in real-world scenarios. https://dl.acm.org/doi/10.1145/35819982023MVMinh Duc Vu et al.Voice User Interface (VUI) DesignIntelligent Voice Assistants (Alexa, Siri, etc.)UbiComp
Unveiling the Tricks: Automated Detection of Dark Patterns in Mobile ApplicationsMobile apps bring us many conveniences, such as online shopping and communication, but some use malicious designs called dark patterns to trick users into doing things that are not in their best interest. Many works have been done to summarize the taxonomy of these patterns and some have tried to mitigate the problems through various techniques. However, these techniques are either time-consuming, not generalisable or limited to specific patterns. To address these issues, we propose UIGuard, a knowledge-driven system that utilizes computer vision and natural language pattern matching to automatically detect a wide range of dark patterns in mobile UIs. Our system relieves the need for manually creating rules for each new UI/app and covers more types with superior performance. In detail, we integrated existing taxonomies into a consistent one, conducted a characteristic analysis and distilled knowledge from real-world examples and the taxonomy. Our UIGuard consists of two components, Property Extraction and Knowledge-Driven Dark Pattern Checker. We collected the first dark pattern dataset, which contains 4,999 benign UIs and 1,353 malicious UIs of 1,660 instances spanning 1,023 mobile apps. Our system achieves a superior performance in detecting dark patterns (micro averages: 0.82 in precision, 0.77 in recall, 0.79 in F1 score). A user study involving 58 participants further showed that UIGuard significantly increases users' knowledge of dark patterns. We demonstrated potential use cases of our work, which can benefit different stakeholders, and serve as a training tool for raising awareness of dark patterns2023JCJieshan Chen et al.Dark Patterns RecognitionUIST
Video2Action: Reducing Human Interactions in Action Annotation of App Tutorial VideosTutorial videos of mobile apps have become a popular and compelling way for users to learn unfamiliar app features. To make the video accessible to the users, video creators always need to annotate the actions in the video, including what actions are performed and where to tap. However, this process can be time-consuming and labor-intensive. In this paper, we introduce a lightweight approach Video2Action, to automatically generate the action scenes and predict the action locations from the video by using image-processing and deep-learning methods. The automated experiments demonstrate the good performance of Video2Action in acquiring actions from the videos, and a user study shows the usefulness of our generated action cues in assisting video creators with action annotation.2023SFSidong Feng et al.Generative AI (Text, Image, Music, Video)Crowdsourcing Task Design & Quality ControlUIST
RadarFoot: Fine-grain Ground Surface Context Awareness for Smart ShoesEveryday, billions of people use footwear for walking, running, or exercise. Of emerging interest are ``smart footwear'', which help users track gait, count steps or even analyse performance. However, such nascent footwear lack fine-grain ground surface context awareness, which could allow them to adapt to the conditions and create usable functions and experiences. Hence, this research aims to recognize the walking surface using a radar sensor embedded in a shoe, enabling ground context-awareness. Using data collected from 23 participants from an in-the-wild setting, we developed several classification models. We show that our model can detect five common terrain types with an accuracy of 80.0\% and further ten terrain types with an accuracy of 66.3\%, while moving. Importantly, it can detect the gait motion types such as `walking', `stepping up', `stepping down', `still', with an accuracy of 90\%. Finally, we present potential use cases and insights for future work based on such ground-aware smart shoes.2023DEDon Samitha Elvitigala et al.Biosensors & Physiological MonitoringContext-Aware ComputingUIST
Drawing Connections: Designing Situated Links for Immersive MapsWe explore the design of situated visual links in outdoor augmented reality (AR) for connecting miniature buildings on a virtual map to their real-world counterparts. We first distill design criteria from prior work, then conduct two user studies to evaluate a set of proposed link designs to better understand users’ preferences for different design choices of the links. In two user studies we evaluated, respectively, a set of link geometries in a virtual environment and a refined AR prototype in two different outdoor environments. The studies reveal that links help in identifying buildings in the environments. Participants prefer straight rather than curved links, simple and thin links to avoid information occlusion, and links and maps aligned with their direction of view. We recommend using a consistent color with a strong contrast to the background color for all links in a scene. To improve visibility, the diameter of links should grow with distance to the viewer and optional animated stripes can be placed on links. The findings of this study have the potential to bolster the development of various situated visualization applications, such as those used in urban planning, tourism, smart agriculture, and other fields.2023ZGZeinab Ghaemi et al.AR Navigation & Context AwarenessGeospatial & Map VisualizationContext-Aware ComputingMobileHCI
Calming Down in Lockdown: Rethinking Technologies for a Slower Pace of LifeThis study investigated Australian older adults' response to the conditions of the COVID-19 pandemic, the adjustments they made to their activities, technology use, and social relations, to inform how technology design could be inspired by these adaptations. Online interviews revealed that some sorely missed social interactions, however, most enjoyed having a greater agency to curate their own activities and slowing down as a result of lockdown. These findings prompted us to rethink the design space of temporal design from the perspective of those craving an ongoing impact of slowness in their lives. We suggest that designing for a slower pace of life can be inspired by people's response to life circumstances in lockdown, complementing the original concept of slow technology which seeks to intervene in a fast-paced life to encourage people to slow down and reflect. We conclude by proposing three new design pathways based on this new standpoint.2023YAYasamin Asadi et al.Sustainable HCIEcological Design & Green ComputingHuman-Nature Relationships (More-than-Human Design)DIS
"Piece it together": Insights from one year of engagement with electronics and programming for people with intellectual disabilitiesWe present the results of one year spent engaging people living with intellectual disabilities with an electronics and programming package. The program was run in collaboration with a disability support organization and delivered by support workers. We evaluate key qualities of the package at three sites via ongoing communication and reflective interviews with five support workers, along with observation of sessions and contextual inquiry with eleven people with a range of disabilities. Our findings demonstrate the importance of physicality in enabling experiences by creating real-world analogues and supporting diverse group interactions; how groups support members' attention, motivating each other, and allow space for coping mechanisms; and participants' growing confidence and creativity in problem solving, and the emergence of self-directed activities. We discuss the importance of diverse repetition for skill development, how skills develop over the year, and pragmatic lessons for conducting a long-term research program with a disability support organization.2023KEKirsten Ellis et al.Monash UniversitySpecial Education TechnologyCHI