Liar, Liar, Headset on Fire: Understanding the Effects of Deception Attacks on Decision-Making in a Mixed Reality GameWe examine the impact of deception in Mixed Reality (MR), focusing on how subversive elements affect user behavior and decision-making. In a controlled experiment with 250 participants playing a Whac-A-Mole MR game, we introduced three types of deception attacks: (1) a Physiological Spoofing Attack intended to foster false beliefs about bodily state; (2) a Gaslighting Attack that evokes false interpretations about bodily state by inducing doubt; and (3) a Disinformation Attack that presents false information by mimicking game- and system-level notifications to influence decision-making. We measured the effects on game performance, cognitive load, and behavioral responses. Results reveal that Physiological Spoofing and Gaslighting Attacks led to behavioral adjustments, though these effects diminished over time. Alternatively, false information presented in the Disinformation Attack adversely influenced decision-making. Our findings highlight the vulnerability of MR users to deception attacks and emphasize the need for adaptive security measures to mitigate these risks.2026ATAli Teymourian et al.Louisiana State UniversityImmersion & Presence ResearchAI-Assisted Decision-Making & AutomationPrivacy by Design & User ControlCHI
Does Background Music Matter in Data Videos? A Study of Music's Impact on Persuasion, Engagement, and RecallData videos combine visualization, animation, narration, and often background music to tell stories with data. While music is widely believed to enhance emotion and persuasion, its impact in data videos remains unexplored. We conducted a preregistered between-subjects experiment comparing six widely-viewed data videos with or without background music. Using Bayesian modeling and thematic analysis, we did not observe consistent measurable effects of background music on persuasion, engagement, or information recall. Qualitative responses revealed a more nuanced picture: some participants described the music as distracting or mismatched, while others reported that it enhanced enjoyment, supported focus, or strengthened emotional resonance when well aligned with the video's tone. These findings suggest that the influence of background music in data videos is highly context-dependent, shaped by genre, familiarity, and its alignment with visual–narrative structure. We discuss possible reasons for the limited measurable effects observed in real-world videos and outline opportunities for future work on purpose-designed, incidental, or adaptive music for data-driven storytelling.2026HDHessam Djavaherpour et al.Independent ResearcherData StorytellingVisualization Perception & CognitionSonification & Auditory DisplayCHI
Challenges in Synchronous & Remote Collaboration Around VisualizationWe characterize 16 challenges faced by those investigating and developing remote and synchronous collaborative experiences around visualization. Our work reflects the perspectives and prior research efforts of an international group of 29 experts from across human-computer interaction and visualization sub-communities. The challenges are anchored around five collaborative activities that exhibit a centrality of visualization and multimodal communication. These activities include exploratory data analysis, creative ideation, visualization-rich presentations, joint decision making grounded in data, and real-time data monitoring. The challenges also reflect the changing dynamics of these activities in the face of recent advances in extended reality (XR) and artificial intelligence (AI). As an organizing scheme for future research at the intersection of visualization and computer-supported cooperative work, we align the challenges with a sequence of four sets of research and development activities: technological choices, social factors, AI assistance, and evaluation.2026MBMatthew Brehmer et al.University of WaterlooInteractive Data VisualizationRemote Work Tools & ExperienceMulti-User Large Display CollaborationCHI
Defining Reality in Dementia VR: Stakeholder Perspectives on Ecological Validity for Functional Activity TrainingVirtual reality (VR) is increasingly used in dementia care, yet most applications focus on recreation or cognitive stimulation rather than supporting the everyday activities that matter for independent living. To understand what makes VR practice feel realistic and useful for people with dementia (PwD), we conducted semi-structured interviews with PwD, caregivers, and therapists using visual probes grounded in daily living contexts. We examine how stakeholders define realism and usefulness in VR-based support for instrumental activities of daily living (IADLs) and how these judgments relate to the concept of ecological validity. Our findings show that realistic IADL-based VR is characterized by environments and task flows that align with the cognitive and functional demands of real-world activities, while useful VR evokes behavior that meaningfully reflects everyday performance and supports rehabilitation practice. We translate these insights into design implications for at-home IADL-focused VR systems that emphasize functional fidelity, adaptability, and collaborative use, grounding real-world relevance in the lived routines and caregiving ecosystems of PwD.2026EBErica Camille Babb et al.Indiana University IndianapolisVR Medical Training & RehabilitationElderly Care & Dementia SupportSleep & Stress MonitoringCHI
The Impacts of Transparency and Personalization on Feelings of Agency and Connection in Democratic Decision MakingCommunity engagement processes often shape policies that affect people’s daily lives, yet they frequently struggle to build transparency, understanding, and agency. Civic technologies aim to address this gap by making connections between voices and decisions visible, but rarely evaluate impact on democratic participants. This study examines the effects of varying levels and types of transparency, including personalization, in technology-enabled civic decision-making on perceptions of agency, vertical and horizontal transparency, and community connection. We conducted an experiment with 266 participants who advocated for a local skate park or tennis court, and then received a decision for or against their position under varying transparency conditions. Results show that increased transparency improved perceptions of agency, vertical transparency, and horizontal transparency, but personalization had limited effects. Qualitative reflections highlighted horizontal transparency as particularly valuable for opening perspectives and enhancing participant experience. We discuss key design implications for civic technologies.2026MHMargaret Hughes et al.Massachusetts Institute of TechnologyCommunity Engagement & Civic TechnologyParticipatory DesignPrototyping & User TestingCHI
AbstractExplorer: Leveraging Structure-Mapping Theory to Enhance Comparative Close Reading at ScaleIndividual flagship conferences today can have over a thousand papers; even reading just the abstract of every paper at the latest relevant conference to keep up with the research is time and memory prohibitive. Previous visualizations in this domain have ubiquitously followed Shneiderman's Visual Information-Seeking Mantra, with details available on demand. However, recently in other domains, system designers have leveraged Structure-Mapping Theory (SMT) to facilitate seeing both the overview and the details at the same time, facilitating abstraction without losing context. We compose and evaluate a system, called AbstractExplorer, with analogous SMT-derived characteristics for the domain of scientific abstract corpus familiarization. AbstractExplorer has a unique combination of LLM-powered (1) faceted comparative close reading with (2) role highlighting enhanced by (3) structure-based ordering and (4) alignment. An ablation study (N=24) validated that these features work best together. A summative study (N=16) describes how these features support users in familiarizing themselves with a corpus of paper abstracts from a single large conference with over 1000 papers.2025ZGZiwei Gu et al.Human-LLM CollaborationInteractive Data VisualizationUIST
Coalesce: An Accessible Mixed-Initiative System for Designing Community-Centric QuestionnairesEffectively incorporating community input into civic decision-making processes is crucial for fostering inclusive governance. However, public officials often face challenges in formulating effective questions to gather meaningful insights due to constraints such as time, resources, and limited experience in questionnaire design. This paper explores the potential of leveraging large language models (LLMs) to address this challenge. We present \textit{Coalesce}, a novel mixed-initiative system that utilizes LLMs to assist civic leaders in crafting tailored and impactful questions for surveys, interviews, and conversation guides. Guided by best practices in questionnaire design, Coalesce improves question readability, enhances specificity, and reduces bias. To inform our design, we conducted a formative interview study with 30 civic leaders and implemented an iterative human-centered design process involving 14 feedback sessions. We built a fully-functional system before evaluating it through a real-world user study with 16 participants who applied the platform to their own community engagement projects. Our findings show that Coalesce improved participants' confidence in questionnaire design, supported diverse workflows, and fostered learning while raising important questions about human agency and over-reliance on AI. These insights highlight the potential for intelligent user interfaces to reshape how civic leaders engage with their communities, fostering more informed and inclusive decision-making processes.2025COCassandra Overney et al.Human-LLM CollaborationParticipatory DesignUser Research Methods (Interviews, Surveys, Observation)IUI
Beyond Text and Speech in Conversational Agents: Mapping the Design Space of AvatarsConversational agents have gained widespread popularity due to their ability to simulate and sustain contextual conversations. Prior works predominantly focused on computational challenges. However, avatars — the representation of the agent — impact user interactions and perception of conversational agents' trustworthiness and usefulness. Despite their importance, we lack a holistic understanding of conversational agent avatar design space. In this work, we address this gap by defining a categorization of 10 dimensions that is based on the analysis and iterative coding of 266 conversational agent papers from 160 venues spanning 2003 to the present. In addition, we built an interactive browser to facilitate exploration and interaction with these dimensions and their interrelationships. Our categorization lays the groundwork for researchers, designers, and practitioners to discern task-specific and contextual aspects of conversational agent avatar design. Our work fosters innovative ideas to facilitate new interactions with avatars by surfacing current patterns and highlighting open challenges.2024MRMashrur Rashik et al.Conversational ChatbotsAgent Personality & AnthropomorphismDIS
Examining the Use of VR as a Study Aid for University Students with ADHDAttention-deficit/hyperactivity disorder (ADHD) is a neurodevelopmental condition characterized by patterns of inattention and impulsivity, which lead to difficulties maintaining concentration and motivation while completing academic tasks. University settings, characterized by a high student-to-staff ratio, make treatments relying on human monitoring challenging. One potential replacement is Virtual Reality (VR) technology, which has shown potential to enhance learning outcomes and promote flow experience. In this study, we investigate the usage of VR with 27 university students with ADHD, in an effort to improve their performance in completing homework, including an exploration of automated feedback via a technology probe. Quantitative results show significant increases in concentration, motivation, and effort levels during these VR sessions and qualitative data offers insight into considerations like comfort and deployment. Together, the results suggest that VR can be a valuable tool in leveling the playing field for university students with ADHD.2024ICIsabelle Cuber et al.University of ZurichVR Medical Training & RehabilitationCognitive Impairment & Neurodiversity (Autism, ADHD, Dyslexia)CHI
Code to Cope: Supporting Self-Care by Integrating Creative Coding and Coping MechanismsCode to Cope is a STEAM curriculum for young adults designed to teach, develop, and encourage coping mechanisms while learning programming with JavaScript. COVID-19 restrictions, such as social distancing and remote learning, disrupted social development and identity formation in young adults, exacerbating mental health issues that remain unaddressed in the existing STEAM curriculum. Young adults are vulnerable to psychological distress that adversely affects educational experiences and career path choices. The Code to Cope curriculum was adopted by the creative coding course at [institution] from 2021 to 2022. We conducted selected interviews with 4 students in 2021 and empirical studies with 34 students in 2022 to evaluate the effects of the curriculum in terms of code, coping, and creativity. The results of the study show that the Code to Cope curriculum effectively teaches computational thinking, develops self-care practices, and engages and motivates students.2023HNHye Yeon Nam et al.Generative AI (Text, Image, Music, Video)Programming Education & Computational ThinkingSTEM Education & Science CommunicationC&C
Readymades & Repertoires: Artifact-Mediated Improvisation in Tabletop Role-Playing GamesGame masters (GMs) are creative practitioners who plan and orchestrate tabletop role-playing games. Through an interview study, we investigate how eight expert game masters adapt everyday technologies and materials as creativity support tools \added{(CSTs)} for improvisational and collaborative play. We integrate theories of improvisational and distributed creativity with the human-artifact model, which provides an activity-theoretical vocabulary for analyzing the mediating relationships between specialist practitioners and their tools. We show how GMs prepare and deploy readymade artifacts: analog and digital CSTs that flexibly mediate recurring creative tasks in their practice, such as improvising narrative elements, facilitating smooth play, and creating aesthetic effects. We find that GMs demonstrate designerly thinking as they create, share, and refine repertoires of readymade artifacts. We argue that our theoretical approach can inform future studies of IT-mediated creativity, and that readymade artifacts can be an analytical and generative concept for the design of novel creativity support tools.2022PTPhilip Tchernavskij et al.Role-Playing & Narrative GamesInteractive Narrative & Immersive StorytellingC&C
Tangible Landscape: A Hands-on Method for Teaching Terrain AnalysisThis paper presents novel and effective methods for teaching about topography--or shape of terrain--and assessing 3-dimensional spatial learning using tangibles. We used Tangible Landscape--a tangible interface for geospatial modeling--to teach multiple hands-on tangible lessons on the concepts of grading (i.e., earthwork), geomorphology, and hydrology. We examined students' ratings of the system's usability and user experience and tested students' acquisition and transfer of knowledge. Our results suggest the physicality of the objects enabled the participants to effectively interact with the system and each other, positively impacting ratings of usability and task-specific knowledge building. These findings can potentially advance the design and implementation of tangible teaching methods for the topics of geography, design, architecture, and engineering.2018GMGarrett C. Millar et al.North Carolina State UniversityGeospatial & Map VisualizationData PhysicalizationSTEM Education & Science CommunicationCHI
Investigating Separation of Territories and Activity Roles in Children’s Collaboration around TabletopsPrior work has shown that children exhibit negative collaborative behaviors, such as blocking others’ access to objects, when collaborating on interactive tabletop computers. We implemented previous design recommendations, namely separate physical territories and activity roles, which had been recommended to decrease these negative collaborative behaviors. We developed a multi-touch "I-Spy" picture searching application with separate territory partitions and activity roles. We conducted a deep qualitative analysis of how six pairs of children, ages 6 to 10, interacted with the application. Our analysis revealed that the collaboration styles differed for each pair, both in regards to the interaction with the task and with each other. Several pairs exhibited negative physical and verbal collaborative behaviors, such as nudging each other out of the way. Based on our analysis, we suggest that it is important for a collaborative task to offer equal opportunities for interaction, but it may not be necessary to strive for complete equity of collaboration. We examine the applicability of prior design guidelines and suggest open questions for future research to inform the design of tabletop applications to support collaboration for children.2018JWJulia Woodward et al.Children, Teens, and Young AdultsCSCW