Ready for the Touch: Exploring Users' Perceived Transparency of Robot Pre-Touch CuesThe emergence of embodied intelligence is expending the landscape of human-robot interaction (HRI) to include more direct and physical contact. While robot touch can provide assistance or comfort, a lack of Perceived Transparency before the touch, meaning limited clarity of the robot’s intentions, can lead to user confusion and anxiety. Despite its importance for user experience, perceived transparency towards robot's pre-touch conveyance method remains underexplored. This study systematically investigates how touch information conveyance affects perceived transparency and safety. Informed by a 340-person survey, we conducted a video-based study with 41 participants, comparing nine different robot pre-touch cues. Our mixed-methods approach combined subjective ratings and interviews with objective measures such as eye-tracking. We found that greater perceived transparency significantly enhances perceived safety. Video Displays were most effective at improving clarity, while task-oriented touch was more readily accepted than emotion-oriented touch. Based on these findings, we propose evidence-based design guidelines for safer and more effective robot touch interaction.2026RZRan Zhao et al.Beihang UniversitySocial Robot InteractionHuman-Robot Collaboration (HRC)Affective Feedback & Emotion Regulation InterfacesCHI
BuyMate: Making AI Interventions Effective in Promoting Rational Consumption in Live CommerceLive commerce platforms frequently employ algorithmic recommendations and time-limited promotions to trigger impulsive purchases, challenging rational consumer decision-making. While existing research has identified manipulative design patterns in live commerce, significant gaps remain in understanding consumer psychological motivations and developing counter-persuasion interventions. We conducted a multi-stage formative study involving surveys (N = 116), interviews (N = 21), and co-design workshops (N = 16) to explore user preferences for rational consumption support systems. Informed by these insights, we designed BuyMate, which provides gentle, real-time rational interventions through product comparison and persuasive speech reframing. A user evaluation (N = 35) demonstrates that the system effectively reduces impulsive purchases, enhances decision autonomy, and promotes sustainable consumption. This work contributes an AI-driven counter-persuasion approach, identifies user-centered principles for adaptive interventions, and offers practical guidance for responsible AI in digital commerce.2026SWShiyi Wang et al.Tsinghua universityAI-Assisted Decision-Making & AutomationAI Ethics, Fairness & AccountabilityRecommender System UXCHI
UEQManager: A Non-intrusive and Real-time System for Recognizing and Managing UEQ in Multilingual Voice AssistantsUser experience quality(UEQ) plays a critical role in multilingual intelligent voice assistant(VA), where real-time feedback directly affect interaction experience. However, current UEQ evaluation methods primarily depend on surveys, lack automation and timeliness, posing limitations for dynamic and user-centered adaptation. We propose a non-intrusive real-time system, UEQManager, for automated UEQ recognition and management. First, UEQManager incorporate interpretable deep learning models to predict UEQ in seven subdimensions. Second, leveraging LLM and expert group, we design adaptive interaction interface based on recognized UEQ states. Third, we implement integration system capable of real-time, non-intrusive UEQ recognition and management. We validate effectiveness of UEQManager through a user testing experiment. Results reveal that UEQManager significantly outperformed baseline, yielding an average UEQ improvement of 27.29% over baseline and demonstrating statistical significance across all subdimensions. This work contributes a proof of concept HCI system that translates webcam gaze cues into adaptive design decisions for multilingual VAs and illustrates how designers can couple interpretable sensing with proactive interaction design.2026EGEntong Gao et al.Beihang UniversityIntelligent Voice Assistants (Alexa, Siri, etc.)Multilingual & Cross-Cultural Voice InteractionHuman-LLM CollaborationCHI
How They Type: Eye and Finger Movement Strategies in Typing of Individuals with Cerebral PalsyTyping is essential for communication, yet the input behavior of individuals with cerebral palsy (CP) remains underexplored. We investigated 31 CP typists and 31 non-disabled controls using keystroke logging, eye tracking, and motion capture. Our study found that CP typists were slower and less rhythmically stable, but by prioritizing accuracy, their overall keyboard efficiency was comparable to controls. They adopted compensatory visual strategies such as shorter and more frequent fixations, greater reliance on the keyboard, and more gaze shifts, and displayed diverse finger usage strategies from single-finger to multi-finger input. We found that using more fingers did not necessarily result in faster typing. Subtype analysis showed spastic CP typists followed a "slow but steady" rhythm with consistent inter-key intervals, whereas athetoid CP typists exhibited a "fast but unstable" rhythm with greater variability, highlighting distinct mechanisms of typing in CP and providing insights for personalized assistive technologies.2026TSTingting Song et al.Institute of Psychology, Chinese Academy of SciencesMotor Impairment Assistive Input TechnologiesEye/Head-Controlled TypingHealth Self-TrackingCHI
From News Source Sharers to Post Viewers: How Topic Diversity and Conspiracy Theories Shape Engagement With Misinformation During a Health CrisisOnline engagement with misinformation threatens societal well-being, particularly during health crises when susceptibility to misinformation is heightened in a multi-topic context. Here, we focus on the COVID-19 pandemic and address a critical gap in understanding engagement with multi-topic misinformation on social media at two user levels: news source sharers (who post news items) and post viewers (who engage with news posts). To this end, we analyze 7273 fact-checked source news items and their associated posts on X through the lens of topic diversity and conspiracy theories. We find that false news, especially those containing conspiracy theories, exhibits higher topic diversity than true news. At news source sharer level, false news has a longer lifetime and receives more posts on X than true news, with conspiracy theories further extending its longevity. However, topic diversity does not significantly influence news source sharers' engagement. At post viewer level, contrary to news source sharer level, posts characterized by heightened topic diversity receive more reposts, likes, and replies. Notably, post viewers tend to engage more with misinformation containing conspiracy narratives: false news posts that contain conspiracy theories, on average, receive 40.8% more reposts, 45.2% more likes, and 44.1% more replies compared to those without conspiracy theories. Our findings suggest that news source sharers and post viewers exhibit distinct engagement patterns on X, offering valuable insights into refining misinformation interventions at these two user levels.2025YCYuwei Chuai et al.Misinformation, News, and Fact-CheckingCSCW
HapEmoji: Enhancing Emotional Experiences in Remote Collaboration through Haptic CommunicationConventional remote collaboration relies primarily on visual and auditory communication, which may lead to insufficient immersive and embodied experience. This paper examines how integrating haptic feedback can enhance emotional engagement in remote interactions and explores design approaches for haptic systems tailored to remote collaboration contexts. We developed, a system featuring four emotion-based dynamic haptic patterns, enabling users to convey emotions during remote meetings through a wearable, flexible haptic interface. After two rounds of pilot studies refining the haptic pattern designs, we conducted a user study with 16 participants in a remote meeting context. The results show that the four haptic patterns were easily distinguishable, and participants reported that haptic feedback helped bridge emotional gaps between collaborators, encourage active participation and positive atmosphere, while facilitating transitions and maintaining engagement. Our findings suggest that haptic interfaces can strengthen emotional communication and have the potential to improve the efficiency of remote collaboration.2025ZFZhou Fang et al.Distributed & Remote WorkCSCW
GazeSwipe: Enhancing Mobile Touchscreen Reachability through Seamless Gaze and Finger-Swipe IntegrationSmartphones with large screens provide users with increased display and interaction space but pose challenges in reaching certain areas with the thumb when using the device with one hand. To address this, we introduce GazeSwipe, a multimodal interaction technique that combines eye gaze with finger-swipe gestures, enabling intuitive and low-friction reach on mobile touchscreens. Specifically, we design a gaze estimation method that eliminates the need for explicit gaze calibration. Our approach also avoids the use of additional eye-tracking hardware by leveraging the smartphone's built-in front-facing camera. Considering the potential decrease in gaze accuracy without dedicated eye trackers, we use finger-swipe gestures to compensate for any inaccuracies in gaze estimation. Additionally, we introduce a user-unaware auto-calibration method that improves gaze accuracy during interaction. Through extensive experiments on smartphones and tablets, we compare our technique with various methods for touchscreen reachability and evaluate the performance of our auto-calibration strategy. The results demonstrate that our method achieves high success rates and is preferred by users. The findings also validate the effectiveness of the auto-calibration strategy.2025ZCZhuojiang Cai et al.Beihang University, State Key Lab. of VR Technology and SystemsFoot & Wrist InteractionEye Tracking & Gaze InteractionCHI
Exploring the Remapping Impact of Spatial Head-hand Relations in Immersive TelesurgeryThe action remapping between the user and the avatar creates significant perceptual and behavioral challenges. Recently, in addition to virtual environments, remapping has also given rise to new applications—immersive teleoperated robots. This paper selects immersive telesurgery, a representative scenario, as an opportunity for research, exploring the generalized effects of remapping. In such a scenario, the operator can observe through the robot's camera and use their hands to control the robotic arms, as if they were the robot. However, common remapping of spatial head-hand relations—due to camera adjustments and robotic arm switching—creates significant visual-proprioceptive conflicts and physical limitations. To explore this, we simulated a telesurgery system with 6 head-camera and 12 hand-robotic-arm remapping conditions, assessing non-surgeon participants across four surgical tasks: navigation, location, cutting, and bimanual coordination. The study examines spatial perception bias, interaction deviation, workload, and task completion time. Our findings reveal how different remapping targets, attributes, intensities, and situations affect performance, contributing to the understanding of perception mechanisms and offering insights for optimizing operations or systems.2025TLTianren Luo et al.Institute of Software, Chinese Academy of Sciences; College of Computer Science and Technology, University of Chinese Academy of SciencesTeleoperated DrivingHuman-Robot Collaboration (HRC)CHI
Exploring the Effects of Sensory Conflicts on Cognitive Fatigue in VR RemappingsVirtual reality (VR) is found to present significant cognitive challenges due to its immersive nature and frequent sensory conflicts. This study systematically investigates the impact of sensory conflicts induced by VR remapping techniques on cognitive fatigue, and unveils their correlation. We utilized three remapping methods (haptic repositioning, head-turning redirection, and giant resizing) to create different types of sensory conflicts, and measured perceptual thresholds to induce various intensities of the conflicts. Through experiments involving cognitive tasks along with subjective and physiological measures, we found that all three remapping methods influenced the onset and severity of cognitive fatigue, with visual-vestibular conflict having the greatest impact. Interestingly, visual-experiential/memory conflict showed a mitigating effect on cognitive fatigue, emphasizing the role of novel sensory experiences. This study contributes to a deeper understanding of cognitive fatigue under sensory conflicts and provides insights for designing VR experiences that align better with human perceptual and cognitive capabilities.2024TLTianren Luo et al.Eye Tracking & Gaze InteractionImmersion & Presence ResearchUIST
Partiality and Misconception: Investigating Cultural Representativeness in Text-to-Image ModelsText-to-image (T2I) models enable users worldwide to create high-definition and realistic images through text prompts, where the underrepresentation and potential misinformation of images have raised growing concerns. However, few existing works examine cultural representativeness, especially involving whether the generated content can fairly and accurately reflect global cultures. Combining automated and human methods, we investigate this issue in multiple dimensions quantificationally and conduct a set of evaluations on three prevailing T2I models (DALL-E v2, Stable Diffusion v1.5 and v2.1). Introducing attributes of cultural cluster and subject, we provide a fresh interdisciplinary perspective to bias analysis. The benchmark dataset UCOGC is presented, which encompasses authentic images of unique cultural objects from global clusters. Our results reveal that the culture of a disadvantaged country is prone to be neglected, some specified subjects often present a stereotype or a simple patchwork of elements, and over half of cultural objects are mispresented.2024LZLili Zhang et al.Hainan UniversityAI Ethics, Fairness & AccountabilityAlgorithmic Fairness & BiasCHI
ProObjAR: Prototyping Spatially-aware Interactions of Smart Objects with AR-HMDThe rapid advances in technologies have brought new interaction paradigms of smart objects (e.g., digital devices) beyond digital device screens. By utilizing spatial properties, configurations, and movements of smart objects, designing spatial interaction, which is one of the emerging interaction paradigms, efficiently promotes engagement with digital content and physical facility. However, as an important phase of design, prototyping such interactions still remains challenging, since there is no ad-hoc approach for this emerging paradigm. Designers usually rely on methods that require fixed hardware setup and advanced coding skills to script and validate early-stage concepts. These requirements restrict the design process to a limited group of users in indoor scenes. To facilitate the prototyping to general usages, we aim to figure out the design difficulties and underlying needs of current design processes for spatially-aware object interactions by empirical studies. Besides, we explore the design space of the spatial interaction for smart objects and discuss the design space in an input-output spatial interaction model. Based on these findings, we present ProObjAR, an all-in-one novel prototyping system with an Augmented Reality Head Mounted Display (AR-HMD). Our system allows designers to easily obtain the spatial data of smart objects being prototyped, specify spatially-aware interactive behaviors from an input-output event triggering workflow, and test the prototyping results in situ. From the user study, we find that ProObjAR simplifies the design procedure and increases design efficiency to a large extent and thus advancing the development of spatially-aware applications in smart ecosystems.2023HYHui Ye et al.City University of Hong KongAR Navigation & Context AwarenessKnowledge Worker Tools & WorkflowsCHI
FDHelper: Assist Unsupervised Fraud Detection Experts with Interactive Feature Selection and EvaluationOnline fraud is the well-known dark side of the modern Internet. Unsupervised fraud detection algorithms are widely used to address this problem. However, selecting features, adjusting hyperparameters, evaluating the algorithms, and eliminating false positives all require human expert involvement. In this work, we design and implement an end-to-end interactive visualization system, FDHelper, based on the deep understanding of the mechanism of the black market and fraud detection algorithms. We identify a workflow based on experience from both fraud detection algorithm experts and domain experts. Using a multi-granularity three-layer visualization map embedding an entropy-based distance metric ColDis, analysts can interactively select different feature sets, refine fraud detection algorithms, tune parameters and evaluate the detection result in near real-time. We demonstrate the effectiveness and significance of FDHelper through two case studies with state-of-the-art fraud detection algorithms, interviews with domain experts and algorithm experts, and a user study with eight first-time end users.2020JSJiao Sun et al.Tsinghua UniversityExplainable AI (XAI)Interactive Data VisualizationCHI
"I Bought This for Me to Look More Ordinary": A Study of Blind People Doing Online ShoppingOnline shopping, by reducing the needs for traveling, has become an essential part of lives for people with visual impairments. However, in HCI, research on online shopping for them has only been limited to the analysis of accessibility and usability issues. To develop a broader and better understanding of how visually impaired people shop online and design accordingly, we conducted a qualitative study with twenty blind people. Our study highlighted that blind people's desire of being treated as ordinary had significantly shaped their online shopping practices: very attentive to the visual appearance of the goods even they themselves could not see and taking great pain to find and learn what commodities are visually appropriate for them. This paper reports how their trying to appear ordinary is manifested in online shopping and suggests design implications to support these practices.2019GLGuanhong Liu et al.Tsinghua University & Ministry of EducationVisual Impairment Technologies (Screen Readers, Tactile Graphics, Braille)Universal & Inclusive DesignCHI
PeerLens: Peer-inspired Interactive Learning Path Planning in Online Question PoolOnline question pools like LeetCode provide hands-on exercises of skills and knowledge. However, due to the large volume of questions and the intent of hiding the tested knowledge behind them, many users find it hard to decide where to start or how to proceed based on their goals and performance. To overcome these limitations, we present PeerLens, an interactive visual analysis system that enables peer-inspired learning path planning. PeerLens can recommend a customized, adaptable sequence of practice questions to individual learners, based on the exercise history of other users in a similar learning scenario. We propose a new way to model the learning path by submission types and a novel visual design to facilitate the understanding and planning of the learning path. We conducted a within-subject experiment to assess the efficacy and usefulness of PeerLens in comparison with two baseline systems. Experiment results show that users are more confident in arranging their learning path via PeerLens and find it more informative and intuitive.2019MXMeng Xia et al.The Hong Kong University of Science and TechnologyInteractive Data VisualizationIntelligent Tutoring Systems & Learning AnalyticsCHI