Posts by Collection

Current Study: Effective and Pleasant Interaction Dialog Design for Assisting People with Visual Impairment (Work submitted to ACM ASSETS Conference 2019 )

We are investigating conversation based prosthetic and an interaction that it provides to People with Visual Impairment (PVI) through studying experience of a remote sighted agent at Aira (https://aira.io/) and PVI from providing assistance to PVI and receiving it from the sighted agent at Aira. We in particular have interests on how conversation modalities (verbal and nonverbal) are utilized and how it is selected for accommodating to context and temporal relevancy and to needs of particular task. Also we are investigating an integration of different kind of modality (e.g. information presented with haptic) into the conversation modality and how it improves guidance support and interaction.

Field Studies

With conducting field studies with ethnographic and participatory design approaches, we learned and understood how people with visual impairments experience and understand world around them and what kind of prosthetic processes and technologies including assistive technologies and collaboration with sighted assistance that they utilize for performing daily tasks and activities, specifically for the shopping task which is an essential and yet found to be challenging task for them.

Lab Experiment Studies

Through iterative lab studies, we investigated and evaluated effectiveness and user experience of the smart camera prosthetics and feedback interface prototype (wearable technology + single or multi-modality of auditory or haptic sense) that support information delivery and navigational guidance for people with visual impairments with using context of grocery shopping.

Impact of misalignment of trading agent strategy across multiple markets

Published in International Conference on Auctions, Market Mechanisms and Their Applications, 2009

We examine the effect of a market pricing policy designed to attract high-valued traders in a multiple market context using JCAT software. Our experiments show that a simple change to pricing policy can create market performance effects that traditional adaptive trading agents are unable to recognize or capitalize on, but that market-policy-aware trading agents can generally obtain. This suggests as parameterized and tunable markets become more common, trading strategies will increasingly need to be conditional on each individual market’s policies.

Recommended citation: Sohn, Jung-woo, Sooyeon Lee, and Tracy Mullen. "Impact of misalignment of trading agent strategy across multiple markets." International Conference on Auctions, Market Mechanisms and Their Applications. Springer, Berlin, Heidelberg, 2009. https://Sooyeon-Lee.github.io/files/Sohn2009_Chapter_ImpactOfMisalignmentOfTradingA.pdf

Attracting intra-marginal traders across multiple markets

Published in IJCAI-09 Workshop on Trading Agent Design and Analysis (TADA-09), 2009

High-valued traders, or intra-marginal traders, can give a market higher transaction rates and generate more profit both for the traders and for the market maker. In previous CAT tournaments with competing market specialists, and in accordance with economic theory, markets using registration fee policies attract intra-marginal traders and drive out extra-marginal traders. We build a simple trader market selection game-theoretic model and simulation to determine how the Nash equilibrium (NE) changes across two markets when a registration fee is charged in one of them.

Recommended citation: Sohn, Jung-woo, Sooyeon Lee, and Tracy Mullen. "Attracting intra-marginal traders across multiple markets." Workshop on Trading Agent Design and Analysis (TADA 2009). 2009. https://Sooyeon-Lee.github.io/files/tada09_submission_16.pdf

Designing Equal Participation in Informal Learning for People with Visual Impairment

Published in Interaction Design and Architecture(s), 2015

Informal learning opportunities that complement formal education with diversity and flexibility are abundant in our daily lives. While sighted people take advantage of such learning and may take it for granted, people with visual impairment are sometimes excluded, due to their sight loss, from accessing informal learning, social interaction, and civic engagement. In this sense, they are not equal participants in the highly visual, sighted world. This paper investigates the needs of people with visual impairment, identifies issues, and suggests a direction to support equal participation. We propose four environment scenarios, grounded in our field work, to describe how to support learning and interaction in a sighted world. We discuss how design implications derived from our scenario-based analysis can help guide technological interventions.

Recommended citation: Yuan, Chien Wen, Benjamin V. Hanrahan, Sooyeon Lee, and John M. Carroll. "Designing Equal Participation in Informal Learning for People with Visual Impairment." IxD&A 27 (2015): 93-106. https://Sooyeon-Lee.github.io/files/2015_Designing.pdf

Being connected to the local community through a Festival mobile application

Published in IConference 2016 Proceedings, 2016

In this paper we report our investigation into how using and interacting with a local festival mobile app enhanced users’ festival experiences and connected them to other local users and their community. We explored the relationship between users’ perceived basic affordances of mobile technology, perceived opportunities of the festival app, and three elements that sustain the local community — attachment, engagement, and social support networks. Based on the usage logs of 348 active users, as well as survey responses from 80 users, we present a mobile-mediated local community framework and found that engagement is a key mediator of mobile experiences and facets of community.

Recommended citation: Han, Kyungsik, Richard Wirth, Benjamin V. Hanrahan, Jiawei Chen, Sooyeon Lee, and John M. Carroll. "Being connected to the local community through a Festival mobile application." IConference 2016 Proceedings (2016). https://Sooyeon-Lee.github.io/files/2016_Being.pdf

MASTerful Matchmaking in Service Transactions: Inferred Abilities, Needs and Interests versus Activity Histories

Published in CHI 16 Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016

Timebanking is a growing type of peer-to-peer service exchange, but is hampered by the effort of finding good transaction partners. We seek to reduce this effort by using a Matching Algorithm for Service Transactions (MAST). MAST matches transaction partners in terms of similarity of interests and complementarity of abilities and needs. We present an experiment involving data and participants from a real timebanking network, that evaluates the acceptability of MAST, and shows that such an algorithm can retrieve matches that are subjectively better than matches based on matching the category of people’s historical offers or requests to the category of a current transaction request.

Recommended citation: Jung, Hyunggu, Victoria Bellotti, Afsaneh Doryab, Dean Leitersdorf, Jiawei Chen, Benjamin V. Hanrahan, Sooyeon Lee, Dan Turner, Anind K. Dey, and John M. Carroll. "MASTerful Matchmaking in Service Transactions: Inferred Abilities, Needs and Interests versus Activity Histories." Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 2016. https://Sooyeon-Lee.github.io/files/2017_MASTERful.pdf

Constructing a holistic view of shopping with people with visual impairment: a participatory design approach

Published in Universal Access in the Information Society (2017), 2016

Timebanking is a growing type of peer-to-peer service exchange, but is hampered by the effort of finding good transaction partners. We seek to reduce this effort by using a Matching Algorithm for Service Transactions (MAST). MAST matches transaction partners in terms of similarity of interests and complementarity of abilities and needs. We present an experiment involving data and participants from a real timebanking network, that evaluates the acceptability of MAST, and shows that such an algorithm can retrieve matches that are subjectively better than matches based on matching the category of people’s historical offers or requests to the category of a current transaction request.

Recommended citation: Yuan, Chien Wen, Benjamin V. Hanrahan, Sooyeon Lee, Mary Beth Rosson, and John M. Carroll. “Constructing a holistic view of shopping with people with visual impairment: a participatory design approach.” Universal Access in the Information Society (2017): 1-14. https://Sooyeon-Lee.github.io/files/2016_Constructing.pdf

Third Eye: A Shopping Assistant for the Visually Impaired

Published in IEEE Computer special issue on “Human Augmentation”, 2017

Through a combination of wearable cameras, hardware accelerators, and algorithms, a vision-based automatic shopping assistant allows users with limited or no sight to select products from grocery shelves.

Recommended citation: Peter A. Zientara, Sooyeon Lee, Rorry Brenner, Henry Smith, Laurent Itti, Mary Beth Rosson, John M. Carroll, Kevin M. Irick, Vijaykrishnan Narayanan
. "Third Eye: a shopping assistant for the visually impaired." Computer 50.2 (2017): 16-24. IEEE Computer special issue on “Human Augmentation” https://Sooyeon-Lee.github.io/files/2017_third.pdf

Reaching Out: Investigating Different Modalities to Help People with Visual Impairments Acquire Items

Published in The 19th International ACM SIGACCESS Conference on Computers and Accessibility, 2017

We present a lab study of multiple feedback designs for guiding small-scale arm-and-hand movement for people with visual impairments (PVI), so that they can reach out to and grasp an item on a shelf. Little attention has been paid to the guidance of smallscale arm-and-hand movements by PVI, yet this is an essential element of product acquisition in a grocery shopping task and other similar daily activities. We developed a feedback interface that allowed us to explore two types of auditory feedback (speech and tones), haptic vibration feedback, and a combination of both. The result of the study demonstrated that the multi-modal navigational feedback, specifically speech and haptic, was the most effective and preferred mode for small-scale navigation.

Recommended citation: Sooyeon Lee, Chien Wen Yuan, Benjamin V. Hanrahan, Mary Beth Rosson, John M. Carroll. “Reaching Out: Investigating Different Modalities to Help People with Visual Impairments Acquire Items”. ASSETS ’17 Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility Pages 389-390. https://Sooyeon-Lee.github.io/files/2017_reaching.pdf

Remote Human Assistant Technology: Classroom Learning Accessibility for Children with Visual Impairment

Published in CHI 2018 workshop on “Inclusive Educational Tehcnologies: Emerging Opportunities for People with Visual Impairments”, 2018

It is very important for child with visual impairment (CVI) to learn how to interact and engage with sighted peer for their equal social participation and inclusion throughout their life. This brings up benefit and a need of the classroom learning provided by a regular school because it provides great setting for CVI to easily and naturally learn the communication and social skills. For CVI to maximally take the benefit, their full and independent participation in the class activities are needed. However, not much attention has been paid to research that supports interaction and engagement in classroom setting but to an individual level focused learning technology. We propose leveraging a hybrid form of human plus technology assistance that may support CVI in a classroom setting and investigating a feasibility of the hybrid technology with an exploratory study.

Recommended citation: Sooyeon Lee, Jordan Beck, Xiying Wang, Mary Beth Rosson, John M. Carrol. “Remote Human Assistant Technology: Classroom Learning Accessibility for Children with Visual Impairment”. Position paper for CHI 2018 workshop on “Inclusive Educational Tehcnologies: Emerging Opportunities for People with Visual Impairments”. https://Sooyeon-Lee.github.io/files/2018_Remote_Assistant.pdf

I Didnt Know that You Knew I Knew: Collaborative Shopping Practices between People with Visual Impairment and People with Vision

Published in 21st ACM Conference on Computer-Supported Cooperative Work and Social Computing, CSCW 2018, 2018

It is important to support independent living for people with visual impairments (PVI). Part of this can be accomplished with individual assistive technologies. However, in this paper we emphasize the social and collaborative needs for PVI to fully integrate into society as equals. The study assesses how PVI collaborate with different types of sighted partners when shopping together. We chose to study grocery shopping because it is a critical and challenging task for PVI. We conducted field observations and in-depth interviews with five PVI and their sighted shopping partners, including spouses, caseworkers, and store-provided courtesy shoppers. We found several factors that modulated these collaborations with varying forms of common ground: 1) knowledge about how to assist PVI; 2) interpersonal knowledge resulting from common experience and interpersonal relationship history; and 3) knowledge of shopping as a practice. We discuss our findings with respect to the implications for designing collaborative interactions.

Recommended citation: Chien Wen Yuan, Benjamin V. Hanrahan, Sooyeon Lee, Mary Beth Rosson, John M. Carroll. “I Didn’t Know that You Knew I Knew: Collaborative Shopping Practices between People with Visual Impairment and People with Vision”. 21st ACM Conference on Computer-Supported Cooperative Work and Social Computing. CSCW 2018. https://Sooyeon-Lee.github.io/files/2018_I_didnt.pdf

Understanding and Designing for Deaf or Hard of Hearing Drivers on Uber

Published in The ACM CHI Conference on Human Factors in Computing Systems, 2019

We used content analysis of in-app driver survey responses, customer support tickets, and tweets, and face-to-face interviews of DHH Uber drivers to better understand the DHH driver experience. Here we describe challenges DHH drivers experience and how they address those difficulties via Uber’s accessibility features and their own workarounds. We also identify and discuss design and product opportunities to improve the DHH driver experience on Uber.

Recommended citation: Sooyeon Lee, Bjorn Hubert-Wallander, Molly Stevens, and John M. Carroll. "Understanding and Designing for Deaf or Hard of Hearing Drivers on Uber." In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, p. 529. ACM, 2019 https://Sooyeon-Lee.github.io/files/2019_Understanding.pdf