DOI QR코드

DOI QR Code

Understanding Smartphone-based Online Shopping Experiences and Behaviors of Blind Users

  • Park, Jihyuk (School of Electrical Engineering, KAIST) ;
  • Han, Yeji (School of Computing, KAIST) ;
  • Oh, Uran (Department of Computer Science and Engineering, Ewha Womans University)
  • 투고 : 2020.08.21
  • 심사 : 2020.08.30
  • 발행 : 2020.09.30

초록

Smartphones provide blind users with screenreader as an accessibility tool. However, blind users often experience difficulties accessing online shopping malls via smartphones due to their inconsistent and image-based layouts. To enable screenreader users to get access to the detailed information about products while they are shopping online, we have developed BarrierFreeShop, an accessible mobile shopping application for people with visual impairments. BarrierFreeShop has three accessibility features: (1) layout automation, (2) review summarization, and (3) optical character recognition. We conducted a user study with 80 participants with visual impairments where they were asked to use BarrierFreeShop for a month. The findings revealed the effectiveness of our app in terms of speed and post interview feedback. We have also discovered typical shopping experiences that participants had during the test. This research suggests that computer vision technologies can improve accessibility issues in online shopping malls. In addition, we have confirmed that extracting contents from images help people with visual impairments to get better access to product information.

키워드

참고문헌

  1. S. Szpiro, Y. Zhao, and S. Azenkot. Finding a store, searching for a product: a study of daily challenges of low vision people. In ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, (pp. 61-72). 2016.
  2. Fernandes, H., Costa, P., Filipe, V., Paredes, H., and Barroso, J. A review of assistive spatial orientation and navigation technologies for the visually impaired. Universal Access in the Information Society, 18(1), (pp. 155-168). 2019. https://doi.org/10.1007/s10209-017-0570-8
  3. An article from AbleNews about a survey results on the usage of online shopping of people with visual impairments conducted by Korea Blind Union. http://ablenews.co.kr/News/NewsContent.aspx?CategoryCode=0006&NewsCode=000620180312112546134726
  4. H. Jethava, S. Zafar, and M. Saini. Electronic Shopping Cart Facility for Blind People Using USB Firmware. In International Journal of Emerging Technology and Advanced Engineering, Vol. 4. (pp. 647-651). 2014.
  5. Lanigan, P. E., Paulos, A. M., Williams, A. W., Rossi, D., and Narasimhan, P. Trinetra: Assistive Technologies for Grocery Shopping for the Blind. In ISWC (pp. 147-148). 2006.
  6. Nicholson, J., Kulyukin, V., and Coster, D. ShopTalk: independent blind shopping through verbal route directions and barcode scans. The Open Rehabilitation Journal, 2(1). 2009. https://doi.org/10.2174/1874943700902010089
  7. Stangl, A. J., Kothari, E., Jain, S. D., Yeh, T., Grauman, K., and Gurari, D. Browsewithme: An online clothes shopping assistant for people with visual impairments. In Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (pp. 107-118). 2018.
  8. T. Winlock, E. Christiansen, and S. Belongie. Toward real-time grocery detection for the visually impaired. In Computer Vision and Pattern Recognition Workshops (CVPRW), 2010 IEEE Computer Society Conference on. IEEE, (pp. 49-56). 2010.
  9. Y. Zhao, S. Szpiro, J. Knighten, and S. Azenkot. CueSee: Exploring Visual Cues for People with Low Vision to Facilitate a Visual Search Task. In ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp). (pp.73-84). 2016.
  10. C. P. Gharpure and V. A. Kulyukin. Robot-assisted shopping for the blind: issues in spatial cognition and product selection. Intelligent Service Robotics 1, 3 (2008), (pp.237-251). 2008. https://doi.org/10.1007/s11370-008-0020-9
  11. H. Jethava, S. Zafar, and M. Saini. Electronic Shopping Cart Facility for Blind People Using USB Firmware. In International Journal of Emerging Technology and Advanced Engineering, Vol. 4. (pp. 647-651). 2014.
  12. Kulyukin, V., and Kutiyanawala, A. Accessible shopping systems for blind and visually impaired individuals: Design requirements and the state of the art. The Open Rehabilitation Journal, 3(1). 2010.
  13. Lee, J., Kim, J., and Jung, H. Challenges and Design Opportunities for Easy, Economical, and Accessible Offline Shoppers with Visual Impairments. In Proceedings of the 2020 Symposium on Emerging Research from Asia and on Asian Contexts and Cultures (pp. 69-72). 2020
  14. Walker Sands. 2018. The Future of Retail 2018: How Technology is Expanding the Scope of Online Commerce Beyond Retail. In Walker Sands Resources. https://www.walkersands.com/resources/the-future-of-retail-2018/
  15. Statistical data from KOSIS (Korean Statistical Information Service) about transaction value of online shopping mall by commodity groups/sales channels. http://kosis.kr/statHtml/statHtml.do?orgId=101&tblId=DT_1KE10071&conn_path=I2&language=kr
  16. Lee, S., Lee, J., Jung, K., Behavior recognition system based fog cloud computing, The International Journal of Advanced Smart Convergence, Vol. 6. (pp. 29-37). 2017 https://doi.org/10.7236/IJASC.2017.6.3.29
  17. Hwang, C., Kim, H., Lee, J., Jung, K., A study on BSN data collection technique through mobile devices in a cloud environment, The International Journal of Advanced Smart Convergence, Vol. 6. (pp. 82-88). 2017 https://doi.org/10.7236/IJASC.2017.6.1.82