Korean Journal of Cognitive Science (인지과학)

The Korean Society for Cognitive Science (한국인지과학회)
권호 표지

The Effect of Emotional Sounds on Multiple Target Search

정서적인 소리가 다중 목표 자극 탐색에 미치는 영향

  • Received : 2015.06.19
  • Accepted : 2015.09.01
  • Published : 2015.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study examined the effect of emotional sounds on satisfaction of search (SOS). SOS occurs when detection of a target results in a lesser chance of finding subsequent targets when searching for an unknown number of targets. Previous studies have examined factors that may influence the phenomenon, but the effect of emotional sounds is yet to be identified. Therefore, the current study investigated how emotional sound affects magnitude of the SOS effect. In addition, participants' eye movements were recorded to determine the source of SOS errors. The search display included abstract T and L-shaped items on a cloudy background and positive and negative sounds. Results demonstrated that negative sounds produced the largest SOS effect by definition, but this was due to superior accuracy in low-salient single target trials. Response time, which represents efficiency, was consistently faster when negative sounds were provided, in all target conditions. On-target fixation classification revealed scanning error, which occurs because targets are not fixated, as the most prominent type of error. These results imply that the two dimensions of emotion - valence and arousal - interactively affect cognitive performance.

본 연구는 정서가를 가진 소리가 시각탐색만족현상에 미치는 영향에 대해 알아보고자 하였다. 시각탐색만족현상은 목표자극이 여러 개 존재하는 상황에서 하나의 목표자극을 찾고 나면 나머지 목표자극을 찾을 가능성이 낮아지는 현상이다. 이러한 현상에 대한 원인 규명에 대한 연구들 중 정서정보를 가진 자극의 효과를 알아본 연구는 부족한 실정이다. 따라서 본 연구는 소리의 정서가가 시각탐색만족현상에 어떤 영향을 주는지 알아보기 위하여 실험을 진행하였다. 또한 시선추적을 통해 시각탐색만족현상이 일어나는 원인을 찾고자 하였다. 참가자들이 알파벳 T자를 탐색하는 과제 도중 긍정적, 부정적 소리를 제시하였다. 그 결과, 부정적 소리가 제시되었을 때 사전적 정의의 시각탐색만족현상이 가장 크게 나타났다. 하지만 이는 현저성이 낮은 단일 목표자극 시행의 정확도가 월등히 좋았기 때문에 나타난 것이다. 효율성의 지표인 반응 시간은 목표자극 조건과 관계없이 부정적 소리가 주어졌을 때 가장 빨랐다. 목표자극 위에 떨어지는 응시점을 분류해본 결과, 목표자극을 응시하지 않아서 생기는 주사 오류가 가장 많이 나타났다. 본 연구의 결과는 소리의 유인과 각성수준의 상호작용에 의해 인지적 수행이 영향을 받는다는 관점에서 이해될 수 있다.

Keywords

References

  1. Alzubaidi, M., Black, J. A., Jr., Patel, A., & Panchanathan, S. (2009, 2-5 Aug. 2009). Conscious vs. subconscious perception, as a function of radiological expertise. Paper presented at the Computer-Based Medical Systems, 2009. CBMS 2009. 22nd IEEE International Symposium on.
  2. Anderson, A. K. (2005). Affective Influences on the Attentional Dynamics Supporting Awareness. Journal of Experimental Psychology: General, 134(2), 258-281. https://doi.org/10.1037/0096-3445.134.2.258
  3. Anderson, A. K., Christoff, K., Stappen, I., Panitz, D., Ghahremani, D. G., Glover, G., . . . Sobel, N. (2003). Dissociated neural representations of intensity and valence in human olfaction. Nature Neuroscience, 6(2), 196-202. https://doi.org/10.1038/nn1001
  4. Anderson, A. K., & Phelps, E. A. (2001). Lesions of the human amygdala impair enhanced perception of emotionally salient events. Nature, 411(6835), 305-309. https://doi.org/10.1038/35077083
  5. Andriole, K. P., Wolfe, J. M., Khorasani, R., Treves, S. T., Getty, D. J., Jacobson, F. L., . . . Seltzer, S. E. (2011). Optimizing Analysis, Visualization, and Navigation of Large Image Data Sets: One 5000-Section CT Scan Can Ruin Your Whole Day. Radiology, 259(2), 346-362. https://doi.org/10.1148/radiol.11091276
  6. Armony, J. L., & Dolan, R. J. (2002). Modulation of spatial attention by fear-conditioned stimuli: an event-related fMRI study. Neuropsychologia, 40(7), 817-826. https://doi.org/10.1016/S0028-3932(01)00178-6
  7. Becker, M. W. (2009). Panic Search: Fear Produces Efficient Visual Search for Nonthreatening Objects. Psychological Science, 20(4), 435-437. https://doi.org/10.1111/j.1467-9280.2009.02303.x
  8. Berbaum, K. S., Franken Jr, E. A., Dorfman, D. D., Miller, E. M., Krupinski, E. A., Kreinbring, K., . . . Lu, C. H. (1996). Cause of satisfaction of search effects in contrast studies of the abdomen. Academic Radiology, 3(10), 815-826. https://doi.org/10.1016/S1076-6332(96)80271-6
  9. Berbaum, K. S., Franklin, E. A. J., Caldwell, R. T., & Schartz, K. M. (2010). Satisfaction of search in traditional radiographic imaging. In E. Samei & E. Krupinski (Eds.), The Handbook of Medical Image Perception and Techniques (pp. 107-138). Cambridge, United Kingdom: Cambridge University Press.
  10. Biggs, A. T., Cain, M. S., Clark, K., Darling, E. F., & Mitroff, S. R. (2013). Assessing visual search performance differences between Transportation Security Administration Officers and nonprofessional visual searchers. Visual Cognition, 21(3), 330-352. https://doi.org/10.1080/13506285.2013.790329
  11. Bolls, P. D., Lang, A., & Potter, R. F. (2001). The Effects of Message Valence and Listener Arousal on Attention, Memory, and Facial Muscular Responses to Radio Advertisements. Communication Research, 28(5), 627-651. https://doi.org/10.1177/009365001028005003
  12. Bradley, M. M., & Lang, P. J. (2007). The International Affective Digitized Sounds (2nd Edition; IADS-2): Affective ratings of sounds and instruction manual Technical report B-3. Gainesville, Fl.: University of Florida.
  13. Brosch, T., Grandjean, D., Sander, D., & Scherer, K. R. (2008). Cross-modal Emotional Attention: Emotional Voices Modulate Early Stages of Visual Processing. Journal of Cognitive Neuroscience, 21(9), 1670-1679. https://doi.org/10.1162/jocn.2009.21110
  14. Cain, M. S., Adamo, S. H., & Mitroff, S. R. (2013). A taxonomy of errors in multiple-target visual search. Visual Cognition, 21(7), 899-921. https://doi.org/10.1080/13506285.2013.843627
  15. Cain, M. S., Dunsmoor, J. E., LaBar, K. S., & Mitroff, S. R. (2011). Anticipatory Anxiety Hinders Detection of a Second Target in Dual-Target Search. Psychological Science, 22(7), 866-871. https://doi.org/10.1177/0956797611412393
  16. Derakshan, N., & Eysenck, M. W. (2009). Anxiety, processing efficiency, and cognitive performance: New developments from attentional control theory. European Psychologist, 14(2), 168-176. https://doi.org/10.1027/1016-9040.14.2.168
  17. Fernandes, M. A., Koji, S., Dixon, M. J., & Aquino, J. M. (2011). Changing the focus of attention: The interacting effect of valence and arousal. Visual Cognition, 19(9), 1191-1211. https://doi.org/10.1080/13506285.2011.618151
  18. Fleck, M. S., Samei, E., & Mitroff, S. R. (2010). Generalized “satisfaction of search”: Adverse influences on dual-target search accuracy. Journal of Experimental Psychology: Applied, 16(1), 60-71. https://doi.org/10.1037/a0018629
  19. Gasper, K., & Clore, G. L. (2002). Attending to the Big Picture: Mood and Global Versus Local Processing of Visual Information. Psychological Science, 13(1), 34-40. https://doi.org/10.1111/1467-9280.00406
  20. Jefferies, L. N., Smilek, D., Eich, E., & Enns, J. T. (2008). Emotional Valence and Arousal Interact in Attentional Control. Psychological Science, 19(3), 290-295. https://doi.org/10.1111/j.1467-9280.2008.02082.x
  21. Kensinger, E. A. (2009). Remembering the Details: Effects of Emotion. Emotion Review, 1(2), 99-113. https://doi.org/10.1177/1754073908100432
  22. Lang, A., Dhillon, K., & Dong, Q. (1995). The effects of emotional arousal and valence on television viewers’ cognitive capacity and memory. Journal of Broadcasting & Electronic Media, 39(3), 313-327. https://doi.org/10.1080/08838159509364309
  23. Maiworm, M., Bellantoni, M., Spence, C., & Roder, B. (2012). When emotional valence modulates audiovisual integration. Attention, Perception, & Psychophysics, 74(6), 1302-1311. https://doi.org/10.3758/s13414-012-0310-3
  24. Mogg, K., & Bradley, B. P. (1999). Orienting of Attention to Threatening Facial Expressions Presented under Conditions of Restricted Awareness. Cognition and Emotion, 13(6), 713-740. https://doi.org/10.1080/026999399379050
  25. Ohman, A., Flykt, A., & Esteves, F. (2001). Emotion drives attention: Detecting the snake in the grass. Journal of Experimental Psychology: General, 130(3), 466-478. https://doi.org/10.1037/0096-3445.130.3.466
  26. Schupp, H. T., Markus, J., Weike, A. I., & Hamm, A. O. (2003). Emotional Facilitation of Sensory Processing in the Visual Cortex. Psychological Science, 14(1), 7-13. https://doi.org/10.1111/1467-9280.01411
  27. Storbeck, J., & Clore, G. L. (2005). With Sadness Comes Accuracy; With Happiness, False Memory: Mood and the False Memory Effect. Psychological Science, 16(10), 785-791. https://doi.org/10.1111/j.1467-9280.2005.01615.x
  28. Thompson, W. F., Schellenberg, E. G., & Husain, G. (2001). Arousal, Mood, and The Mozart Effect. Psychological Science, 12(3), 248-251. https://doi.org/10.1111/1467-9280.00345
  29. Vuilleumier, P. (2005). How brains beware: neural mechanisms of emotional attention. Trends in Cognitive Sciences, 9(12), 585-594. https://doi.org/10.1016/j.tics.2005.10.011
  30. Wolfe, J. M. (2012). When do I Quit? The Search Termination Problem in Visual Search. In M. D. Dodd & J. H. Flowers (Eds.), The Influence of Attention, Learning, and Motivation on Visual Search (pp.183-208): Springer New York.
  31. Zeelenberg, R., & Bocanegra, B. R. (2010). Auditory emotional cues enhance visual perception. Cognition, 115(1), 202-206. https://doi.org/10.1016/j.cognition.2009.12.004