The Effect of Emotional Sounds on Multiple Target Search

정서적인 소리가 다중 목표 자극 탐색에 미치는 영향

  • Received : 2015.06.19
  • Accepted : 2015.09.01
  • Published : 2015.09.30


This study examined the effect of emotional sounds on satisfaction of search (SOS). SOS occurs when detection of a target results in a lesser chance of finding subsequent targets when searching for an unknown number of targets. Previous studies have examined factors that may influence the phenomenon, but the effect of emotional sounds is yet to be identified. Therefore, the current study investigated how emotional sound affects magnitude of the SOS effect. In addition, participants' eye movements were recorded to determine the source of SOS errors. The search display included abstract T and L-shaped items on a cloudy background and positive and negative sounds. Results demonstrated that negative sounds produced the largest SOS effect by definition, but this was due to superior accuracy in low-salient single target trials. Response time, which represents efficiency, was consistently faster when negative sounds were provided, in all target conditions. On-target fixation classification revealed scanning error, which occurs because targets are not fixated, as the most prominent type of error. These results imply that the two dimensions of emotion - valence and arousal - interactively affect cognitive performance.


  1. Alzubaidi, M., Black, J. A., Jr., Patel, A., & Panchanathan, S. (2009, 2-5 Aug. 2009). Conscious vs. subconscious perception, as a function of radiological expertise. Paper presented at the Computer-Based Medical Systems, 2009. CBMS 2009. 22nd IEEE International Symposium on.
  2. Anderson, A. K. (2005). Affective Influences on the Attentional Dynamics Supporting Awareness. Journal of Experimental Psychology: General, 134(2), 258-281.
  3. Anderson, A. K., Christoff, K., Stappen, I., Panitz, D., Ghahremani, D. G., Glover, G., . . . Sobel, N. (2003). Dissociated neural representations of intensity and valence in human olfaction. Nature Neuroscience, 6(2), 196-202.
  4. Anderson, A. K., & Phelps, E. A. (2001). Lesions of the human amygdala impair enhanced perception of emotionally salient events. Nature, 411(6835), 305-309.
  5. Andriole, K. P., Wolfe, J. M., Khorasani, R., Treves, S. T., Getty, D. J., Jacobson, F. L., . . . Seltzer, S. E. (2011). Optimizing Analysis, Visualization, and Navigation of Large Image Data Sets: One 5000-Section CT Scan Can Ruin Your Whole Day. Radiology, 259(2), 346-362.
  6. Armony, J. L., & Dolan, R. J. (2002). Modulation of spatial attention by fear-conditioned stimuli: an event-related fMRI study. Neuropsychologia, 40(7), 817-826.
  7. Becker, M. W. (2009). Panic Search: Fear Produces Efficient Visual Search for Nonthreatening Objects. Psychological Science, 20(4), 435-437.
  8. Berbaum, K. S., Franken Jr, E. A., Dorfman, D. D., Miller, E. M., Krupinski, E. A., Kreinbring, K., . . . Lu, C. H. (1996). Cause of satisfaction of search effects in contrast studies of the abdomen. Academic Radiology, 3(10), 815-826.
  9. Berbaum, K. S., Franklin, E. A. J., Caldwell, R. T., & Schartz, K. M. (2010). Satisfaction of search in traditional radiographic imaging. In E. Samei & E. Krupinski (Eds.), The Handbook of Medical Image Perception and Techniques (pp. 107-138). Cambridge, United Kingdom: Cambridge University Press.
  10. Biggs, A. T., Cain, M. S., Clark, K., Darling, E. F., & Mitroff, S. R. (2013). Assessing visual search performance differences between Transportation Security Administration Officers and nonprofessional visual searchers. Visual Cognition, 21(3), 330-352.
  11. Bolls, P. D., Lang, A., & Potter, R. F. (2001). The Effects of Message Valence and Listener Arousal on Attention, Memory, and Facial Muscular Responses to Radio Advertisements. Communication Research, 28(5), 627-651.
  12. Bradley, M. M., & Lang, P. J. (2007). The International Affective Digitized Sounds (2nd Edition; IADS-2): Affective ratings of sounds and instruction manual Technical report B-3. Gainesville, Fl.: University of Florida.
  13. Brosch, T., Grandjean, D., Sander, D., & Scherer, K. R. (2008). Cross-modal Emotional Attention: Emotional Voices Modulate Early Stages of Visual Processing. Journal of Cognitive Neuroscience, 21(9), 1670-1679.
  14. Cain, M. S., Adamo, S. H., & Mitroff, S. R. (2013). A taxonomy of errors in multiple-target visual search. Visual Cognition, 21(7), 899-921.
  15. Cain, M. S., Dunsmoor, J. E., LaBar, K. S., & Mitroff, S. R. (2011). Anticipatory Anxiety Hinders Detection of a Second Target in Dual-Target Search. Psychological Science, 22(7), 866-871.
  16. Derakshan, N., & Eysenck, M. W. (2009). Anxiety, processing efficiency, and cognitive performance: New developments from attentional control theory. European Psychologist, 14(2), 168-176.
  17. Fernandes, M. A., Koji, S., Dixon, M. J., & Aquino, J. M. (2011). Changing the focus of attention: The interacting effect of valence and arousal. Visual Cognition, 19(9), 1191-1211.
  18. Fleck, M. S., Samei, E., & Mitroff, S. R. (2010). Generalized “satisfaction of search”: Adverse influences on dual-target search accuracy. Journal of Experimental Psychology: Applied, 16(1), 60-71.
  19. Gasper, K., & Clore, G. L. (2002). Attending to the Big Picture: Mood and Global Versus Local Processing of Visual Information. Psychological Science, 13(1), 34-40.
  20. Jefferies, L. N., Smilek, D., Eich, E., & Enns, J. T. (2008). Emotional Valence and Arousal Interact in Attentional Control. Psychological Science, 19(3), 290-295.
  21. Kensinger, E. A. (2009). Remembering the Details: Effects of Emotion. Emotion Review, 1(2), 99-113.
  22. Lang, A., Dhillon, K., & Dong, Q. (1995). The effects of emotional arousal and valence on television viewers’ cognitive capacity and memory. Journal of Broadcasting & Electronic Media, 39(3), 313-327.
  23. Maiworm, M., Bellantoni, M., Spence, C., & Roder, B. (2012). When emotional valence modulates audiovisual integration. Attention, Perception, & Psychophysics, 74(6), 1302-1311.
  24. Mogg, K., & Bradley, B. P. (1999). Orienting of Attention to Threatening Facial Expressions Presented under Conditions of Restricted Awareness. Cognition and Emotion, 13(6), 713-740.
  25. Ohman, A., Flykt, A., & Esteves, F. (2001). Emotion drives attention: Detecting the snake in the grass. Journal of Experimental Psychology: General, 130(3), 466-478.
  26. Schupp, H. T., Markus, J., Weike, A. I., & Hamm, A. O. (2003). Emotional Facilitation of Sensory Processing in the Visual Cortex. Psychological Science, 14(1), 7-13.
  27. Storbeck, J., & Clore, G. L. (2005). With Sadness Comes Accuracy; With Happiness, False Memory: Mood and the False Memory Effect. Psychological Science, 16(10), 785-791.
  28. Thompson, W. F., Schellenberg, E. G., & Husain, G. (2001). Arousal, Mood, and The Mozart Effect. Psychological Science, 12(3), 248-251.
  29. Vuilleumier, P. (2005). How brains beware: neural mechanisms of emotional attention. Trends in Cognitive Sciences, 9(12), 585-594.
  30. Wolfe, J. M. (2012). When do I Quit? The Search Termination Problem in Visual Search. In M. D. Dodd & J. H. Flowers (Eds.), The Influence of Attention, Learning, and Motivation on Visual Search (pp.183-208): Springer New York.
  31. Zeelenberg, R., & Bocanegra, B. R. (2010). Auditory emotional cues enhance visual perception. Cognition, 115(1), 202-206.