The Effect of Emotional Sounds on Multiple Target Search

정서적인 소리가 다중 목표 자극 탐색에 미치는 영향

  • Received : 2015.06.19
  • Accepted : 2015.09.01
  • Published : 2015.09.30

Abstract

This study examined the effect of emotional sounds on satisfaction of search (SOS). SOS occurs when detection of a target results in a lesser chance of finding subsequent targets when searching for an unknown number of targets. Previous studies have examined factors that may influence the phenomenon, but the effect of emotional sounds is yet to be identified. Therefore, the current study investigated how emotional sound affects magnitude of the SOS effect. In addition, participants' eye movements were recorded to determine the source of SOS errors. The search display included abstract T and L-shaped items on a cloudy background and positive and negative sounds. Results demonstrated that negative sounds produced the largest SOS effect by definition, but this was due to superior accuracy in low-salient single target trials. Response time, which represents efficiency, was consistently faster when negative sounds were provided, in all target conditions. On-target fixation classification revealed scanning error, which occurs because targets are not fixated, as the most prominent type of error. These results imply that the two dimensions of emotion - valence and arousal - interactively affect cognitive performance.

References

  1. Alzubaidi, M., Black, J. A., Jr., Patel, A., & Panchanathan, S. (2009, 2-5 Aug. 2009). Conscious vs. subconscious perception, as a function of radiological expertise. Paper presented at the Computer-Based Medical Systems, 2009. CBMS 2009. 22nd IEEE International Symposium on.
  2. Anderson, A. K. (2005). Affective Influences on the Attentional Dynamics Supporting Awareness. Journal of Experimental Psychology: General, 134(2), 258-281. https://doi.org/10.1037/0096-3445.134.2.258
  3. Anderson, A. K., Christoff, K., Stappen, I., Panitz, D., Ghahremani, D. G., Glover, G., . . . Sobel, N. (2003). Dissociated neural representations of intensity and valence in human olfaction. Nature Neuroscience, 6(2), 196-202. https://doi.org/10.1038/nn1001
  4. Anderson, A. K., & Phelps, E. A. (2001). Lesions of the human amygdala impair enhanced perception of emotionally salient events. Nature, 411(6835), 305-309. https://doi.org/10.1038/35077083
  5. Andriole, K. P., Wolfe, J. M., Khorasani, R., Treves, S. T., Getty, D. J., Jacobson, F. L., . . . Seltzer, S. E. (2011). Optimizing Analysis, Visualization, and Navigation of Large Image Data Sets: One 5000-Section CT Scan Can Ruin Your Whole Day. Radiology, 259(2), 346-362. https://doi.org/10.1148/radiol.11091276
  6. Armony, J. L., & Dolan, R. J. (2002). Modulation of spatial attention by fear-conditioned stimuli: an event-related fMRI study. Neuropsychologia, 40(7), 817-826. https://doi.org/10.1016/S0028-3932(01)00178-6
  7. Becker, M. W. (2009). Panic Search: Fear Produces Efficient Visual Search for Nonthreatening Objects. Psychological Science, 20(4), 435-437. https://doi.org/10.1111/j.1467-9280.2009.02303.x
  8. Berbaum, K. S., Franken Jr, E. A., Dorfman, D. D., Miller, E. M., Krupinski, E. A., Kreinbring, K., . . . Lu, C. H. (1996). Cause of satisfaction of search effects in contrast studies of the abdomen. Academic Radiology, 3(10), 815-826. https://doi.org/10.1016/S1076-6332(96)80271-6
  9. Berbaum, K. S., Franklin, E. A. J., Caldwell, R. T., & Schartz, K. M. (2010). Satisfaction of search in traditional radiographic imaging. In E. Samei & E. Krupinski (Eds.), The Handbook of Medical Image Perception and Techniques (pp. 107-138). Cambridge, United Kingdom: Cambridge University Press.
  10. Biggs, A. T., Cain, M. S., Clark, K., Darling, E. F., & Mitroff, S. R. (2013). Assessing visual search performance differences between Transportation Security Administration Officers and nonprofessional visual searchers. Visual Cognition, 21(3), 330-352. https://doi.org/10.1080/13506285.2013.790329
  11. Bolls, P. D., Lang, A., & Potter, R. F. (2001). The Effects of Message Valence and Listener Arousal on Attention, Memory, and Facial Muscular Responses to Radio Advertisements. Communication Research, 28(5), 627-651. https://doi.org/10.1177/009365001028005003
  12. Bradley, M. M., & Lang, P. J. (2007). The International Affective Digitized Sounds (2nd Edition; IADS-2): Affective ratings of sounds and instruction manual Technical report B-3. Gainesville, Fl.: University of Florida.
  13. Brosch, T., Grandjean, D., Sander, D., & Scherer, K. R. (2008). Cross-modal Emotional Attention: Emotional Voices Modulate Early Stages of Visual Processing. Journal of Cognitive Neuroscience, 21(9), 1670-1679. https://doi.org/10.1162/jocn.2009.21110
  14. Cain, M. S., Adamo, S. H., & Mitroff, S. R. (2013). A taxonomy of errors in multiple-target visual search. Visual Cognition, 21(7), 899-921. https://doi.org/10.1080/13506285.2013.843627
  15. Cain, M. S., Dunsmoor, J. E., LaBar, K. S., & Mitroff, S. R. (2011). Anticipatory Anxiety Hinders Detection of a Second Target in Dual-Target Search. Psychological Science, 22(7), 866-871. https://doi.org/10.1177/0956797611412393
  16. Derakshan, N., & Eysenck, M. W. (2009). Anxiety, processing efficiency, and cognitive performance: New developments from attentional control theory. European Psychologist, 14(2), 168-176. https://doi.org/10.1027/1016-9040.14.2.168
  17. Fernandes, M. A., Koji, S., Dixon, M. J., & Aquino, J. M. (2011). Changing the focus of attention: The interacting effect of valence and arousal. Visual Cognition, 19(9), 1191-1211. https://doi.org/10.1080/13506285.2011.618151
  18. Fleck, M. S., Samei, E., & Mitroff, S. R. (2010). Generalized “satisfaction of search”: Adverse influences on dual-target search accuracy. Journal of Experimental Psychology: Applied, 16(1), 60-71. https://doi.org/10.1037/a0018629
  19. Gasper, K., & Clore, G. L. (2002). Attending to the Big Picture: Mood and Global Versus Local Processing of Visual Information. Psychological Science, 13(1), 34-40. https://doi.org/10.1111/1467-9280.00406
  20. Jefferies, L. N., Smilek, D., Eich, E., & Enns, J. T. (2008). Emotional Valence and Arousal Interact in Attentional Control. Psychological Science, 19(3), 290-295. https://doi.org/10.1111/j.1467-9280.2008.02082.x
  21. Kensinger, E. A. (2009). Remembering the Details: Effects of Emotion. Emotion Review, 1(2), 99-113. https://doi.org/10.1177/1754073908100432
  22. Lang, A., Dhillon, K., & Dong, Q. (1995). The effects of emotional arousal and valence on television viewers’ cognitive capacity and memory. Journal of Broadcasting & Electronic Media, 39(3), 313-327. https://doi.org/10.1080/08838159509364309
  23. Maiworm, M., Bellantoni, M., Spence, C., & Roder, B. (2012). When emotional valence modulates audiovisual integration. Attention, Perception, & Psychophysics, 74(6), 1302-1311. https://doi.org/10.3758/s13414-012-0310-3
  24. Mogg, K., & Bradley, B. P. (1999). Orienting of Attention to Threatening Facial Expressions Presented under Conditions of Restricted Awareness. Cognition and Emotion, 13(6), 713-740. https://doi.org/10.1080/026999399379050
  25. Ohman, A., Flykt, A., & Esteves, F. (2001). Emotion drives attention: Detecting the snake in the grass. Journal of Experimental Psychology: General, 130(3), 466-478. https://doi.org/10.1037/0096-3445.130.3.466
  26. Schupp, H. T., Markus, J., Weike, A. I., & Hamm, A. O. (2003). Emotional Facilitation of Sensory Processing in the Visual Cortex. Psychological Science, 14(1), 7-13. https://doi.org/10.1111/1467-9280.01411
  27. Storbeck, J., & Clore, G. L. (2005). With Sadness Comes Accuracy; With Happiness, False Memory: Mood and the False Memory Effect. Psychological Science, 16(10), 785-791. https://doi.org/10.1111/j.1467-9280.2005.01615.x
  28. Thompson, W. F., Schellenberg, E. G., & Husain, G. (2001). Arousal, Mood, and The Mozart Effect. Psychological Science, 12(3), 248-251. https://doi.org/10.1111/1467-9280.00345
  29. Vuilleumier, P. (2005). How brains beware: neural mechanisms of emotional attention. Trends in Cognitive Sciences, 9(12), 585-594. https://doi.org/10.1016/j.tics.2005.10.011
  30. Wolfe, J. M. (2012). When do I Quit? The Search Termination Problem in Visual Search. In M. D. Dodd & J. H. Flowers (Eds.), The Influence of Attention, Learning, and Motivation on Visual Search (pp.183-208): Springer New York.
  31. Zeelenberg, R., & Bocanegra, B. R. (2010). Auditory emotional cues enhance visual perception. Cognition, 115(1), 202-206. https://doi.org/10.1016/j.cognition.2009.12.004