人的一生中充滿情緒。但多數時候，我們總是在覺察和接受情緒的過程中掙扎。根據美國心理學會的研究統計更顯示美國近 74％ 的成年人在 2018 年的過去一個月中至少經歷了一種壓力症狀，且其中 56％ 的人認為他們在 2017 年需要比原本更多的情感支持。雖然透過臉部表情來觀察和理解人們自己的情緒狀態時是會經常被想起並嘗試的處理方式，但除了臉部表情外，人們天生就具有通過非語言的情緒聲音（情緒語音）表達自己情緒的能力，這樣的能力甚至在尚未學會語言前就已具備。除此之外，聲音也被認為是能最多元普遍表達情感且跨文化被理解的情緒表達形式，這也讓如何透過情緒語音來幫助覺察情緒成為一個有趣且具啟發性的設計方向和探討空間。為了能進一步研究情緒語音如何促進人們意識到自己的情緒狀態，本研究提出由八張情緒卡和四張具有錄音播放功能的空白卡組成的設計物件進行實驗並進一步評估情緒語音、物件和使用者間的關係、影響和成效。實驗將參與者分成四組，並分別和不同版本的實體或數位設計物件進行進行為期 12 天的互動。同時於實驗過程中收集質化與量化數據，以進一步了解參與者的情緒語音和情緒覺察能力間的關聯、和對不同版本的設計物件的看法與行為。本研究旨在瞭解如何透過情緒聲音和實體/數位設計物件促進人們的情緒覺察能力，進而為人機互動領域做出貢獻。

Our life journey is full of and entangled with emotions. However, most of the time we struggle to be attentive to them and embrace their existence. According to the American Psychology Association, nearly 74% of adults in the US said they have experienced at least one symptom of stress during the past month in 2018, and among these people, 56% of them felt they needed more emotional support in 2017. Though facial expression is the first thing that comes to people’s mind when understanding one’s own emotional states, the act of vocalizing ones’ emotions is considered to be one of the most pervasive and enriching ways to express emotions across cultures, making it an interesting space for design. To investigate how emotional vocalizations motivate people to be aware of their emotional states, this study presents the design and evaluation of a tangible artifact consisting of eight emotion cards and four blank cards along with the audio recording/ replaying feature for capturing the emotional vocalization, and compares its effectiveness with different versions of the prototype via a four-condition experimental study design that lasted 12 days each. Both qualitative and quantitative data were collected to examine participant reactions and perceptions toward the different versions of the prototype. This study aims to contribute to the field of human-computer interaction by introducing emotional vocalizations to promoting people’s emotional awareness and examining the role of tangible and digital form factors in facilitating this process.

CHAPTER 1. INTRODUCTION 1
CHAPTER 2. LITERATURE REVIEW 4
2.1 THE ROLE OF EMOTIONAL AWARENESS IN EMOTIONAL INTELLIGENCE 4
2.2 RELATIONSHIP BETWEEN SOUNDS AND EMOTIONS: THE ROLE OF EMOTIONAL VOCALIZATIONS 5
2.3 TECHNOLOGIES THAT ENHANCE HUMAN SOUNDS INTERACTION FOR REFLECTION IN HCI AND PSYCHOLOGY 6
CHAPTER 3. METHODS 8
3.1 STUDY DESIGN 8
3.2 STUDY PROCEDURE 10
3.3 QUANTITATIVE MEASUREMENT 14
3.4 DATA ANALYSIS PROCEDURE 15
3.5 IRB APPROVAL AND INFORMED CONSENT 15
3.6 PARTICIPANTS OVERVIEW 15
CHAPTER 4. PROTOTYPE DESIGN AND IMPLEMENTATION 16
4.1 DESIGN ELEMENTS OF THE TANGIBLE/DIGITAL ARTIFACT FOR CONDITIONS 2, 3, 4 16
4.2 PROTOTYPE IMPLEMENTATION 20
CHAPTER 5. RESULTS 22
5.1 QUALITATIVE EVIDENCES ON THE EFFECT OF THE TANGIBLE/DIGITAL ARTIFACT 22
5.2 QUANTITATIVE EVIDENCES ON THE EFFECT OF THE TANGIBLE/DIGITAL ARTIFACT 30
CHAPTER 6. DISCUSSION 38
6.1 EFFECT OF THE EMOTION CARDS: THE ROLE OF ITS TEXTUAL AND VOCAL INFORMATION ON EMOTIONAL AWARENESS 38
6.2 EFFECT OF THE BLANK CARDS: THE ROLE OF SELF-GENERATED VOCAL & TEXTUAL INFORMATION ON EMOTIONAL AWARENESS 39
6.3 THE EFFECT OF EMOTION CLUSTERING, INTENSITY, AND PROTOTYPE MEDIUM ON EMOTIONAL AWARENESS 39
6.4 DESIGN FEATURES OF PROTOTYPE: WHAT WORKED, AND WHAT DID NOT WORK? 40
6.5 STUDY EFFECT ON PARTICIPANTS’ BEHAVIORS 41
CHAPTER 7. STUDY LIMITATIONS 43
CHAPTER 8. CONCLUSION AND FUTURE WORK 44

1. Alice Morby. 2016. Tools for Therapy encourage people to open up about their emotions (Nov. 2016). Retrieved Aug. 24, 2020 from https://www.dezeen.com/2016/11/04/tools-for-therapy-nicolette-bodewes-tactile-object-psychotherapy-dutch-design-week-2016/
2. All Electronics. 2012. ISD1820 Voice Recorder Module User Guide. (Oct. 2012). Retrieved Aug. 24, 2020 from https://www.allelectronics.com/mas_assets/media/allelectronics2018/spec/ME-63S.pdf
3. American Psychological Association. 2018. APA Dictionary of Psychology. Retrieved Aug. 24, 2020 from https://dictionary.apa.org/emotional-intelligence
4. American Psychological Association. 2018. Stress in America: Stress and Generation Z. (30 Oct. 2018). Retrieved Aug. 24, 2020 from https://www.apa.org/news/press/releases/stress/index.aspx
5. R.Michael Bagby, James D.A. Parker, and Graeme J. Taylor. 1994. The twenty-item Toronto Alexithymia scale—I. Item selection and cross-validation of the factor structure. Journal of Psychosomatic Research, Volume 38, Issue 1, Pages 23-32.
6. Reuven Bar-On. 2006. The Bar-On model of emotional-social intelligence (ESI). Psicothema, 18, 13-25.
7. Lisa Feldman Barrett, Michael Lewis, and Jeannette M. Haviland-Jones. 2016. Handbook of emotions (4th ed., pp. 467–482). New York, NY: Guilford Press.
8. Pascal Belin, Sarah Fillion-Bilodeau and Frédéric Gosselin. 2008. The Montreal Affective Voices: A validated set of nonverbal affect bursts for research on auditory affective processing. Behavior Research Methods 40, 531–539.
9. Jeff Blagdon. 2012. 'Sound-Word Index' can help you express your emotions online. Retrieved Aug. 24, 2020 from https://www.theverge.com/2012/6/26/3117887/sound-word-index-emotion-reference-online-dictionary
10. Andy Boucher, Dean Brown, Bill Gaver, Naho Matsuda, Liliana Ovalle, Andy Sheen, and Michail Vanis. 2019. ProbeTools: unconventional cameras and audio devices for user research. interactions 26, 2 (March - April 2019), 26–35.
11. David R. Caruso, Peter Salovey, Marc Brackett, and John D. Mayer. 2015. The ability model of emotional intelligence. Positive psychology in practice: Promoting human flourishing in work, health, education, and everyday life, 545-558.
12. Kyung Yun Choi, Darle Shinsato, Shane Zhang, Ken Nakagaki, and Hiroshi Ishii. 2018. reMi: Translating Ambient Sounds of Moment into Tangible and Shareable Memories through Animated Paper. In The 31st Annual ACM Symposium on User Interface Software and Technology Adjunct Proceedings (UIST’18 Adjunct). ACM, New York, NY, USA, 84-86.
13. Daniel T. Cordaro, Dacher Keltner, Sumjay Tshering, Dorji Wangchuk, and Lisa M. Flynn. 2016. The voice conveys emotion in ten globalized cultures and one remote village in Bhutan. Emotion 16(1), 117.
14. Alan Cowen, Hillary Elfenbein, Petri Laukka, and Dacher Keltner. 2018. Mapping 24 Emotions Conveyed by Brief Human Vocalization. American Psychologist 74(6), 698.
15. Alan Cowen, Disa Sauter, Jessica L. Tracy, and Dacher Keltner. 2019. Mapping the passions: Toward a high-dimensional taxonomy of emotional experience and expression. Psychological Science in the Public Interest, 20(1), 69-90.
16. Nele Dael, Marcello Mortillaro, Klaus R Scherer. 2012. Emotion expression in body action and posture. Emotion, 12, 1085–1101.
17. Charles Darwin. 1872. The expression of the emotions in man and animals (First ed. Ed.). London: John Murray.
18. Richard J. Davidson, Klaus R. Sherer, and H. Hill Goldsmith. 2009. Handbook of affective sciences. Oxford University Press.
19. Kevin A. Davies, Andrew M. Lane, Tracey J. Devonport, and Jamie A. Scott. 2010. Validity and reliability of a brief emotional intelligence scale (BEIS-10). Journal of Individual Differences.
20. Paul Ekman. 1993. Facial expression and emotion. American Psychologist, 48(4), 384–392.
21. Paul Ekman and Wallace V. Friesen. 1971. Constants across cultures in the face and emotion. Journal of Personality and Social Psychology, 17(2), 124–129.
22. Paul R. Gesn and William Ickes. 1999. The development of meaning contexts for empathic accuracy: Channel and sequence effects. Journal of Personality and Social Psychology, 77(4), 746.
23. Daniel Goleman. 2001. An EI-based theory of performance. The emotionally intelligent workplace: How to select for, measure, and improve emotional intelligence in individuals, groups, and organizations, 1, 27-44.
24. Judith A. Hall and Marianne Schmid Mast. 2007. Sources of accuracy in the empathic accuracy paradigm. Emotion, 7, 438 – 446.
25. Headspace. 2017. Mini meditation | Appreciate nature. Video. (23 April 2017). Retrieved Aug. 24, 2020 from https://youtu.be/nsGbtrl1WkU
26. Dacher Keltner, Disa Sauter, Jessica Tracy, and Alan Cowen. 2019. Emotional expression: Advances in basic emotion theory. Journal of Nonverbal Behavior. Advance online publication.
27. Michael W. Kraus. 2017. Voice-only communication enhances empathic accuracy. American Psychologist, 72, 644–654.
28. Mooli Lahad, Moshe Farhi, Dmitry Leykin, and Nira Kaplansky. 2010. Preliminary study of a new integrative approach in treating post-traumatic stress disorder: SEE FAR CBT. The Arts in Psychotherapy. Volume 37, Issue 5, Pages 391-399.
29. John D. Mayer and Peter Salovey. 1997. What is emotional intelligence. Emotional development and emotional intelligence: Educational implications 3: 31.
30. Karin Niemantsverdriet and Maarten Versteeg. 2016. Interactive Jewellery as Memory Cue: Designing a Sound Locket for Individual Reminiscence. In Proceedings of the TEI’16: Tenth International Conference on Tangible, Embedded, and Embodied Interaction (TEI’16). ACM, New York, NY, USA, 532-538.
31. Gerard Oleksik and Lorna M. Brown. 2008. Sonic gems: exploring the potential of audio recording as a form of sentimental memory capture. In Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 1 (BCS-HCI '08). BCS Learning & Development Ltd., Swindon, GBR, 163–172.
32. Christine E. Parsons, Katherine S. Young, Michelle G. Craske, Alan L. Stein, and Morten L. Kringelbach. 2014. Introducing the Oxford Vocal (OxVoc) Sounds database: a validated set of non-acted affective sounds from human infants, adults, and domestic animals. Frontiers in Psychology, Volume 5, p. 562.
33. Sally Planalp. 1996. Varieties of cues to emotion in naturally occurring situations. Cognition & Emotion, 10, 137–154.
34. Stephen Porter and Leanne Ten Brinke. 2008. Reading between the lies: Identifying concealed and falsified emotions in universal facial expressions. Psychological science, 19(5), 508-514.
35. Klaus R. Scherer. 1988. On the symbolic functions of vocal affect expression. Journal of Language and Social Psychology, 7(2), 79-100.
36. Klaus R. Scherer. 1995. Expression of emotion in voice and music. Journal of voice, 9(3), 235-248.
37. Klaus R. Scherer and Heiner Ellgring. 2007. Multimodal expression of emotion: Affect programs or componential appraisal patterns? Emotion, 7(1), 158–171.
38. Klaus R. Scherer, Tom Johnstone, and Gundrun Klasmeyer. 2003. Vocal expression of emotion. In R. J. Davidson, K. Scherer, & H. Hill Goldsmith (Eds.), Handbook of affective sciences (p. 433–456). New York, NY: Oxford University Press.
39. Ralf Schwarzer and Matthias Jerusalem. 1995. Generalized self-efficacy scale. Measures in health psychology: A user’s portfolio. Causal and control beliefs 1.1: 35-37.
40. Sophie K. Scott, Disa Sauter, and Carolyn McGettigan. 2010. Chapter 5.5 - Brain mechanisms for processing perceived emotional vocalizations in humans, Editor(s): Stefan M. Brudzynski, Handbook of Behavioral Neuroscience, Elsevier, Volume 19, Pages 187-197.
41. Martin Seligman. 2018. PERMA and the building blocks of well-being. The Journal of Positive Psychology 13.4: 333-335.
42. Emiliana R. Simon-Thomas, Dacher J. Keltner, Disa Sauter, Lara Sinicropi-Yao, and Anna J. Abramson. 2009. The voice conveys specific emotions: Evidence from vocal burst displays. Emotion, 9(6), 838.
43. Ryan A. Stevenson and Thomas W. James. 2008. Affective auditory stimuli: Characterization of the International Affective Digitized Sounds (IADS) by discrete emotional categories. Behavior research methods 40.1: 315-321.
44. The Oh Cards Institute. 2020. Applying OH cards to therapy and counselling. Retrieved Aug. 24, 2020 from https://www.oh-cards-institute.org/category/methods/therapy-and-counselling/
45. Wikipedia. 2020. Prosody (linguistics). Retrieved Aug. 24, 2020 from
https://en.wikipedia.org/wiki/Prosody_(linguistics)
46. Jamil Zaki, Niall Bolger, and Kevin Ochsner. 2009. Unpacking the informational bases of empathic accuracy. Emotion, 9, 478 – 487