人們可能發現持續性地使用產品或設備來改善或維持健康狀態是一件困難的事，因為他們會對使用該產品或設備感到無聊或厭倦，其中的原因是使用性不佳所導致。因此，發展衡量使用性的方法或技術是一個重要的議題。衡量使用性的方法如同Jay等人(2008)所歸納，主要有五個衡量使用性的方法，這些方法分別是：使用問卷、畫面擷取、眼睛活動資料、動作觀察和訪談。根據我們對文獻的探討，我們考量有效性、效率性、滿意性、錯誤預防性、學習系、社交性來制定衡量使用性的問卷，並衡量其心智負荷以顯示其對於產品使用性的主觀認知。本研究利用問卷來獲得心理類型資料，以及利用心跳感測裝置和眼動儀來獲得生理類型資料，以此兩類資料為基礎，本研究發展一個衡量體感運動相關之展品使用性的方法以衡量該產品的使用性。
我們的研究顯示，心理類型資料與生理類型資料在對於使用性的主觀認知為正面時具有一致性。我們的研究結果和對於改善使用性的改善建議將使體感運動的設計人員得以改善運動效果與視覺訊息接收效率變異過大之情形，並且改善他們產品的使用性。

People might found it is hard to continue using the products or equipment in health improving or maintaining purpose because they feel bored or tired of using them. The reason for this problem was bad usability. It is an important issue for developing method or techniques to evaluate usability. As Jay et al. (2008) concluded, there were five techniques for evaluating usability and they were using questionnaires, screen captured scene, eye activity data, activity observation and interviewing. And based on our literature review, we customized a psychological usability questionnaire which considered effectiveness, efficiency, satisfaction, error-prevention, learnability, sociability, and mental workload, generating a tool meant to reveal the subjective cognition of product usability. This research develops an approach for measuring the usability of a motion-related health management product by using psychological data gathered from questionnaires and physiological data gathered from a heart rate sensor and an eye tracking device. Our analysis shows that the psychological data and physiological data tends consistent when the cognition appears to be positive on usability. The finding and suggestions enable motion sports designer guidelines to reduce the deviation of exercise effectiveness and efficiency of visual information receiving so that could improve the usability of their products.

摘要 I
Abstract II
致謝 III
Table of Contents IV
List of Tables VI
List of Figures VII
1. Introduction 1
2. Literature Review 4
2.1 Usability 4
2.2 Psychological Indicators 10
2.2.1 Questionnaires 10
2.2.2 Mental Workload 12
2.3 Physiological Indicators 13
2.3.1 Heart Rate Measuring 14
2.3.2 Eye Tracking 15
2.4 Summary 18
3. Methodology 20
3.1 Subjects 20
3.2 Apparatus 20
3.3 Experimental Design 24
3.3.1 Experiment Environment 24
3.3.2 Task for Subjects 26
3.3.3 Experiment Process 26
3.4 Data Collection 27
3.4.1 Psychological Data 29
3.4.2 Physiological Data 30
3.5 Psychological Indicators 30
3.5.1 Usability Questionnaires 30
3.5.2 NASA-TLX Questionnaires 33
3.6 Physiological Indicators 34
3.6.1 Heart Rate Measuring 34
3.6.2 Eye Tracking 39
3.7 Integrating Psychological and Physiological Data to Evaluate Usability 40
4. Case Study 42
4.1 Usability Questionnaires 43
4.2 NASA-TLX Questionnaires 50
4.3 Heart Rate Response 51
4.4 Eye Activity 54
4.5 Integrating Psychological and Physiological Data 60
4.5.1 Effectiveness Aspect and Heart Rate Ratio 60
4.5.2 Efficiency Aspect and Eye Activity 63
4.6 Suggestions of Usability Improvement 67
4.7 Academic and Practical Contribution 68
4.8 Limitations 69
5. Conclusion 70
References 72
Appendix 76
The Questionnaires Used in the Experiment 76
Institutional Review Board (IRB) Certification 85

[1] Antelmi, I., De Paula, R. S., Shinzato, A. R., Peres, C. A., Mansur, A. J., and Grupi, C. J. (2004). Influence of age, gender, body mass index, and functional capacity on heart rate variability in a cohort of subjects without heart disease. The American journal of cardiology, 93(3), 381-385.
[2] Bennett, J., Case, D., Sandelin, J., and Smith, M. (1984). Visual display terminals: Usability issues and health concerns. Prentice-Hall.
[3] Bevan, N. (1995a). Measuring usability as quality of use. Software Quality Journal, 4(2), 115-130.
[4] Bevan, N. (1995b). Usability is quality of use. Advances in Human Factors/Ergonomics, 20, 349-354.
[5] Bach, D. R., Flandin, G., Friston, K. J., and Dolan, R. J. (2010). Modeling event-related skin conductance responses, Journal of Psychophysiology, 75:349-356.
[6] Bohua, L., Lishan, S., and Jian, R. (2010) Driver’s Visual Cognition Behaviors of Traffic Signs: Based on Eye Movement Parameters, Journal of Transportation Systems Engineering And Information Technology, 11-4:22-27.
[7] Coursaris, C. K., and Kim, D. J. (2011). A meta-analytical review of empirical mobile usability studies. Journal of usability studies, 6(3), 117-171.
[8] Chen, S., and Epps, J. (2013) Automatic classification of eye activity for cognitive load measurement with emotion interference, Journal of Computer Methods and Programs in Biomedicine, 110:111-124.
[9] Djamasbi, S, Siegel, M., and Tullis, T. (2010) Generation Y, web design, and eye tracking, Journal of Human-Computer Studies, 68 307-323.
[10] Friesen, F. K. and Kingstone, A. (1998). The eyes have it! Reflexive orientingis triggered by nonpredictive gaze, Journal of Psychonomic Bulletin & Review 5-3:490-1272.
[11] Freedson, P. S., and Miller, K. (2000). Objective monitoring of physical activity using motion sensors and heart rate. Research Quarterly for Exercise and Sport, 71(2 Suppl), S21-9.
[12] Fletcher, G. F., Balady, G. J., Amsterdam, E. A., Chaitman, B., Eckel, R., Fleg, J. and Bazzarre, T. (2001). Exercise standards for testing and training a statement for healthcare professionals from the American Heart Association. Circulation, 104(14), 1694-1740.
[13] Finstad, K. (2010). The usability metric for user experience. Interacting with Computers, 22(5), 323-327.
[14] Gondoni, L. A., Titon, A. M., Nibbio, F., Augello, G., Caetani, G., and Liuzzi, A. (2009). Heart rate behavior during an exercise stress test in obese patients. Nutrition, Metabolism and Cardiovascular Diseases, 19(3), 170-176.
[15] Hart, S. G., and Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research, Human mental workload, 1-3:139-183.
[16] Hornbæk, K. (2006). Current practice in measuring usability: Challenges to usability studies and research, Journal of Human-Computer Studies, 64:79-102.
[17] Hassenzahl, M. and Tractinsky, N. (2006). User Experience: a research agenda, Journal of Behaviour & Information Technology,25-2:91-97.
[18] Hertzum, M., Hansen, K. D., and Andersen, H. H. K. (2009). Scrutinising usability evaluation: does thinking aloud affect behavior and mental workload, Journal of Behavior and Information Technology, 28-2:165-181.
[19] ISO 9001 (1994). Quality Systems - Model for Quality Assurance in Design Development, Production, Installation and Servicing. Geneva, Switzerland: International Standards Organization.
[20] International Organization for Standardization. (1998). ISO 9241-11: Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs): Part 11: Guidance on Usability.
[21] Jay, C., Lunn, D., and Michailidou, E. (2008). End user evaluations. In Web Accessibility (pp. 107-126). Springer London.
[22] Kjeldskov, J., and Stage, J. (2004). New techniques for usability evaluation of mobile systems, Journal of Human and Computer Studies, 60:599-620.
[23] Komlodi, A., Hou W., Preece, J., Druin, A., Golub, E., Jade, A., Liao, S., Elkiss, A., and Resnik, P. (2007). Evaluating a cross-cultural children’s online book community: Lessons learned for sociability, usability, and cultural exchange, Journal of Interacting with Computers, 19:494-511.
[24] Lin, H. X., Choong, Y. Y., and Salvendy, G. (1997). A proposed index of usability: a method for comparing the relative usability of different software systems, Journal of Behavior and Information Technology, 16-4/5:267-278.
[25] Land, M. F. (2006). Eye movements and the control of actions in everyday life, Journal of Retinal and Eye Research, 25:296-324.
[26] Lenker, J. A., Nasarwanji M., Paquet V., and Feathers, D. (2011). A tool for rapid assessment of product usability and universal design: Development and preliminary psychometric testing, Journal of Work, 39:141–150.
[27] Lee, Y., and Kozar, K. A. (2012). Understanding of website usability: Specifying and measuring constructs and their relationships. Decision Support Systems, 52(2), 450-463.
[28] Mancia, G., and Parati, G. (1987). Reactivity to physical and behavioral stress and blood pressure variability in hypertension. Handbook of hypertension,9, 104-122.
[29] Maslow, A. H. (1943). A theory of human motivation. Psychological review, 50(4), 370.
[30] Mandryk, R. L., Inkpen, K. M., and Calvert, T. W. (2006). Using psychophysiological techniques to measure user experience, Journal of Behaviour & Information Technology, 25-2:141-158.
[31] Mandryk, R. L. and Atkins, M. S. (2007). A fuzzy physiological approach for continuously modeling emotion during interaction with play technologies, Journal of Human-Computer Studies, 65:329-347.
[32] Memmert, D., Simons, D. J., and Grimme, T. (2009). The relationship between visual attention and expertise in sports. Psychology of Sport and Exercise,10(1), 146-151.
[33] Merino, G. S. A. D., Teixeira, C.S., Schoenardie, R. P., Merino, E. A. D., and Gontijo, L. A. (2012). Usability in Product Design-The importance and need for systematic assessment models in product development - Usa-Design Model (U-D), Journal of Work, 41:1045-1052.
[34] Nielsen, J. (1994, April). Usability inspection methods. In Conference companion on Human factors in computing systems (pp. 413-414). ACM.
[35] Parati, G., Pomidossi, G., Ramirez, A., Cesana, B., and Mancia, G. (1985). Variability of the haemodynamic responses to laboratory tests employed in assessment of neural cardiovascular regulation in man. Clinical Science, 69(Pt 5), 533-540.
[36] Parati, G., Pomidossi, G., Casadei, R., Ravogli, A., Groppelli, A., Cesana, B., and Mancia, G. (1988). Comparison of the cardiovascular effects of different laboratory stressors and their relationship with blood pressure variability.Journal of hypertension, 6(6), 481-488.
[37] Preece, J. (2001). Sociability and usability in online communities: determining and measuring success, Journal of Behaviour & Information Technology, 20-5:347-356.
[38] Preece, J., Rogers, Y., and Sharp, H. (2001). Handbook of Interaction design: beyond human-computer interaction. Wiley & Sons Publishers Inc., New York, NY.
[39] Pasch, M., Berthouze, N. B., Dijk, B. V., and Nijholt, A. (2009). Movement-based sports video games: investigating motivation and gaming experience, Journal of Entertainment Computing, 1:49-61.
[40] Ramakrisnan, P., Jaafar, A., Razak, F. H. A., and Ramba, D. A. (2012). Evaluation of user Interface Design for Leaning Management System (LMS): Investigating Student's Eye Tracking Pattern and Experiences. Procedia-Social and Behavioral Sciences, 67, 527-537.
[41] Report of International Labor Statistics (2013). Executive Yuan of Taiwan, Council of Labor Affairs, Directorate-General of Budget, Accounting and Statistics.
[42] Shackel, B. and Richardson, S. (1991). Human factors for informatics usability. New York: Cambridge University Press.
[43] Smith, J. J., Porth, C. M., and Erickson, M. (1994). Hemodynamic response to the upright posture. The Journal of Clinical Pharmacology, 34(5), 375-386.
[44] Sutcliffe, A. G., and Kaur, K.D. (2000). Evaluating the usability of virtual reality user, Journal of Behaviour & Information Technology, 19-6:415-426.
[45] Stolarz, K., Staessen, J. A., Kuznetsova, T., Tikhonoff, V., Babeanu, S., Casiglia, E., and Nikitin, Y. (2003). Host and environmental determinants of heart rate and heart rate variability in four European populations. Journal of hypertension, 21(3), 525-535.
[46] Stigchel, S. V. d., Meeter, M., and Theeuwes, J. (2006). Eye movement trajectories and what they tell us, Journal of Neuroscience and Biobehavioral Reviews 30:666–679.
[47] Sawahata, Y., Khosla, R, Komine, K., Hiruma, N., Itou, T., Watanabe, S., Suzuki, Y., Hara, Y., and Issiki, N. (2008). Determining comprehension and quality of TV programs using eye-gaze tracking, Journal of Pattern Recognition, 41: 1610-1626.
[48] Stickel, C., Ebner, M., Steinbach-Nordmann, S., Searle, G., and Holzinger, A. (2009). Emotion Detection: Application of the Valence Arousal Space for Rapid Biological Usability Testing to Enhance Universal Access, Journal of Lecture Notes in Computer Science, 5614:615-624.
[49] Stigchel, S. V. d. (2010). Recent advances in the study of saccade trajectory deviations, Journal of Vision Research, 50:1619-1627.
[50] Stasi, L. L. D., Antolí, A., Gea, M., and Cañas, J. J. (2011). A neuroergonomic approach to evaluating mental workload in hypermedia interactions, Journal of Industrial Ergonomics, 41:298-304.
[51] Shalom, D. E., Dagnino, B., and Sigman, M. (2011). Looking at breakout: Urgency and predictability direct eye events. Vision research, 51(11), 1262-1272.
[52] Salvendy, G., Soares, M. M., Karwowski, W., and Rebelo, F. (Eds.). (2012). Advances in Usability Evaluation (Vol. 20). CRC Press.
[53] Tullis, T. and Albert, B. (2008). Handbook of Measuring the User Experience: Collecting, Analyzing, and Presenting Usability Metrics, Morgan Kaufmann Publishers Inc., San Francisco, CA.
[54] Vitense, H. S., Jacko, J. A., and Emery, V. K. (2003). Multimodal feedback: an assessment of performance and mental workload, Journal of Ergonomics, 46:1-3:68-87.
[55] Virvou, M., and Katsionis, G. (2008). On the usability and likeability of virtual reality games for education: The case of VR-ENGAGE, Journal of Computers & Education, 50:154-178.
[56] Valentini, M., and Parati, G. (2009). Variables influencing heart rate. Progress in cardiovascular diseases, 52(1), 11-19.
[57] Vidal, M., Turner, J., Bulling, A., and Gellersen H. (2012). Wearable eye tracking for mental health monitoring, Journal of Computer Communications, 35:1306-1311.
[58] Velasquez, J. D. (2013) Combining eye-tracking technologies with web usage mining for identifying Website Key objects, Journal of Engineering Applications of Artificial Intelligence,26:1469–1478.
[59] Watson, D., Anna, L., and Tellegen, C. A. (1988). Development and Validation of Brief Measures of Positive and Negative Affect: The PANAS Scales, Journal of Personality and Social Psychology, 54-6:1063-1070.
[60] Yannakakis, G. N. and Hallam, J. (2008). Entertainment modeling through physiology in physical play, Journal of Human-Computer Studies, 66:741-755.
[61] Yen, P. Y. (2010). Health information technology usability evaluation: methods, models, and measures (Doctoral dissertation, Columbia University).