帳號:guest(3.145.84.135)          離開系統
字體大小: 字級放大   字級縮小   預設字形  

詳目顯示

以作者查詢圖書館館藏以作者查詢臺灣博碩士論文系統以作者查詢全國書目
作者(中文):何天與
作者(外文):Ho, Tien-Yu
論文名稱(中文):以基於視線追蹤之機器翻譯呈現及語句對應輔助第二外語閱讀
論文名稱(外文):Second-Language Reading Support with Display of Machine Translation Based on Eye-Tracking and Sentence-Level Mapping
指導教授(中文):賴尚宏
指導教授(外文):Lai, Shong-Hong
口試委員(中文):王浩全
林文杰
口試委員(外文):Wang, Hao-Chuan
Lin, Wen-Chieh
學位類別:碩士
校院名稱:國立清華大學
系所名稱:資訊系統與應用研究所
學號:104065515
出版年(民國):106
畢業學年度:105
語文別:英文
論文頁數:51
中文關鍵詞:第二語言閱讀視線估測眼動儀閱讀輔助
外文關鍵詞:second-language readinggaze estimationeye trackerreading support
相關次數:
  • 推薦推薦:0
  • 點閱點閱:524
  • 評分評分:*****
  • 下載下載:17
  • 收藏收藏:0
在這個資訊爆炸的時代,我們常常需要使用世界上大多數人的第二語言──英語,於線上閱讀第一手的資料。然而,對於英語不專精的第二語言閱讀者讓他們很難有效率地了解英語網頁中的內容,在閱讀長篇的文章的問題尤為嚴重。在這個研究中,為了要增加第二語言閱讀者對於線上英語文章的理解程度和易讀性,我們提出了一個新的閱讀介面來幫助他們。這個介面利用視線追蹤技術提供的眼動資訊來適當地呈現機器翻譯,並使用背景顏色來做語句對應。我們進行了一個18 個參與者的實驗來研究不同機器翻譯的呈現方式以及語句對應的有無對第二語言閱讀者的影響。我們從實驗結果中發現,主動式翻譯 (active translation) 除了可以在不使第二語言閱讀者眼花的條件下幫助他們理解英語文章,也可以降低他們閱讀時的工作量。此外,使用背景顏色來實現的語句對應不只幫助配對句子和其對應的翻譯內容,它也緩和了跳行閱讀和閱讀恢復 (reading resumption) 的問題。在這篇論文的最後,我們也根據我們的研究結果,討論並提出了一些對於未來的第二語言閱讀協助系統設計的想法。
In the era of information explosion, we often need to read first-hand information online in English, which is the second-language of most of the people in the world. However, the unproficiency toward the second language makes it difficult for second-language readers to efficiently understand the contents on the English webpages, especially the long articles. In this work, for the purpose of enhancing second-language readers’ comprehension level and readability toward the online English articles, we propose a novel reading interface to support second-language readers with proper display of machine translation (MT) using eye tracking, accompanied with sentence-level mapping using background colors. We conducted an experiment with 18 participants to investigate how different methods of displaying of the MT results combined with or without sentence-level mapping affect the second-language readers. We found from our experimental results that active translation could help second-language readers comprehend the English article without dazzling them. In addition, sentence-level mapping using background colors not only benefits the mapping between original sentences and their corresponding ones, but also alleviates the problems of line skipping and reading resumption. At the end of the thesis, we discuss and bring up some design implications for future second-language reading supporting systems based on the results of our study.
ABSTRACT II
摘要 III
LIST OF FIGURES VI
LIST OF TABLES VII
CHAPTER 1. INTRODUCTION 1
CHAPTER 2. BACKGROUND 3
1.1 NON-NATIVE READING SUPPORT 3
1.2 EYE TRACKING 4
1.2.1 Gaze and Reading 4
1.2.2 Attention Switching on Online Reading and Learning 5
1.2.3 Gaze Control 5
1.3 MACHINE TRANSLATION (MT) 6
CHAPTER 3. PRELIMINARY STUDY: INFLUENCE OF DIFFERENT FORMS OF FIRST-LANGUAGE SUPPORT 7
3.1 PARTICIPANTS 7
3.2 MATERIALS 7
3.2.1 Tasks 7
3.2.2 Survey 11
3.2.3 Interview 11
3.3 PROCEDURE 11
3.4 MEASURES 12
3.4.1 Comprehension 12
3.4.1.1 Self-Reported Comprehension Level 12
3.4.1.2 Correctness of The Answer of Comprehension Test 12
3.4.2 Perceived Helpfulness 12
3.4.3 Preference 13
3.5 RESULT 13
3.5.1 Comprehension 13
3.5.1.1 Self-Reported Comprehension Level 13
3.5.1.2 Correctness Rate 14
3.5.2 Perceived Helpfulness 15
3.5.3 Preference 16
3.6 DISCUSSION 17
3.7 IMPLICATION 18
CHAPTER 4. EXPERIMENTAL DESIGN 19
4.1 PARTICIPANTS 19
4.2 MATERIALS 20
4.2.1 Tasks 20
4.2.2 Survey 24
4.3 SOFTWARE AND EQUIPMENT 24
4.4 PROCEDURE 25
CHAPTER 5. MEASURES 26
5.1 READING SPEED 26
5.2 COMPREHENSION LEVEL 26
5.2.1 Self-reported Comprehension Level 26
5.2.2 Correctness Rate 26
5.2.3 Correctness Rate per Unit Time 27
5.3 PRESENTATION READABILITY 27
5.4 WORKLOAD 27
CHAPTER 6. RESULTS 28
6.1 READING SPEED 28
6.2 COMPREHENSION LEVEL 29
6.2.1 Self-reported Comprehension Level 29
6.2.2 Correctness Rate 30
6.2.3 Correctness Rate per Unit Time 32
6.3 PRESENTATION READABILITY 34
6.3.1 Line Skipping 34
6.3.2 Degree of Being Dazzled 35
6.4 WORKLOAD 37
CHAPTER 7. DISCUSSION 39
7.1 THE AIDS OF AUTOMATIC MACHINE TRANSLATION 39
7.2 SENTENCE-LEVEL SEPARATION AND MAPPING USING COLORS 41
7.2.1 Separation 41
7.2.2 Mapping 42
7.3 INFORMATION OVERLOAD 43
CHAPTER 8. DESIGN IMPLICATIONS 44
8.1 USING MULTIPLE INPUT SOURCES 44
8.2 AUGMENTING THE USAGE OF HIGHLIGHTING, MAPPING AND SEPARATION BY COLORS 45
CHAPTER 9. LIMITATION AND FUTURE WORK 46
CHAPTER 10. CONCLUSION 47
REFERENCES 48
[1] Yu, C. H., & Miller, R. C. (2010, April). Enhancing web page readability for non-native readers. In Proceedings of the sIGCHI conference on human factors in computing systems (pp. 2523-2532). ACM.
[2] Yu, C. H., & Miller, R. C. (2012, May). Enhancing web page skimmability. In CHI'12 Extended Abstracts on Human Factors in Computing Systems (pp. 2655-2660). ACM.
[3] Yu, C. H., Thom-Santelli, J., & Millen, D. (2011, May). Enhancing blog readability for non-native english readers in the enterprise. In CHI'11 extended abstracts on human factors in computing systems (pp. 1765-1770). ACM.
[4] Wang, H. C., Han, C. H., Pan, M. H., & Yang, C. L. (2016, February). How Social Annotation Affects Second Language Reading. In Proceedings of the 19th ACM Conference on Computer Supported Cooperative Work and Social Computing Companion (pp. 429-432). ACM.
[5] Han, C. H., Yang, C. L., & Wang, H. C. (2014, April). Supporting second language reading with picture note-taking. In CHI'14 Extended Abstracts on Human Factors in Computing Systems (pp. 2245-2250). ACM.
[6] Hyrskykari, A., Majaranta, P., Aaltonen, A., & Räihä, K. J. (2000, November). Design issues of iDICT: a gaze-assisted translation aid. In Proceedings of the 2000 symposium on Eye tracking research & applications (pp. 9-14). ACM.
[7] Sibert, J. L., Gokturk, M., & Lavine, R. A. (2000, November). The reading assistant: eye gaze triggered auditory prompting for reading remediation. In Proceedings of the 13th annual ACM symposium on User interface software and technology (pp. 101-107). ACM.
[8] Hohlfeld, O., Pomp, A., Link, J. Á. B., & Guse, D. (2015, August). On the applicability of computer vision based gaze tracking in mobile scenarios. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (pp. 427-434). ACM.
[9] Copeland, L., & Gedeon, T. (2013, November). The effect of subject familiarity on comprehension and eye movements during reading. In Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration (pp. 285-288). ACM.
[10] Duggan, G. B., & Payne, S. J. (2011, May). Skim reading by satisficing: evidence from eye tracking. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 1141-1150). ACM.
[11] Duggan, G. B., & Payne, S. J. (2009). Text skimming: the process and effectiveness of foraging through text under time pressure. Journal of Experimental Psychology: Applied, 15(3), 228.
[12] Rochette, A., Goossens, C., Giot, R., & Frisson, C. (2016, June). ComixTrip: Reading Comic Books with Text Sequenced through Gaze Tracking. In Proceedings of the 2016 ACM Conference Companion Publication on Designing Interactive Systems (pp. 125-128). ACM.
[13] Kern, D., Marshall, P., & Schmidt, A. (2010, April). Gazemarks: gaze-based visual placeholders to ease attention switching. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (pp. 2093-2102). ACM.
[14] Jo, J., Kim, B., & Seo, J. (2015, April). EyeBookmark: Assisting recovery from interruption during reading. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (pp. 2963-2966). ACM.
[15] Leiva, L. A. (2011, May). MouseHints: easing task switching in parallel browsing. In CHI'11 Extended Abstracts on Human Factors in Computing Systems (pp. 1957-1962). ACM.
[16] Walker, S., Schloss, P., Fletcher, C. R., Vogel, C. A., & Walker, R. C. (2005). Visual-syntactic text formatting: A new method to enhance online reading. Reading Online, 8(6), 1096-1232.
[17] Iimura, Y., Oota, M., Tachimoto, S., & Kojo, Y. (2013, December). Phone call translator system in realtime. In Proceedings of International Conference on Advances in Mobile Computing & Multimedia (p. 365). ACM.
[18] Xu, B., Gao, G., Fussell, S. R., & Cosley, D. (2014, April). Improving machine translation by showing two outputs. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems (pp. 3743-3746). ACM.
[19] Gao, G., Xu, B., Hau, D. C., Yao, Z., Cosley, D., & Fussell, S. R. (2015, February). Two is better than one: improving multilingual collaboration by giving two machine translation outputs. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (pp. 852-863). ACM.
[20] Yamashita, N., & Ishida, T. (2006, November). Effects of machine translation on collaborative work. In Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work (pp. 515-524). ACM.
[21] Wang, H. C., Fussell, S., & Cosley, D. (2013, February). Machine translation vs. common language: Effects on idea exchange in cross-lingual groups. In Proceedings of the 2013 conference on Computer supported cooperative work (pp. 935-944). ACM.
[22] Gao, G., Yamashita, N., Hautasaari, A. M., & Fussell, S. R. (2015, April). Improving multilingual collaboration by displaying how non-native speakers use automated transcripts and bilingual dictionaries. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (pp. 3463-3472). ACM.
[23] Gao, G., Wang, H. C., Cosley, D., & Fussell, S. R. (2013, April). Same translation but different experience: the effects of highlighting on machine-translated conversations. In Proceedings of the sigchi conference on human factors in computing systems (pp. 449-458). ACM.
[24] Okoso, A., Kunze, K., & Kise, K. (2014, September). Implicit gaze based annotations to support second language learning. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication (pp. 143-146). ACM.
[25] http://www.kmf.com/. Retrieved 17 July 2017.
[26] Test your English. Cambridge English Language Assessment. Retrieved 17 July 2017, from http://www.cambridgeenglish.org/test-your-english/adult-learners/
[27] Lutteroth, C., Penkar, M., & Weber, G. (2015, November). Gaze vs. mouse: A fast and accurate gaze-only click alternative. In Proceedings of the 28th annual ACM symposium on user interface software & technology (pp. 385-394). ACM.
[28] Feng, W., Chen, M., & Betke, M. (2014, May). Target reverse crossing: a selection method for camera-based mouse-replacement systems. In Proceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments (p. 39). ACM.
[29] Kurauchi, A., Feng, W., Joshi, A., Morimoto, C., & Betke, M. (2016, May). EyeSwipe: Dwell-free text entry using gaze paths. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (pp. 1952-1956). ACM.
[30] Penkar, A., Lutteroth, C., & Weber, G. (2013, September). Eyes only: Navigating hypertext with gaze. In 14th International Conference on Human-Computer Interaction (INTERACT) (No. Part II, pp. 153-169). Springer.
[31] Hart, S. G., & Staveland, L. E. (1988). Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. Advances in psychology, 52, 139-183.
[32] Project IRIS. Downloaded on 20 Apirl 2017, from http://iris.xcessity.at/
[33] Text 2.0. https://text20.net/
 
 
 
 
第一頁 上一頁 下一頁 最後一頁 top
* *