冠詞、介係詞，名詞單複數與補語是非母語者最常犯的文法錯誤。我們提出一個新的方法，透過自動擷取英文樣式文法，來幫助非母語使用者寫作與編輯，使他們減少文法錯誤。基於自然語言處理的技術，我們的方法可以用特定文體的語料庫，自動擷取出英文的樣式文法。我們的研究路線，涉及將語料庫的句子的每個字轉換成文法樣式的元素，再把這些元素合成文法樣式，最後再抽出常用的文法樣式。我們同時也提出一個演算法，根據使用者輸入，來排名最佳文法樣式。初步的實驗顯示，我們能有效地取出對使用者有幫助的樣本文法，幫助使用者流利地的寫作，並避免文法錯誤。

Grammatical errors related to articles, prepositions, noun number, verb form, and complementation is the most frequent and
problematic writing errors produced by learners of English as a Second Language (ESL).
We introduce a method for extracting grammar patterns from a corpus for the purpose of assisting ESL learners in writing fluently and avoiding errors.
In our approach, phrase chunks are transformed into grammar patterns for statistical analysis and filtering.
The method involves extracting grammar patterns using templates, and selecting characteristic patterns for each content words.

We present an interactive writing environment, WriteAhead, that automatically displays extracted pattern and examples to prompt the users as they write away, or mouse around a draft during self-editing. We also extend the method to apply to error-annotated corpus and for extracting synchronous grammar patterns (SGP). These extracted SGPs can be used to provide more informative feedback to the user with a given sentence with potential errors for the purpose of assisted editing.
In our approach, grammar patterns are extracted from training data to generate feedback with corrections and explanation.
The method involves identifying patterns in pairs of erroneous and edited sentences covering an edit, and validate patterns extracted from the edited sentences, and counting the frequency of distinct SGPs.

We present a new system, WriteAhead, in writing mode, proactively provides writing suggestions using extracted grammar patterns and examples to assist student writers, as they write away.
Additionally, in editing mode, WriteAhead displays common edit patterns as corrective feedback for potential errors near the word under the cursor.

Preliminary experiments and evaluation show that WriteAhead with the acquired patterns and examples give reasonably effective writing suggestion and corrective feedback, and has potentials of promoting fluent and correct writing, based on evaluation on publicly available datasets.

Chinese Abstract i
Abstract ii
Acknowledgments iv
Contents v
List of Figures vii
List of Tables viii
Introduction 1
Related Work 6
Method 9
Experimental Setting 18
Evaluation Results 24
Conclusion and Future Work 29
References 30

Attali, Y. (2004). Exploring the feedback and revision features of criterion. Journal of Second Language Writing, 14, 191–205.
Bitchener, J. (2008). Evidence in support of written corrective feedback. Journal of second language writing, 17(2), 102–118.
Burstein, J., Chodorow, M., & Leacock, C. (2003). Criterionsm online essay evaluation: An application for automated evaluation of student essays. In Iaai (pp. 3–10).
Cahill, A., Madnani, N., Tetreault, J. R., & Napolitano, D. (2013). Robust systems for preposition error correction using wikipedia revisions. In Hlt-naacl (pp. 507–517). Caragea, C., Wu, J., Ciobanu, A., Williams, K., Fernández-Ramírez, J., Chen, H.-H., . . .
Giles, L. (2014). Citeseer x: A scholarly big dataset. In Advances in information retrieval (pp. 311–322). Springer.
Chodorow, M., Gamon, M., & Tetreault, J. (2010). The utility of article and preposition error correction systems for english language learners: Feedback and assessment. Language Testing.
Church, K. W., & Hanks, P. (1990). Word association norms, mutual information, and lexicography. Computational linguistics, 16(1), 22–29.
Felice, M., Yuan, Z., Andersen, Ø. E., Yannakoudakis, H., & Kochmar, E. (2014). Grammatical error correction using hybrid systems and type filtering. CoNLL-2014, 15.

Ferris, D. (1999). The case for grammar correction in l2 writing classes: A response to truscott (1996). Journal of second language writing, 8(1), 1–11.
Flowerdew, J. (1999). Problems in writing for scholarly publication in english: The case of hong kong. Journal of Second Language Writing, 8(3), 243–264. Francis, G., Hunston, S., & Manning, E. (1998). Collins cobuild grammar patterns: Nouns and adjectives. HarperCollins.
Graddol, D. (2003). The decline of the native speaker. Translation today: trends and perspectives. Clevedon: Multilingual Matters, 152–167. Hunston, S., & Francis, G. (2000). Pattern grammar: A corpus-driven approach to the lexical grammar of english. MIT Press.
Hunston, S., Francis, G., & Manning, E. (1996). Collins cobuild grammar patterns 1: verbs. London: HarperCollins Publishers. Jacobs, G. M., Curtis, A., Braine, G., & Huang, S.-Y. (1998). Feedback on student writing: Taking the middle path. Journal of second language writing, 7(3), 307–317.
Kulick, S., Bies, A., Liberman, M., Mandel, M., McDonald, R., Palmer, M., . . . White, P. (2004). Integrated annotation for biomedical information extraction. In Proc. of the human language technology conference and the annual meeting of the north american chapter of the association for computational linguistics (hlt/naacl) (pp. 61–68).
Langlais, P., & Lapalme, G. (2002). Trans type: Development-evaluation cycles to boost translator’s productivity. Machine Translation, 17(2), 77–98.
Leacock, C., Chodorow, M., Gamon, M., & Tetreault, J. (2010). Automated grammatical error detection for language learners. Synthesis lectures on human language technologies, 3(1), 1–134.

Leacock, C., Gamon, M., & Brockett, C. (2009). User input and interactions on microsoft research esl assistant. , 73–81.
Lin, D. (1998). Automatic retrieval and clustering of similar words. In Proceedings of the 36th annual meeting of the association for computational linguistics and 17th international conference on computational linguistics-volume 2 (pp. 768–774).
Liou, H.-C., Yang, P.-C., & Chang, J. (2012). Language supports for journal abstract writing across disciplines. Journal of Computer Assisted Learning, 28(4), 322–335.
Madnani, N., & Cahill, A. (2014). An explicit feedback system for preposition errors based on wikipedia revisions. ACL 2014, 79.
Mikolov, T., Sutskever, I., Chen, K., Corrado, G. S., & Dean, J. (2013). Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems (pp. 3111–3119).
Milton, J., & Cheng, V. S. (2010). A toolkit to assist l2 learners become independent writers. In Proceedings of the naacl hlt 2010 workshop on computational linguistics and writing: Writing processes and authoring aids (pp. 33–41).
Paquot, M. (2010). Academic vocabulary in learner writing: From extraction to analysis. Bloomsbury Publishing. Rundell, E., Michael. (2007). Macmillan english dictionary. Macmillan Education.
Sheen, Y. (2007). The effect of focused written corrective feedback and language aptitude on esl learners’ acquisition of articles. Tesol Quarterly, 41(2), 255–283. Shermis, M., Burstein, J., & Bliss, L. (2004). The impact of automated essay scoring on high stakes writing assessments. In annual meeting of the national council on measurement in education. Sinclair, J. (1991). Corpus, concordance, collocation. Oxford University Press.

Smadja, F. (1993). Retrieving collocations from text: Xtract. Computational linguistics, 19(1), 143–177.
Tateisi, Y., & Tsujii, J. (2004). Part-of-speech annotation of biology research abstracts. In Lrec.
Toutanova, K., Klein, D., Manning, C. D., & Singer, Y. (2003). Feature-rich part-ofspeech tagging with a cyclic dependency network. In Proceedings of the 2003 conference of the north american chapter of the association for computational linguistics on human language technology-volume 1 (pp. 173–180).
Truscott, J. (1996). The case against grammar correction in l2 writing classes. Language learning, 46(2), 327–369.
Tsuruoka, Y., & Tsujii, J. (2005). Bidirectional inference with the easiest-first strategy for tagging sequence data. In Proceedings of the conference on human language technology and empirical methods in natural language processing (pp. 467–474).
Turton, N. D., & Heaton, J. B. (1996). Longman dictionary of common errors. Longman.
Yannakoudakis, H., Briscoe, T., & Medlock, B. (2011). A new dataset and method for automatically grading esol texts. In Proceedings of the 49th annual meeting of the association for computational linguistics: Human language technologies-volume 1 (pp. 180–189).