A Corpus-Based Lexical Evaluation of L1 Arabic Learners’ English Literary Essays


Abstract

Evaluating learners’ writing quality has been quite challenging. One important indicator of writing quality is the use of lexis in texts. However, more efficient evaluative guidelines should be explored. Although corpus-based lexical studies have provided analyses of various text genres for word frequencies and keywords indicative of lexical density, and thus writing quality for teaching/learning purposes, learner literary texts remain under researched. This study explores the word frequencies in a corpus of N=206 L1 Arabic learners’ literary essays written in English in one literature course at an English medium university in Lebanon. Lextutor platform was used to analyze the word frequency profiles which indicate the lexical density level and Voyant Tools platform to analyze the content keyword profiles, which preview thematic representations and character features. Main findings indicated a dichotomy between literary knowledge and language proficiency. The content keywords previewed themes and character features adequately which showed the learners’ knowledge of the literary text. The word frequency profiles, however, indicated a low lexical density and, thus, a low language proficiency level. Implications for pedagogy and recommendations are made for further researching this “controversial dichotomy” in learners’ literary essays in developing the literary edge for well-rounded learners versus improving their language proficiency level.

Authors

Nahla Nola Bacha, Victor Khachan

Keywords

corpus linguistics, Lebanon, lexical richness, literary corpora, text analysis

References

Abu Ramman, Ronza and Jihad Hamdan. (2022). ‘Conceptual metaphors in political discourse: Evidence from the speeches of King Abdullah II of Jordan’. Dirasat: Human and Social Sciences, 49(5):189-205. DOI: 10.35516/hum.v49i5.3468. Aijmer, Karin. (ed.). (2009). Corpora and Language Teaching. Amsterdam: John Benjamins. Ajmal, Muhammad and Aisha Shoukat. (2020). ‘A corpus based study of James Joyce’s A Portrait of the Artist as a Young Man’. Corporum: Journal of Corpus Linguistics, 30(1):57–68. Alsuweed, Muhamad. (2015). Accessing Dicken’s style as an EFL learner: A corpus stylistic approach to lexical style. PhD Thesis. University of Huddersfield. Altenberg, Bengt. and Marie Tapper. (1998). ‘The use of adverbial connectors in advanced Swedish learners’ written English’. In S. Granger (ed.), Learner English on Computer, 80-93. London: Longman. Anthony, Lawrence. (2020).‘Lawrence Anthony's Website’. Retrieved from Lawrence Anthony’s Website: https://www.laurenceanthony.net/software/antconc/. Armstrong, Matthew I. (2017). ‘Literature and language teaching: Bridging EGAP and ESAP’. In G. Brooks (ed.), The 2016 PanSIG Journal Innovations in Education, 1-9. Asif, Muhammad, Shafqat Zaidi and FarihaYasmeen. (2021). ‘A corpus-based study of Austen’s novel Pride and Prejudice using Cirrus Tool’. Corporum: Journal of Corpus Linguistics, 4(1):60-72. Babanoğlu, Pinar M. and Kerem Sütçü. (2017). ‘A corpus-based study on the use of contractions by EFL learners in argumentative essays’. International Journal of Applied Linguistics and English Literature, 6(2):56-62. Bacha, Nahla Nola. (2001a). ‘Writing evaluation: What can analytic versus holistic essay scoring tell us’? System, 29(3):371-383. Bacha, Nahla Nola. (2005b). ‘Academic vocabulary: A corpus linguistic approach’. International Journal of Arabic-English Studies’, 6(1):123-146. Bacha, Nahla Nola and Victor Khachan. (2012c). ‘A lexical corpus based analysis of L2 academic vocabulary: A case study’. The Asian ESP Journal, 8(1):53-74. Bacha, Nahla Nola. (2016d). ‘Teaching the novel in a university English as a Foreign Language (EFL) context: An exploratory study in Lebanon’. International Journal of Learning, Teaching and Educational Research, 15(12):155-173. Bacha, Nahla Nola. (2020e). A ‘marriage’ between language and literature: Writing an argumentative literary essay in EFL contexts’. International Journal of Language and Literature, 8(2):31-39. Bahous, Rima. (2008). ‘The self‐assessed portfolio: A case study’. Assessment and Evaluation in Higher Education, 33(4):381-393. DOI: 10.1080/02602930701562866. Barabadi Elyas and Yasser Khajavi. (2017). ‘The effect of data-driven approach to teaching vocabulary on Iranian students’ learning of English vocabulary’. Cogent Education. 4(1):2-13. DOI: 10.1080/2331186X.2017.1283876. Behzadi, Lale and Vahid Behmardi.(2009). The Weaving of Words: Approaches to Classical Arabic Prose. Beiruter Texte und Studien (Serial No. 112), Orient-Institut Beirut. ISBN 978-3-89913-678-4. Benavides, Carlos. (2015). ‘Using a corpus in a 300 level Spanish grammar course’. Foreign Language Annals. 48(2):218-235. Biber, Douglas. (2011). ‘Corpus linguistics and the study of literature: Back to the future’. Scientific Study of Literature. 1(1):15-23. Deborah Schiffrin, Deborah Tannen, and Heidi Hamilton (eds.), The Handbook of Discourse Analysis, 175 -196. Massachusetts: Blackwell. Biber, Douglas, Stig Johansson, Geoffrey Leech, Susan Conrad and Edward Finegan (1999). Longman Grammar of Spoken and Written English. London: Longman. Bolton, Kingsley, Gerald Nelson and Joseph Hung. (2002). ‘A corpus- based study of connectors in student writing’. International Journal of Corpus Linguistics,7(2):165-182. Boulton, Alex (2016). ‘Integrating corpus tools and techniques in ESP courses’. ASp La Revue DuGERAS 69. |DOI-10.4000/asp.4826. Boulton, Alex and Thomas J (2012).’ Corpus language input, corpus processes in learning, learner corpus Product’. In James Thomas and Alex Boulton (Eds.), Introduction to input, Process and Product: Developments in Teaching and Language Corpora, 7-34, Masaryk University Press. Brynildssen, Shawna. (2000). ‘Vocabulary's influence on successful writing’. ERIC Digest D157. ED446339 2000-11-00. Butler, Ian. (2006). ‘A brighter future? Integrating language and literature for first-year university students’. In A. Paran (ed.), Literature in Language Teaching and Learning, 11-25. TESOL Inc. Bychkovska, Tetyana and Joseph J. Lee. (2017). ‘At the same time: Lexical bundles in L1 and L2 university student argumentative writing’. Journal of English for Academic Purposes, 30:38-52. Castello, Erik. (2008). Text Complexity and Reading Comprehension Tests. Peter Lang. Cobb, Tom. (2021). Web Compleat lexical tutor/vocabulary profile. www.lextutor.ca. (Retrieved on April 10, 2023). Coxhead, Averil. (2000). ‘A new academic word list’. TESOL Quarterly’, 34(2):213-238. Daoshan, MA. and Zhang Shuo. (2014). ‘A discourse study of the ice-burg principle in A Farewell to Arms’. Studies in Literature and Language, 8(1):80-84. de Beaugrand, Robert. (2001). ‘Interpreting the discourse of H. G. Widdowson: A corpus-based critical discourse analysis’. Applied Linguistics, 22(1): 104-121. DOI:10.1093/applin/22.1.104. Defazio, Joseph, Josette Jones, Felisa Tennant and Sara Anne Hook. (2010). ‘Academic literacy: The importance and impact of writing across the curriculum – a case study’. Journal of the Scholarship of Teaching and Learning, 10(2): 34-47. Diab, Nuwar and Ghada M. Awada. (2022). ‘Effect of language learning strategies and teacher versus peer feedback on reducing lexical errors of University Learners’. International Journal of Arabic-English Studies, 22(1):101-124. https://doi.org/10.33806/ijaes2000.22.1.6 Diab, Rula. (2006). ‘Error correction and feedback in the EFL writing classroom comparing instructor and student preferences’. English Teaching Forum, 44(3):2-13. https://eric.ed.gov/?id=EJ1107984. Egbert, Jesse, Brent Burch and Douglas Biber. (2020). ‘Lexical dispersion and corpus design’. International Journal of Corpus Linguistic, 25:89-115. DOI: 10.1075/Ijcl.18010.Egb. Engber, Cheryl A. (1995). The relationship of lexical proficiency to the quality of ESL compositions’, Second Language Writing, 4(2):139-155. Flowerdew, Lynne. (2009). ‘Applying corpus linguistics to pedagogy: A critical evaluation’. International Journal of Corpus Linguistics, 14(3):393-417. DOI: 10.1075/ijcl.14.3.05flo. Gemeinbock, Iris. (2016). ‘Representativeness in corpora of literary texts: Introducing the C18P project’. University of Vienna. Gilroy, Marie and Brian Parkinson. (1997). ‘Teaching literature in a foreign language’. Language Teaching, 29:213-25. Graesser, Arthur C., N. Dowell, and C Moldovan. (2011). ‘A computer’s understanding of literature’. Scientific Study of Literature, 1(1):24-33. The University of Memphis. Grant, Lesie, and April. (2000). ‘Using computer-tagged linguistic features to describe L2 writing differences’. Journal of Second Language Writing. 9:123-145. https://doi.org/10.1016/S1060-3 743(00)00019-9. Granger, Sylviane. (2002). ‘A bird's-eye view of computer learner corpus research’. In Susan Granger, J. Hung, S. Petch-Tyson and J. Hulstijn (eds.), Computer Learner Corpora, Second Language Acquisition and Foreign Language Teaching, 3-33. Amsterdam: John Benjamins. Granger, Sylviane. (2008). ‘Learner corpora’. In A. Ludeling, and M. Kyto (eds.). Corpus linguistics. An International Handbook. 1-14. Berlin: Walter de Gruyter Publisher. Granger, Sylviane, Estelle Dagneaux, Fanny Meunier and Magali Paquot. (2009). International Corpus of Learner English. Louvain-la-Neuve: Presses Universitaires de Louvain. Hamadeh, Wissam, Rima Bahous, Rula Diab, and Mona Nabhani. (2020). ‘Using social media to enhance second language learning’. Computer- Assisted Language Learning Electronic Journal, 21(2):132-149 . Hemingway, Ernest. (2004). A Farewell to Arms. Penguin. Hoey, Michael, Michaela Mahlberg, Michael Stubbs and Teubert Wolfgang. (eds.), (2007). Text, Discourse and Theory and Analysis. Continuum. Hoey, Michael. (2013). Lexical Priming. Taylor and Francis. Retrieved from https://www.perlego.com/book/1617387/lexical-priming-a-new-theory-of- words-and-language-pdf. (Original work published 2012). Höglund, Mikko and Kaj Syrjänen. (2016). ‘Corpus of early American literature’. ICAME Journal, 40(1):16-38. Hunston, Susan and Gill Francis. (2000). Pattern Grammar: A Corpus-Driven Approach to the Lexical Grammar of English. Amsterdam: John Benjamin. Hunston, Susan. (2002). Corpora in Applied Linguistics. Cambridge: University Press. Hunston, Susan. (2009). ‘The usefulness of corpus-based descriptions of English for learners: The case of relative frequency’. In Karin Aijmer (ed.), Corpora and Language Teaching, 141-156. Amsterdam: John Benjamins. Hussein, Khalid Shakir and Ina'am Abdul-Jebbar Abdul-kadhim. (2020). ‘A corpus-based stylistic identification of lexical density profile of three novels by Ernest Hemingway: The Sun also Rises, A Farewell to Arms, and A Moveable Feast’. (Retrieved on 15, December 2022). https://www.bing.com/search?q=Khalid+Shakir+Hussein Ihejirika, Richard C. (2014). ‘Literature and English language teaching and learning: A symbiotic relationship’. English Language Teaching, 7(3):84-90. Itani, Layla Youssef and Rima Bahous. (2019). ‘Media discourse analysis of news reports in Lebanese newspapers’, Global Media Journal, 17(32):1-10. Johns, Ann and Tony Dudley-Evans. (1997). ‘English for specific purposes: International in scope, specific in purpose’. TESOL Quarterly, 25(2): 297-314. Johns, Ann M. Anis Bawarshi, Richard M. Coe, Ken Hyland, Brian Paltridge and Mary Jo Reiff Christine Tardy. (2006).‘Crossing the boundaries of genre studies: Commentaries by experts’. Journal of Second Language Writing, 15:234-249. Johnson, Mark D., Anthony Acevedo and Leonardo Mercado. (2016). ‘Vocabulary knowledge and vocabulary use in second language writing’. TESOL Journal, 7:700-715. https://doi.org/10.1002/tesj.238. Khan, Mohammad Shamsur rabb Khan and Ali Mohammad. (2018). ‘Literary texts in the EFL classroom: Applications, benefits and approaches’. International Journal of Applied Linguistics and English Literature, 7(5): 167-179. Kroll, Barbara (ed.). (1991). Second Language Writing: Research Insights for the Classroom. Cambridge: Cambridge University Press. Laufer, Batia and Paul Nation. (1995). ‘Vocabulary size and use: Lexical richness in L2 written productions’. Applied Linguistics, 16(3):307-322. Laosrirattanachai, Paul and Sugunya Ruangjaroon. (2021). ‘Implementation of a data-driven hospitality lexis learning programme. 3L Language, Linguistics, Literature, 27(1): 1-21. Learning Corpus Bibliography. Learner Corpus Association (Retrieved from https://www.learnercorpusassociation.org on March 24, 2023). Lewis, Michael. (Ed.) (2000). Teaching Collocation: Further Developments in the Lexical Approach. Language Teaching Publications. Lin, Ching-His and Yen-Liang Lin. (2019). ‘Grammatical and lexical patterning of make in Asian learner writing: A corpus-based study of ICNALE’, 3L.The Southeast Asian Journal of English Language Studies. Yen-liang Lin | Semantic Scholar. López-Couso, María José, Belén Méndez-Naya, Paloma Núñez-Pertejo and Ignacio M. Palacios-Martínez (2016). Corpus Linguistics on the Move: Exploring and Understanding English through Corpora. Leiden: Brill. Mahlberg, Michaela. (2007). ‘A corpus stylistic perspective on Dickens’ Great Expectation’s. In M. Lambrou and Stockwell (eds.), Contemporary Stylistics, 19-31. London: Continuum. Mahlberg, Michaela. (2010). ‘Corpus linguistics and the study of nineteenth-century fiction’. Journal of Victorian Culture, (2):292-298. DOI:10.1080/13555502.2010.491667. Mahlberg, Michaela. (2012). ‘The corpus stylistic analysis of fiction – or the fiction of corpus stylistics’? In J. Mukherjee, and M. Huber (eds.), Corpus Linguistics and Variation in English, 77-95. Leiden: Brill. Mahlberg, Michaela, Voila Wiegand, Peter Stockwell, and Anthony Hennessey. (2019). ‘Speech-bundles in the 19th-century English novel’. Language and Literature, 28(4):326–353. Mart, Cagri Tugru (2021). ‘Literature-based instruction: A worthwhile approach for the mastery of a second language’. 3L Language. Linguistics, Literature, 27(2):49-61. Masood, Muhammad Hamzah, Shahzeb Shafi and Maqsood Darwesh. (2020). ‘Study of Shakespearean themes and characters through corpus based voyant tools approach’. Conference: National Conference on Education (NCE). McEnery, Tony and Richard Xiao. (2011). ‘What corpora can offer in language teaching and learning’. In E. Hinkel (ed.), Handbook of Research in Second Language Teaching and Research, 361-381. London: Routledge. McIntyre, Dan. (2013). ‘Corpora and literature’. Encyclopedia of Applied Linguistics, University of Huddersfeld. 1-14. McNaught, Carmel and Paul Lam. (2014). Using Wordle as a supplementary research tool. https://nsuworks.nova.edu/tqr/vol15/iss3/8 Moon, Rosamund. (2008). ‘Sinclair, phraseology, and lexicography’. International Journal of Lexicography. 21(3):243-254. https://doi.org/10.1093/ijl/ecn027 Mukattash, Lewis. (2003). ‘Towards a new methodology for teaching English to Arab learners’. International Journal Arabic-English Studies, 4:211-234. Nation, Paul. (1990). Teaching and Learning Vocabulary. London: Newbury House. Nation, Paul. (2001). Learning Vocabulary in Another Language. Cambridge: Cambridge University Press. Nation, Paul. (2021). ‘Is it worth teaching vocabulary’? TESOL Journal, 12(4). https://doi.org/10.1002/tesj.564 Nation, Paul and Paul Meara. (2020). ‘Vocabulary’. In N. Schmitt and M. Rodgers (3rd ed.) (eds.), An Introduction to Applied Linguistics, 35-54. London: Routledge. Nelson, Gerald. (2000). ‘An introduction to corpus linguistics’. Journal of English Linguistic, 28(2):193-196. Neumann, Stella. (2014). Contrastive Register Variation: A Quantitative Approach to the Comparison of English and German. Berlin: De Gruyter, Mouton. Nur, Aliyah. (2015). ‘Analyzing vocabulary level of the students’ essay writing and academic textbook utilizing lextutor’. Eternal Journal for Corpus, 1(1):15-27. O'Keeffe, Anne, Michael McCarthy, and Ronald Carter. (2007). From Corpus to Classroom: Language Use and Language Teaching. Cambridge: Cambridge University Press. Paran, Amos. (2006). ‘The stories of literature and language teaching’. In A. Paran (Ed.), Literature in Language Teaching and Learning, 1-10. TESOL Inc. Picoral, Adriana. (2018). Corpus Linguistics on the Move: Understanding English through Corpora. Leiden: Brill. Pretila, Päivi, Katalin Doró and Renata Pípalová. (eds.), (2015). Lexical Issues in L2 Writing. Cambridge: Cambridge scholars Publishing. Reppen, Randi. (2010). Using Corpora in the Classroom. Cambridge: Cambridge University Press. Research Uses of VocabProfile (lextutor.ca). (Retrieved from https://www.lextutor.ca/vp/eng/vp_research/html on March 23, 2023 Ridwan, Wahid. (2011). ‘The use of corpus-based techniques in literary analysis: Exploring learners’ perceptions’, Asiatic. 5(1):124-128. Römer, Ute. (2006).’Where the computer meets language, literature, and pedagogy: Corpus analysis in English studies.’ In A. Gerbig and A. Müller-Wood (eds.), How Globalization affects the Teaching of English: Studying Culture through Texts, 81-109. E. Mellen Press. Römer, Ute. (2009). ‘Corpus research and practice: What help do teachers need and what can we offer’? In Karin Aijmer (ed.), Corpora and Language Teaching, 83–98. John Benjamins. Sadaka, George. (2022). ‘Illnesses of illusion and disillusionment: From euphoria to aporia’, Life Writing, DOI:10.1080/14484528.2022.2127627. Sadaka, George and Vicky Panossian. (2022). ‘Policing Victorian women’s desire: Retracing mirrored patriarchy in Jane Eyre and Villette, Brontë Studies, 47(2):128-140, DOI: 10.1080/14748932.2022.2043675 Sampson, Geoffrey and Diana McCarthy (eds.), (2005). Corpus Linguistics in a Widening Discipline. London: Continuum. Scardamalia, Marlene and Carl Bereiter. (1987). ‘Knowledge telling and knowledge transforming in written composition’. In S. Rosenberg (ed.), Advances in Applied Psycholinguistics Reading, Writing and Language Learning, 2:142-175. Cambridge: Cambridge University Press. Schmitt, Norbert, and Michael Rodgers. (eds.), (2020). An Introduction to Applied Linguistics. London: Routledge. Scott, R. (2004). ‘Institutional theory: Contributing to a theoretical research Program’. In K. G. Smith, and M. A. Hitt, (eds.), Great Minds in Management: The Process of Theory Development, 460-484, Oxford: Oxford University Press. Shaaban, Kassem. (2017). ‘Challenges of teaching English in tertiary education in the Arab world. The ongoing rivalry between English and French in Lebanon: Current practices and future directions’. In A. Gebril (ed.), Applied linguistics in the Middle East and North Africa. Current Practices and Future Directions, 162-182. Amsterdam: John Benjamins. Shakeel, Rana K. and Muhammad K. Khan. (2021). ‘Compiling literary academic word list (LAWL): A corpus analysis of English papers’. Corporum: Journal of Corpus Linguistics, 3(2):92-115. Shaw, Philip. (2009). ‘Linking adverbials in student and professional writing in literary studies: What makes writing mature’. In M. Charles, D. Picorari, and Susan Hunston (eds.), Exploring the Interface between Corpus Linguistics and Discourse, 215-235. London: Continuum. Sinclair, John (1991). Corpus, Concordance, Collocation. Oxford: Oxford University Press. Sinclair, John. (2004). Trust the Text. London: Routledge. Sinclair, John. (2007). ‘Introduction’. In Michael Hoey, Michaela Mahlberg, Michael Stubbs and Wolfgang Teubert (eds.), Text, Discourse and Corpora: Theory and Analysis, 1–7. London: Continuum. Sinclair, Stefan and Geoffrey Rockwell. (2021). Voyant tools version 2.4 Web- based text analysis suite. Language Learning and Technology, 25(3):43– https://voyant- tools.org. Smith, J., and Colleen Kelly. (2002). ‘Stylistic constancy and change across literary corpora: Using measures of lexical richness to date works’. Computers and the Humanities, 36(4):411-430. www.jstor.org/stable/30204686. Stubbs, Michael. (2001). ‘Texts, corpora and problems of interpretation: A response to Widdowson’. Applied Linguistics, 22(2):149-72. Stubbs, Michael. (2005). ‘Conrad in the computer: Examples of quantitative stylistic techniques’. Language and Literature. 14(1):5-24. Toolan, Michael. (2004). ‘Values are descriptions: Or, from literature to linguistics and back again by way of keywords. Belgian Journal of English Language and Literatures (BELL New Series 2), 11-30. Ullah, Zafar, Muhammad Uzair and ArshadMahmood. (2019). ‘Extraction of key motifs as a preview from 2017 Nobel prize winning novel, ‘Never Let Me Go’: An interactive word cloud study’. Journal of Research in Social Sciences, 7(2):83-98. Ure, J. (1971). ‘Lexical density and register differentiation’. Contemporary Educational Psychology, 5:96-104. Viera, Rodrigo Tovar- . (2022).’ Lexical richness of abstracts in scientific papers in Anglophone and non-Anglophone Journals’. 3L: Language, Linguistics, Literature, 28(2). http://doi.org/10.17576/3L Voegelin, Cristina K. and Stefan Keller. (2021). ‘Linguistic features of formative feedback on ESL argumentative writing: Comparing pre-service and experienced teachers’. Issues in Applied Linguistics 22(0). -22. DOI10.5070/L422049267. Wahid, Ridwan. (2011). ‘The use of corpus-based techniques in literary analysis: Exploring learners’ perceptions’. Asiatic, 5(1):104-127. Widdowson, Henry G. (1991). ‘The description and prescription of language’. In J. Alatis (ed.), Georgetown University Round Table on Languages and Linguistics. 11–24. Washington, DC: Georgetown University Press. Widdowson, Henry G. (2008). ‘The novel features of text: Corpus analysis and stylistics’. In A. Gerbig and O. Mason (eds.), Language, People, Numbers, 93-304. Amsterdam: Rodopi. Widdowson, Henry G. (2000a). ‘Critical practices: On representations and the interpretation of text’. In S. Sarangi and M. Coulthard (eds.), Discourse and Social Life, 155-169. London: Longman. Widdowson, Henry G. (2000b). ‘The limitations of linguistics applied’. Applied Linguistics, 21(1):3-25. Wulff, Stefanie. (2017). ‘What learner corpus research can contribute to multilingual research’. International Journal of Bilingualism, 21(6):734-753. Yoon, Choongi. (2011). ‘Concordancing in L2 writing class: An overview of research and issues’. Journal of English for Academic Purposes, 10:130–139. Yu, Guoxing. 2010). ‘Lexical diversity in writing and speaking task performances’. Applied Linguistics, 31(2):236-259. Zhang, Xiaofei. (2022). ‘The relationship between lexical use and L2 writing quality: A case of two genres’. International Journal of Applied Linguistics and English Literature. https://onlinelibrary.wiley.com doi/10.1111/ijal.12420?af=R.