A Study of Classroom-based Dynamic Assessment of EFL Listening Comprehension

doi:10.12002/j.bisu.413

Abstract

Abstract:

Dynamic assessment (DA) is based on Vygotsky’s sociocultural theory of mind, and provides new horizons for second language (L2) instruction and assessment by integrating these concepts and using the process of assessment to develop learners’ potential. The current study aims to prove the feasibility and effectiveness of DA in college English listening classes. Mixed methods were adopted in the process of the pre-test-intervention-post-test. Based on the data analysis of the test scores, questionnaires, reflection journals, and interview transcripts, the research results were as follows: 1) Systematically designed DA can be applied effectively in English listening classes in college; 2) the abovementioned DA can effectively promote the development of Chinese college English learners’ listening comprehension ability via mediational interactions; and 3) DA is conducive to guiding learners to select effective listening strategies reasonably, thus improving their overall language abilities, and giving them a sense of self-efficacy. In addition, both mediators and learners had positive attitudes toward DA, which contributed to creating a harmonious atmosphere in the classroom during their interactions. The findings provide empirical evidence for the use of DA in China’s college English listening classes, as well as implications for further research and practice.

Keywords: dynamic assessment; listening comprehension; mixed methods; EFL teaching

摘要：

动态评价起源于维果茨基对于人类能力的本体论认识，旨在评价、理解学习者的潜在能力，指导、支持学习者发展，构成动态、辩证、综合的课堂评价体系。本项研究采用混合研究方法，基于实证数据，探索了动态评价在提升高校英语听力课堂教学质量、促进学习者语言能力发展方面的可行性和有效性。研究结果表明，在动态评价过程中，学习者与教师进行互动并受益于教师的干预，其英语听力理解能力表现往往超越静态评价所获定论。学习者英语听力理解能力发展受其最近发展区影响，而非保持其静态测试评价的现有能力水平。动态评价有利于引导学习者合理选择有效的听力策略，整体提升语言学习水平，获得自我效能感。教师和学习者对动态评价均持积极态度，认为其有助于课堂教学过程中构建新型师生关系，并有助于教师提高教学水平，以及增强学生的语言能力。上述研究结果为动态评价在外语课堂教学中的应用提供了经验性证据。

关键词: 动态评价, 听力理解能力, 混合研究方法, 外语课堂教学

CLC Number:

H319.3

Qu Xin, Jia Li. A Study of Classroom-based Dynamic Assessment of EFL Listening Comprehension[J]. Journal of Beijing International Studies University, 2022, 44(5): 84-100.

曲鑫, 贾莉. 英语听力理解能力动态评价研究[J]. 北京第二外国语学院学报, 2022, 44(5): 84-100.

Figures/Tables 9

References 57

[1]	Ableeva R. Dynamic Assessment of Listening Comprehension in Second Language Learning[D]. Philadelphia: The Pennsylvania State University, 2010.
[2]	Aljaafreh A & Lantolf J P. Negative feedback as regulation and second language learning in the zone of proximal development[J]. The Modern Language Journal, 1994, 78(4):465-483. DOI URL
[3]	Anderson A & Lynch T. Listening[M]. Oxford: Oxford University Press, 1988.
[4]	Antón M. Dynamic Assessment of Advanced Foreign Language Learners[Z]. Washington:American Association of Applied Linguistics, 2003.
[5]	Bachman L F. Fundamental Considerations in Language Testing[M]. Oxford: Oxford University Press, 1990.
[6]	Bandura A. Social Foundations of Thought and Action:A Social Cognitive Theory[M]. Englewood Cliffs: Prentice Hall, 1986.
[7]	Bandura A. Self-Efficacy:The Exercise of Control[M]. New York: Freeman W H, 1997.
[8]	Bang S & Hiver P. Investigating the structural relationships of cognitive and affective domains for L2 listening[J]. Asian-Pacific Journal of Second and Foreign Language Education, 2016, 1(1):7. DOI URL
[9]	Blau E K. The effect of syntax,speed,and pauses on listening comprehension[J]. TESOL Quarterly, 1990, 24(4):746-753. DOI URL
[10]	Brindley G & Slatyer H. Exploring task difficulty in ESL listening assessment[J]. Language Testing, 2002, 19(4):369-394. DOI URL
[11]	Brunfaut T & Révész A. The role of task and listener characteristics in second language listening[J]. TESOL Quarterly, 2015, 49(1):141-168. DOI URL
[12]	Buck G & Tatsuoka K. Application of the rule-space procedure to language testing:Examining attributes of a free response listening test[J]. Language Testing, 1998, 15(2):119-157. DOI URL
[13]	Carrell P L, Dunkel P & Mollaun P. The Effects of Notetaking, Lecture Length and Topic on the Listening Component of TOEFL 2000[R]. Princeton: Educational Testing Service, 2002.
[14]	Davin K J. Group Dynamic Assessment in an Early Foreign Language Learning Program:Tracking Movement Through the Zone of Proximal Development[D]. Pittsburgh: University of Pittsburgh, 2011.
[15]	Davin K J. Integration of dynamic assessment and instructional conversations to promote development and improve assessment in the language classroom[J]. Language Teaching Research, 2013, 17(3):303-322. DOI URL
[16]	Feuerstein R, Rand Y, Hoffman M B, et al. Instrumental Enrichment:An Intervention Program for Cognitive Modifiability[M]. Baltimore: University Park Press, 1980.
[17]	Freedle R & Kostin I. Does the text matter in a multiple-choice test of comprehension? The case for the construct validity of TOEFL’s minitalks[J]. Language Testing, 1999, 16(1):2-32.
[18]	Ginther A. Context and content visuals and performance on listening comprehension stimuli[J]. Language Testing, 2002, 19(2):133-167. DOI URL
[19]	Grigornko E L, Sternberg R J & Ehrman M E. A theory-based approach to the measurement of foreign language learning ability:The Canal-F theory and test[J]. The Modern Language Journal, 2000, 84(3):390-405. DOI URL
[20]	Guthke J, Heinrich A & Caruso M. The diagnostic program of “syntactical rule and vocabulary acquisition” —A contribution to the psychodiagnosis of foreign language learning ability[C]//Klix F & Hagendorf H. Human Memory and Cognitive Capabilities:Mechanisms and Performances. Amsterdam:Elsevier, 1986:903-911.
[21]	Hasan A S. Learners’ perceptions of listening comprehension problems[J]. Language, Culture and Curriculum, 2000, 13(2):137-153. DOI URL
[22]	Jensen C & Hansen C. The effect of prior knowledge on EAP listening-test performance[J]. Language Testing, 1995, 12(1):99-119. DOI URL
[23]	Jensen C, Hansen C, Green S, et al. An investigation of item difficulty incorporating the structure of listening tests:A hierarchical linear modeling analysis[C]// Huhta A,Kohonen V,Kurki-Suonio L,et al. Current Developments and Alternatives in Language Assessment. Jyvaskyla: University of Jyvaskyla, 1997:151-164.
[24]	Kozulin A & Garb E. Dynamic assessment of EFL text comprehension[J]. School Psychology International, 2002, 23(1):112-127. DOI URL
[25]	Lantolf J P & Poehner M E. Dynamic assessment of L2 development:Bringing the past into the future[J]. Journal of Applied Linguistics, 2004, 1(1):49-74. DOI URL
[26]	Lantolf J P & Poehner M E. Dynamic Assessment in the Foreign Language Classroom:A Teacher’s Guide[M]. University Park: Center for Advanced Language Proficiency Education and Research (CALPER), 2006.
[27]	Naeini J. On the study of DA and SLA:Feuerstein’s MLE and EFL learners’ reading comprehension[J]. Procedia-Social and Behavioral Sciences, 2014, 98:1297-1306. DOI URL
[28]	O’Malley J M & Chamot A U. Learning Strategies in Second Language Acquisition[M]. New York: Cambridge University Press, 1990.
[29]	Pajares F. Self-efficacy beliefs and mathematical problem-solving of gifted students[J]. Contemporary Educational Psychology, 1996, 21(4):325-344. PMID
[30]	Petersen D B, Allen M M & Spencer T D. Predicting reading difficulty in first grade using dynamic assessment of decoding in early kindergarten:A large-scale longitudinal study[J]. Journal of Learning Disabilities, 2016, 49(2):200-215. DOI PMID
[31]	Poehner M E. Dynamic Assessment:A Vygotskian Approach to Understanding and Promoting L2 Development[M]. New York: Springer Publishing, 2008.
[32]	Poehner M E & Lantolf J P. Dynamic assessment in the language classroom[J]. Language Teaching Research, 2005, 9(3):233-265. DOI URL
[33]	Poehner M E & Lantolf J P. Bringing the ZPD into the equation:Capturing L2 development during computerized dynamic assessment(C-DA)[J]. Language Teaching Research, 2013, 17(3):323-342. DOI URL
[34]	Poehner M E, Zhang Jie & Lu Xiaofei. Computerized dynamic assessment(C-DA):Diagnosing L2 development according to learner responsiveness to mediation[J]. Language Testing, 2015, 32(3):337-357. DOI URL
[35]	Sadek N S. A Hybrid Dynamic Assessment(HDA)Model of Essay Writing by English Language Learners(ELL):An Exploratory Qualitative Study[D]. Pennsylvania: Indiana University of Pennsylvania, 2012.
[36]	Schmidt-Rinehart B C. The effects of topic familiarity on second language listening comprehension[J]. Modern Language Journal, 1994, 78(2):179-189. DOI URL
[37]	Schneider E & Ganschow L. Dynamic assessment and instructional strategies for learners who struggle to learn a foreign language[J]. Dyslexia, 2000, 6(1):72-82. PMID
[38]	Shohamy E & Inbar O. Validation of listening comprehension tests:The effect of text and question type[J]. Language Testing, 1991, 8(1):23-40. DOI URL
[39]	Spalding E & Wilson A. Demystifying reflection:A study of pedagogical strategies that encourage reflective journal writing[J]. Teachers College Record, 2002, 104(7):1393-1421. DOI URL
[40]	Taguchi N. Comprehending implied meaning in English as a foreign language[J]. The Modern Language Journal, 2005, 89(4):543-562. DOI URL
[41]	Tavakoli M, Shahraki S H & Rezazadeh M. The relationship between metacognitive awareness and EFL listening performance:Focusing on IELTS higher and lower scorers[J]. The Journal of Language Teaching and Learning, 2012, 2(2):24-37.
[42]	Vandergrift L. Recent developments in second and foreign language listening comprehension research[J]. Language Teaching, 2007, 40(3):191-210. DOI URL
[43]	Vandergrift L & Baker S. Learner variables in second language listening comprehension:An exploratory path analysis[J]. Language Learning, 2015, 65(2):390-416. DOI URL
[44]	Vygotsky L S. Thinking and speech[C]// Rieber R W & Carton A S. The Collected Works of L. S. Vygotsky:Problems of General Psychology(Vol. 1). New York: Plenum Press, 1987:39-285.
[45]	Vygotsky L S. The problem of age[C]// Rieber R W. The Collected Works of L. S. Vygotsky:Child Psychology(Vol. 5). New York: Plenum, 1998:187-205.
[46]	Vygotsky L S, Cole M, Jolm-Steiner V, et al. Mind in Society:The Development of Higher Psychological Processes[M]. Cambridge: Harvard University Press, 1978.
[47]	Wagner E. An investigation of how the channel of input and access to test questions affect L2 listening test performance[J]. Language Assessment Quarterly, 2013, 10(2):178-195. DOI URL
[48]	Wu W M & Stansfield C W. Towards authenticity of task in test development[J]. Language Testing, 2001, 18(2):187-206. DOI URL
[49]	Yanagawa K & Green A. To show or not to show:The effects of item stems and answer options on performance on a multiple-choice listening comprehension test[J]. System, 2008, 36(1):107-122. DOI URL
[50]	韩宝成. 动态评价理论、模式及其在外语教育中的应用[J]. 外语教学与研究, 2009, 41(6):452-458.
[51]	何勇斌. 听力测试的构想效度及其实现[J]. 外语教学, 2005, 26(3):72-75.
[52]	孔文, 李敦东, 余国兴. L2写作动态评估中同伴中介干预和教师中介干预比较研究[J]. 外语界, 2013(3):77-86.
[53]	李丹弟. 基于动态评价理论的英语语言学课程评价模式研究[J]. 外语界, 2015(6):19-25,84.
[54]	刘森, 武尊民. 国外语言动态评价的最新研究[J]. 现代外语, 2017, 40(6):837-847.
[55]	彭金定. 大学英语课堂教学动态评估[J]. 外语界, 2004(3):26-31.
[56]	彭金定, 谭颖. 大学英语课堂教学动态评估的开发与利用[J]. 外语教育, 2002, 2:40-44,46.
[57]	张艳红. 大学英语写作教学的动态评价研究[D]. 上海: 上海外国语大学, 2012.

干预活动				中介类型
学习者1	I can’t find the answer in the text.	教师（中介者）	Please raise your hands if you have similar questions.	Reminder of error

教师（中介者）	Please pay attention to the expression of “talk about” in the question, which is a typical item of listening for gist. Where should it be most likely located?	CLASS	At the beginning or the end.	Reminder of locating the relevant paragraph(s) of the text

教师（中介者）	But is it sufficient for you to just focus on the beginning and the end?	CLASS	No.	Reminder of searching space to one or several sentences

教师（中介者）	Gist is the theme of the text.	CLASS	——	Language knowledge
教师（中介者）	Please listen carefully to the full text, find the key words, and focus on the beginning and the end.	CLASS	——	Listening strategies

干预活动				中介类型
学习者1	I can’t find the answer in the text.	教师（中介者）	Please raise your hands if you have similar questions.	Reminder of error

教师（中介者）	Please pay attention to the expression of “talk about” in the question, which is a typical item of listening for gist. Where should it be most likely located?	CLASS	At the beginning or the end.	Reminder of locating the relevant paragraph(s) of the text

教师（中介者）	But is it sufficient for you to just focus on the beginning and the end?	CLASS	No.	Reminder of searching space to one or several sentences

教师（中介者）	Gist is the theme of the text.	CLASS	——	Language knowledge
教师（中介者）	Please listen carefully to the full text, find the key words, and focus on the beginning and the end.	CLASS	——	Listening strategies

变量	前测		后测		检验结果
变量	M	SD	M	SD	MD	t	df	Sig.（2-tailed）
分数	16.88	2.90	18.97	2.42	-1.242	-8.596	32	0.000

变量	前测		后测		检验结果
变量	M	SD	M	SD	MD	t	df	Sig.（2-tailed）
分数	16.88	2.90	18.97	2.42	-1.242	-8.596	32	0.000

变量	前测		后测		检验结果
变量	M	SD	M	SD	MD	t	df	Sig.（2-tailed）
分数	16.68	3.08	16.79	2.84	-0.118	-1.436	33	0.160