多模态构式语法研究：理论渊源、研究框架与发展前瞻

doi:10.12002/j.bisu.385

摘要/Abstract

摘要：

近年来,构式语法研究出现了多模态转向,多模态构式语法研究成为该领域新的研究动向。本文结合构式语法理论的使用观和意义观,概述了多模态构式研究的理论渊源和研究框架,并在评述现有研究的基础上,展望多模态构式语法研究的发展前景。多模态构式研究为考察构式义提供了新的观测窗口,有助于更完整地分析构式义,拓展构式概念的内涵,从而能够丰富和完善构式语法理论。同时,当前的多模态构式研究也存在多模态构式标准模糊、研究方法不够客观等问题。

关键词: 构式语法; 多模态构式; 手势; 言语

Abstract:

In recent years, the study of Multimodal Construction Grammar has received increasing attention. Against this background, this paper first provides an analysis of the rationale behind studies of Multimodal Construction Grammar, including two basic tenets of Construction Grammar: a usage-based approach to constructions and constructional meaning as conceptualization. Second, it summarizes the research framework, which involves the following elements: (1) the form and meaning of verbal constructions, (2) the form and meaning of gestures, (3) the formal relationship between gestures and verbal constructions, (4) the semantic relationship between gestures and verbal constructions, and (5) the conventionality of multimodal form-meaning pairings. Furthermore, a case analysis of a multimodal modal particle construction in German is provided to illustrate how this framework can be applied to examine the multimodality of constructions. After that, the theoretical implications of these studies are discussed. Multimodal constructional studies provide a new and more direct tool for exploring the meaning of constructions and help in reconsidering the nature of linguistic structures and broadening the scope of constructions. Finally, a number of theoretical and empirical challenges are raised; for instance, the criteria for defining multimodal constructions are still somewhat fuzzy, and research methods on multimodal constructions are still not quantitative or diversified enough.

Keywords: construction grammar; multimodal construction; gesture; speech

中图分类号:

H043

吴素伟. 多模态构式语法研究：理论渊源、研究框架与发展前瞻[J]. 北京第二外国语学院学报, 2022, 44(2): 96-108.

Wu Suwei. Studies on Multimodal Construction Grammar: Theoretical Motivation, Research Framework, and Prospects[J]. Journal of Beijing International Studies University, 2022, 44(2): 96-108.

图/表 2

参考文献 45

[1]	Bavelas J, Gerwing J, Sutton C, et al. Gesturing on the telephone:Independent effects of dialogue and visibility[J]. Journal of Memory and Language, 2008, 58(2):495-520. DOI URL
[2]	Bressem J, Ladewig S H, & Müller C. Linguistic annotation system for gestures(LASG)[C]// Müller C,Cienki A,Fricke E,et al. Body-Language-Communication:An International Handbook on Multimodality in Human Interaction. Vol. 1. Berlin:Mouton de Gruyter, 2013:1098-1125.
[3]	Bressem J, & Müller C. The “Negative-Assessment-Construction”- A multimodal pattern based on a recurrent gesture?[J/OL]. Linguistics Vanguard, 2017, 3(s1).(2017-06-29)[2022-03-10]. https://doi.org/10.1515/lingvan-2016-0053.
[4]	Cánovas C P, & Valenzuela J. Timelines and multimodal constructions:Facing new challenges[J/OL]. Linguistics Vanguard, 2017, 3(s1).(2017-06-29)[2022-03-10]. https://doi.org/10.1515/lingvan-2016-0087.
[5]	Cienki A. Image schemas and gesture[C]// Hampe B. From Perception to Meaning:Image Schemas in Cognitive Linguistics. Berlin:Mouton de Gruyter. 2005:421-441.
[6]	Cienki A. Spoken language usage events[J]. Language and Cognition, 2015, 7(4):499-514. DOI URL
[7]	Cienki A. Cognitive linguistics,gesture studies,and multimodal communication[J]. Cognitive Linguistics, 2016, 27(4):603-618. DOI URL
[8]	Cienki A, & Müller C. Metaphor and Gesture[M]. Amsterdam: Benjamins, 2008.
[9]	Croft W. Radical Construction Grammar:Syntactic Theory in Typological Perspective[M]. Oxford: Oxford University Press, 2001.
[10]	Debreslioska S, Özyürek A, Gullberg M, et al. Gestural viewpoint signals referent accessibility[J]. Discourse Processes, 2013, 50(7):431-456. DOI URL
[11]	Duncan S D. Gesture,verb aspect,and the nature of iconic imagery in natural discourse[J]. Gesture, 2002, 2(2):183-206. DOI URL
[12]	Enfield N J. On linear segmentation and combinatorics in co-speech gesture:A symmetry-dominance construction in Lao fish trap descriptions[J]. Semiotica, 2004, 149:57-123.
[13]	Enfield N J, Kita S, & de Ruiter J P. Primary and secondary pragmatic functions of pointing gestures[J]. Journal of Pragmatics, 2007, 39(10):1722-1741. DOI URL
[14]	Forceville C J, & Urios-Aparisi E. Multimodal Metaphor[M]. Berlin: Mouton de Gruyter, 2009.
[15]	Fricke E. Towards a unified grammar of gesture and speech:A multimodal approach[C]// Müller C,Cienki A & Fricke E,et al. Body-Language-Communication:An International Handbook on Multimodality in Human Interaction. Vol. 1. Berlin:Mouton de Gruyter, 2013:733-754.
[16]	Goldberg A E. A Construction Grammar Approach to Argument Structure[M]. Chicago: University of Chicago Press, 1995.
[17]	Goldberg A E. Constructions at Work:The Nature of Generalization in Language[M]. Oxford: Oxford University Press, 2006.
[18]	Goldin-Meadow S, & Butcher C. Pointing toward two-word speech in young children[C]// Kita S. Pointing:Where Language,Culture,and Cognition Meet. Mahwah:Erlbaum, 2003:85-107.
[19]	Harrison S. The Impulse to Gesture:Where Language,Minds,and Bodies Intersect[M]. Cambridge: Cambridge University Press, 2018.
[20]	Hinnell J. The multimodal marking of aspect:The case of five periphrastic auxiliary constructions in North American English[J]. Cognitive Linguistics, 2018, 29(4):773-806. DOI URL
[21]	Hoffmann T. Multimodal constructs-multimodal constructions? The role of constructions in the working memory[J/OL]. Linguistics Vanguard, 2017, 3(s1).(2017-06-29)[2022-03-10]. https://doi.org/10.1515/lingvan-2016-0042.
[22]	Kendon A. Gesture:Visible Action as Utterance[M]. Cambridge: Cambridge University Press, 2004.
[23]	Kok K I. The Status of Gesture in Cognitive-Functional Models of Grammar[D]. Amsterdam: Vrije Universiteit Amsterdam, 2017.
[24]	Kok K I, & Cienki A. Cognitive Grammar and gesture:Points of convergence,advances and challenges[J]. Cognitive Linguistics, 2016, 27(1):67-100. DOI URL
[25]	Ladewig S H. Syntactic and Semantic Integration of Gestures into Speech:Structural,Cognitive,and Conceptual Aspects[D]. Frankfurt(Oder):European University Viadrina, 2011.
[26]	Langacker R W. Discourse in Cognitive Grammar[J]. Cognitive Linguistics, 2001, 12(2):143-188.
[27]	Langacker R W. Cognitive Grammar:A Basic Introduction[M]. Oxford: Oxford University Press, 2008.
[28]	McNeill D. Hand and Mind:What Gestures Reveal about Thought[M]. Chicago: University of Chicago Press, 1992.
[29]	Müller C. Gestural modes of representation as techniques of depiction[C]// Müller C,Cienki A,Fricke E,et al. Body-Language-Communication:An International Handbook on Multimodality in Human Interaction. Vol. 2. Berlin:Mouton de Gruyter, 2014:1687-1702.
[30]	Müller C. How recurrent gestures mean:Conventionalized contexts-of-use and embodied motivation[J]. Gesture, 2017, 16(2):277-304. DOI URL
[31]	Ruth-Hirrel L, & Wilcox S. Speech-gesture constructions in cognitive grammar:The case of beats and points[J]. Cognitive Linguistics, 2018, 29(3):453-493. DOI URL
[32]	Schoonjans S. Modalpartikelnals Multimodale Konstruktionen:Einekorpusbasierte Kookkurrenzanalyse von Modalpartikeln und Gestikim Deutschen[D]. Leuven:University of Leuven, 2014.
[33]	Steen F,& Turner M. Multimodal construction grammar[C]// Borkent M,Dancygier B & Hinnell J. Language and the Creative Mind. Stanford:CSLI Publications, 2013:255-274.
[34]	Streeck J. Forward-gesturing[J]. Discourse Processes, 2009, 46(2-3):161-179. DOI URL
[35]	Wilcox S. Cognitive iconicity:Conceptual spaces,meaning,and gesture in signed language[J]. Cognitive Linguistics, 2004, 15(2):119-147.
[36]	Wu S. Multimodality of Constructions in Construction Grammars:Transitivity,Transitivity Alternations,and the Dative Alternation[D]. Amsterdam:Vrije Universiteit Amsterdam, 2018.
[37]	Zima E. English multimodal motion constructions:A construction grammar perspective[J/OL]. Papers of the Linguistic Society of Belgium, 2014(8):14-29[2022-03-10]. https://sites.uclouvain.be/bkl-cbl/wp-content/uploads/2014/08/Zim2013.pdf.
[38]	Zlatev J.What’s in a schema? What’s in a schema? Bodily mimesis and the grounding of language[C]// Hampe B. From Perception to Meaning:Image Schemas in Cognitive Linguistics. Berlin:Mouton de Gruyter, 2005:313-342.
[39]	方梅. 浮现语法--基于汉语口语和书面语的研究[M]. 北京: 商务印书馆, 2018.
[40]	郭恩华, 张德禄. 基于会话分析的多模态交际研究探索--论序列分析在CA多模态交际研究中的应用[J]. 北京第二外国语学院学报, 2017, 39(3):31-45.
[41]	李晓婷. 多模态互动与汉语多模态互动研究[J]. 语言教学与研究, 2019(4):45-59.
[42]	沈家煊. 怎样对比才有说服力--以英汉名动对比为例[J]. 现代外语, 2012, 35(1):1-13.
[43]	王文斌. 论英语的时间性特质与汉语的空间性特质[J]. 外语教学与研究, 2013, 45(2):163-173.
[44]	吴素伟, Cienki A. 事件结构、句法结构与手势的关系研究- -以与格交替结构为例[J]. 外国语, 2020, 43(4):23-33.
[45]	赵秀凤. 概念隐喻研究的新发展--多模态隐喻研究--兼评Forceville & Urios-Aparisi《多模态隐喻》[J]. 外语研究, 2011(1):1-10,112.