Please wait a minute...
北京第二外国语学院学报  2017, Vol. 39 Issue (3): 1-11    DOI: 10.12002/j.bisu.095
Basic Questions of Multimodal Discourse Analysis
FENG Dezheng
The Hong Kong Polytechnic University, Department of English, Hong Kong, China
 全文: PDF(604 KB)   [HTML]()
摘要: 作为一个新的研究领域,多模态语篇分析仍然面临诸多挑战。一方面,多模态研究在传统语言学领域的地位仍然受到质疑;另一方面,多模态研究的理论与方法仍处于初级阶段,有很多局限,同时,有些学者对该领域的认识存在一些误区。因此,本文拟对多模态研究的基本问题进行系统梳理,简要回答为什么要研究多模态语篇,语言学理论是否适用于分析图像、手势等非语言符号,多模态的研究范畴是什么,有哪些理论与方法、局限与误区等问题。本文进一步提出研究者需要有跨学科意识、实证意识与应用意识,立足于理论与方法创新,着眼于解决多媒体时代传播与交际中的实际问题。正确把握这些基本问题对将多模态语篇分析发展成为一个具有强大理论支撑与严谨方法保障的新兴学科具有重要意义。
关键词: 多模态语篇分析基本问题理论视角研究方法    
Abstract: As a new research field, multimodal discourse analysis is facing a lot of challenges. On the one hand, the status of multimodality in traditional linguistics is questioned. Many linguists argue that nonlinguistic signs such as gestures and visual images are out of the scope of linguistics. On the other hand, the theories and methods of multimodal discourse analysis are still at an early stage of development and have many limitations. Moreover, many researchers have misunderstandings of the field. In view of these, this article provides a brief explanation of the basic questions of multimodal discourse analysis, including why we analyze multimodal discourse, whether linguistic theories are applicable to nonlinguistic signs such as visual images and gesture, what is the scope of multimodal research, what are the main theories and methods, and what are the limitations and misunderstandings. It further points out that researchers need to have the awareness of making their research interdisciplinary, empirical, and application-oriented. It argues that multimodal research should be based on theoretical and methodological innovation, and should aim at solving real communication problems in the multimedia age. The accurate understanding of these questions is crucial for developing multimodal discourse analysis into a new discipline with strong theoretical and methodological support.
Key words: multimodal discourse analysis    basic questions    theoretical perspectives    research methods
收稿日期: 2016-12-13 出版日期: 2018-03-19
PACS:  H030  
作者简介: 冯德正,香港理工大学英文系,研究方向:多模态语篇分析,语言教学。电子邮箱
E-mail Alert


冯德正. 多模态语篇分析的基本问题探讨[J]. 北京第二外国语学院学报, 2017, 39(3): 1-11.

FENG Dezheng. Basic Questions of Multimodal Discourse Analysis. Journal of Beijing International Studies University, 2017, 39(3): 1-11.


[1]Baldry A & Thibault P. Applications of multimodal concordances [J]. Journal of Language and Communication Studies, 2008,41: 11~41.
[2]Bateman J A & Schmidt K H. Multimodal Film Analysis: How Films Mean [M]. London: Routledge, 2012.
[3]Bateman J A. Text and Image: A Critical Introduction to the Visual/Verbal Divide [M]. New York: Routledge, 2014.
[4]Bateman J A. Using multimodal corpora for empirical research [A]. In Jewitt C (Ed.). The Routledge Handbook of Multimodal Analysis [C]. London: Routledge, 2014: 238~252.
[5]Beasley R & Danesi M. Persuasive Signs: The Semiotics of Advertising [M]. New York: Mouton de Gruyter, 2005.
[6]Cheong Y Y. The construal of ideational meaning in print advertisements [A]. In O’Halloran K L (Ed.). Multimodal Discourse Analysis [C]. London: Continuum, 2004: 163~195.
[7]Cook G. The Discourse of Advertising [M]. London: Routledge, 2001.
[8]Djonov E N. Analyzing the Organization of Information in Websites [D]. PhD Thesis. Sydney: University of New South Wales, 2005.
[9]El Refaie E. Understanding visual metaphors: the example of newspaper cartoons [J]. Visual Communication, 2003, 2 (1): 75~95.
[10]Fairclough N. Critical Discourse Analysis: The Critical Study of Language [M]. London: Longman, 1995.
[11]Feng Dezheng. Modeling Appraisal in Film: A Social Semiotic Approach [D]. PhD Thesis. Singapore: National University of Singapore, 2012.
[12]Feng Dezheng & O’Halloran K L. Representing emotion in visual images: a social semiotic approach [J]. Journal of Pragmatics, 2012, 44(14): 2067~2084.
[13]Forceville C. Pictorial Metaphor in Advertising [M]. London: Routledge, 1996.
[14]Forceville C. Book review: multimodal transcription and text analysis [J]. Journal of Pragmatics, 2007, 39(6): 1235~1238.
[15]Forceville C. Nonverbal and multimodal metaphor in a cognitivist framework [A]. In Forceville C & Urios-Aparisi E (Eds.). Multimodal Metaphor [C]. Berlin: Mouton de Gurter, 2009: 19~42.
[16]Forceville C & Urios-Aparisi E. Multimodal Metaphor [M]. Berlin: Mouton De Gruyter, 2009.
[17]Gu Yueguo. Multimodal text analysis: a corpus based approach to situated discourse [J]. Text and Talk, 2006, 26 (2): 127~167.
[18]Halliday M A K. Language as Social Semiotic: The Social Interpretation of Language and Meaning [M]. London: Edward Arnold, 1978.
[19]Halliday M A K. An Introduction to Functional Grammar (2nd edition) [M]. London: Edward Arnold, 1994.
[20]Holsanova J. New methods for studying visual communication and multimodal integration [J]. Visual Communication, 2012, 11 (3): 251~257.
[21]Hood S. Body language in face-to-face teaching [A]. In Dreyfus S,Hood S & Stenglin M (Eds.). Semiotic Margins [C]. London: Continuum, 2011: 31~52.
[22]Jewitt C (Ed.). The Routledge Handbook of Multimodal Analysis [M]. London: Routledge, 2009.
[23]Knight N. The interpersonal semiotics of having a laugh [A]. In Dreyfus S, Hood S & Stenglin M (Eds.). Semiotic Margins [C]. London: Continuum, 2011: 7~30.
[24]Kress G. Multimodality [M]. London: Routledge, 2010.
[25]Kress G & van Leeuwen T. Reading Images:The Grammar of Visual Design [M]. London: Routledge, 1996.
[26]Kress G & van Leeuwen T. Front pages: (the critical) analysis of newspaper layout [A]. In Bell A & Garrett P(Eds.). Approaches to Media Discourse [C]. Oxford: Blackwell, 1998: 186~219.
[27]Lakoff G & Johnson M. Metaphors We Live by [M]. Chicago: University of Chicago Press, 1980.
[28]Lemke J. Travels in hypermodality [J]. Visual Communication, 2002, 1 (3): 299~325.
[29]Lim F V. Language, gestures and space in the classroom of ‘Dead Poets Society’ [A]. In Fang Y & Wu C (Eds.). Challenges to Systemic Functional Linguistics: Theory and Practice(Proceedings of the Conference ISFC36)[C]. Beijing: Tsinghua University, 2010: 165~172.
[30]Lim F V. A Systematic Functional Multimodal Analysis Approach to Pedagogical Discourse [D]. PhD Thesis. Singapore: National University of Singapore, 2011.
[31]Liu Y & O’Halloran K L. Intersemiotic texture: analyzing cohesive devices between language and images [J]. Social Semiotics, 2009, 19 (4): 367~387.
[32]Liu Y & Owyong M. Metaphor, multiplicative meaning and the semiotic construction of scientific knowledge [J]. Language Science, 2011, 33(5): 822~834.
[33]Martinec R. Types of processes in action [J]. Semiotica, 2000, 130 (3/4): 243~268.
[34]Martinec R & Salway A. A system for image-text relations in new (and old) media [J]. Visual Communication, 2005, 4 (3): 337~371.
[35]Mitchell W J T. Picture Theory: Essays on Verbal and Visual Representation [M]. Chicago: The University of Chicago Press, 1994.
[36]O’Halloran K L. Mathematical Discourse: Language, Symbolism and Visual Images [M]. London: Continuum, 2005.
[37]O’Halloran K L. Multimodal discourse analysis [A]. In Hyland K & Paltridge B (Eds.). Companion to Discourse Analysis [C]. London: Continuum, 2011: 120~137.
[38]O’Toole M. The Language of Displayed Art [M]. London: Leicester University Press, 1994.
[39]Painter C,Martin J R & Unsworth L. Reading Visual Narratives [M]. London: Equinox, 2013.
[40]Rahm H. Getting attention in the media [A]. In Lassen I, Strunck J & Vestergaard T(Eds.). Mediating Ideology in Text and Image [C]. Amsterdam: John Benjamins, 2006: 193~210.
[41]Stenglin M. Spaced out: an evolving cartography of a visceral semiotic [A]. In Dreyfus S,Hood S & Stenglin M (Eds.). Semiotic Margins [C]. London: Continuum, 2011: 73~100.
[42]Tseng C. Cohesion in Film: Tracking Film Elements [M]. Basingstoke: Palgrave Macmillan, 2013.
[43]van Leeuwen T. Speech, Music, Sound [M]. London: Macmillan, 1999.
[44]Vestergaard T & Schorder K. The Language of Advertising [M]. New York: Basil Blackwell, 1985.
[45]Ventola E. Semiotization processes of space [A]. In O’Halloran K L & Smith B (Eds.). Multimodal Studies [C]. London: Routledge, 2011: 220~238.
[46]Zhang Y Q & O’Halloran K L. The gate of the gateway: a hypermodal approach to university homepages [J]. Semiotica, 2012, 190 (1/4): 87~109.
[47]陈松菁. 舞台叙事的多模态语篇研究——基于对一次英语朗诵比赛的舞台语言使用分析 [J]. 外语与外语教学, 2016(4): 70~78.
[48]陈瑜敏. 情态分析在多模态外语教材研究中的应用探析 [J]. 外语教学, 2010, 31 (1):69~72.
[49]冯德正. 多模态隐喻的构建与分类——系统功能视角 [J]. 外语研究, 2011 (1): 24~29.
[50]冯德正. 数字技术与多模态语篇分析 [J]. 北京科技大学学报, 2010, 26 (4): 12~17.
[51]冯德正, 亓玉杰. 态度意义的多模态建构——基于认知评价理论的分析模式 [J]. 现代外语,2014, 37 (5):585~596.
[52]冯德正, 张德禄, O’Halloran K. 多模态语篇分析的进展与前沿 [J]. 当代语言学, 2014 (1): 88~99.
[53]顾曰国. 基于角色的建模语言 [A]. 第十二届CODATA国际学术大会论文集 [C]. 北京:中国科学院,2006: 21~47.
[54]李战子. 多模态话语的社会符号学分析 [J]. 外语研究, 2003(5):1~8.
[55]张德禄. 多模态外语教学的设计与模态调用初探 [J]. 中国外语, 2010(5): 48~53.
[1] 余红兵,王峰. 国际符号学研究的阵地、理论与方法——Semiotica期刊副主编余红兵博士访谈录[J]. 北京第二外国语学院学报, 2018, 40(6): 14-21.
[2] 陈子娟 耿敬北. 景区提示标识的多模态语篇分析与构建策略研究[J]. 北京第二外国语学院学报, 2016, 38(2): 28-41.
[3] 陈麦池. 基于学科构建的旅游学案例研究方法研究[J]. 北京第二外国语学院学报, 2014, 36(5): 78-.