Please wait a minute...
北京第二外国语学院学报  2017, Vol. 39 Issue (3): 12-30    DOI: 10.12002/j.bisu.097
语言学研究(多模态专栏)     
言语行为理论与多模态研究——兼论多模态(语料库)语用学的逻辑
黄立鹤
黄立鹤,同济大学外国语学院
Speech Act Theory and Multimodal Analysis: the Logic in Multimodal (Corpus) Pragmatics
HUANG Lihe
Tongji University, Shanghai 200092, China
 全文: PDF(1162 KB)   [HTML]()
摘要: 人们在日常交际中实施的是一个个“鲜活”的言语行为,研究者应当从人类普通行为的视角看待言语行为,在社会场景观照下对其进行考察。多模态研究拓展了学者们对包括言语行为在内语用课题的考察视野和方法,为从结构形式、韵律特征、体貌动作等多个维度研究言语行为提供了可能。个案研究显示:说话人的话语内容、韵律特征、体貌表现等资源都为其言语行为的实施作出了贡献。研究者基于多模态语料库开展言语行为研究,是以新的研究范式重新检视语用学经典课题,拓展了言语行为的研究视野,对语力、语力显示项等概念、范畴进行了发展,尤其为间接言语行为的考察提供了新路径,能够深刻揭示言语行为的本质和特点。这启示研究者应当重视运用多模态方法考察语用问题,关注多模态(语料库)语用学的兴起。运用多模态方法研究语用问题,可在研究方法上对语用学研究进行升级,从而对相关语用学理论进行拓展、修正。
关键词: 言语行为多模态语料库语用学范式创新    
Abstract: Live speech acts in situated discourse are performed by live “whole persons” who interact with the environment in a multimodal way. In this sense, speech acts are suggested to be studied in the perspective of human behavior and in the framework of social situation. With the help of Corpus Linguistics and multimodal approach to language study, researchers are able to further investigate pragmatic issues to develop a better understanding on human interaction and refine traditional pragmatic theories or concepts. Adopting the method of Multimodal Corpus Linguistics and the basic thought of Simulative Modeling, the pilot study in this paper shows that the live illocutionary act is rooted in the whole multimodal interaction of speakers, thus the illocutionary force is multimodal in nature. Illocutionary Force Indicating Devices range in its scope from language structures, prosodic features to non-verbal gestures, etc. All these resources, which are impacted by speakers’ occurrent emotions and other factors, work in a collaborative way to help speakers to perform illocutionary acts. These findings are in compliance with Austin’s observation on the accompaniments of the utterance when a speaker performs an illocutionary act. The findings extend the inquiry of Speech Act Theory and develop the concept of Illocutionary Force Indicating Device by using the novel method and new linguistic data. This paper provides a reference for further study of pragmatic issues based on multimodal corpus, multimodal approach to pragmatic study, or even Multimodal (Corpus) Pragmatics, therefore, should receive due attention.
Key words: speech acts    multimodal    corpus    pragmatics    paradigm innovation
收稿日期: 2016-12-05 出版日期: 2018-03-19
PACS:  H030  
基金资助: 本文系2017年度教育部人文社会科学研究青年基金项目“基于多模态语料库的智退症老年人言语行为研究”成果。
作者简介: 黄立鹤,同济大学外国语学院,硕士生导师,200092,研究方向:多模态、语用学、外语教育。电子邮箱:cranehlh@tongji.edu.cn
服务  
把本文推荐给朋友
加入引用管理器
E-mail Alert
RSS
作者相关文章  
黄立鹤

引用本文:

黄立鹤. 言语行为理论与多模态研究——兼论多模态(语料库)语用学的逻辑[J]. 北京第二外国语学院学报, 2017, 39(3): 12-30.

HUANG Lihe. Speech Act Theory and Multimodal Analysis: the Logic in Multimodal (Corpus) Pragmatics. Journal of Beijing International Studies University, 2017, 39(3): 12-30.

链接本文:

https://journal.bisu.edu.cn/CN/10.12002/j.bisu.097        https://journal.bisu.edu.cn/CN/Y2017/V39/I3/12

[1]Adolphs S. Corpus and Context: Investigating Pragmatic Functions in Spoken Discourse[M]. Amsterdam: John Benjamins Publishing Company, 2008.
[2]Aijmer K. Conversational Routines in English[M]. London: Longman, 1996.
[3]Archer D,Aijmer K & Wichmann A. Pragmatics: An Advanced Resource Book for Students[M]. London: Routledge, 2012.
[4]Argyle M, Furnham A & Graham J A. Social Situations[M]. Cambridge: Cambridge University Press, 1981.
[5]Austin J L. How to Do Things with Words[M]. London: Oxford University Press, 1962.
[6]Austin J L. Performative Utterance[A]. In Austin J L(Ed.). Philosophical Papers(3rd edition)[C]. Oxford: Oxford University Press, 1979.
[7]Baldary A & Thibault P. Multimodal corpus linguistics[A]. In Thompson G & Hunston S (Eds.). System and Corpus: Exploring Connections[C]. Sheffield:Equinox Publishing Ltd., 2006: 164~183.
[8]Cutting J. The speech acts of the in-group[J]. Journal of Pragmatics, 2001, 33(8): 1207~1233.
[9]de Moraes J A & Rilliard A. Illocution, attitudes and prosody[A]. In Raso T & Mello H (Eds.). Spoken Corpora and Linguistic Studies[C]. Philidelphia, PA: John Benjamins Publishing Company, 2014: 233~270.
[10]Firth J R. Papers in Linguistics 1934-1951[C]. London:Oxford University Press, 1957.
[11]Fónagy I, Bérard E & Fónagy J. Clichés mélodiques[J]. Folia Linguistica, 1983: 17(1-4): 153~186.
[12]Georgila K, Lemon O, Henderson J & Moore J D. Automatic annotation of context and speech acts for dialogue corpora[J]. Natural Language Engineering, 2009, 15 (3): 315~353.
[13]Gu Y. Multimodal text analysis - a corpus linguistic approach to situated discourse[J]. Text and Talk, 2006, 26(2): 127~167.
[14]Gu Y. From real-life situated discourse to video-stream data-mining[J]. International Journal of Corpus Linguistics, 2009, 14(4): 433~466.
[15]Gu Y. A conceptual model of Chinese illocution, emotion and prosody[A]. In Tseng Chiu-yu(Ed.). Human Language Resources and Linguistic Typology[C]. Taipei: Academia Sinica, 2013: 309~362.
[16]Kendon A. Gestures as illocutionary and discourse structure markers in Southern Italian conversation[J]. Journal of Pragmatics, 1995, 23 (3): 247~279.
[17]Knight D & Adolphs S. Multi-model corpus pragmatics: the case of active listenership[A]. In Romero-Trillo J (Ed.). Pragmatics and Corpus Linguistics[C]. Berlin:Walter de Gruyter, 2008: 175~190.
[18]Kohnen T. Corpora and speech acts: the study of performatives[A]. In Mair C & Hundt M (Eds.). Corpus Linguistics and Linguistic Theory(Papers from the Twentieth International Conference on English Language Research on Computerized Corpora,ICAME 20)[C]. Freiburg im Breisgau 1999. Amsterdam: Rodopi, 2000: 177~186.
[19]Leech G & Weisser M. Generic speech act annotation for task-oriented dialogues[A]. In Archer D, Rayson P, Wilson A & McEnery T (Eds.). Proceedings of the Corpus Linguistics 2003 Conference(Vol.16)[C]. Lancaster University: UCREL Technical Papers, 2003.
[20]Leech G & Weisser M. The SPAADIA Annotation Scheme[O/L]. http://martinweisser.org/publications/SPAADIA_Annotation_Scheme.pdf ,2015-08-19.
[21]Levinson S C. Activity types and language[A]. In Drew P & Heritage J (Eds.). Talk at Work:Interaction in Institutional Settings[C]. Cambridge:Cambridge University Press,1992:66~100.
[22]Levinson S C. Pragmatics[M]. Cambridge:Cambridge University Press, 1983.
[23]Maynard C & Leicher S. Pragmatic annotation of an academic spoken corpus for pedagogical purposes[A]. In Fitzpatrick E (Ed.). Corpus Linguistic beyond the Word: Corpus Research from Phrase to Discourse[C]. Amsterdam: Rodopi, 2007: 107~115.
[24]McAllister P G. Speech acts: a synchronic perspective[A]. In Aijmer K & Rühlemann C (Eds.). Corpus Pragmatics: A Handbook[C]. Cambridge:Cambridge University Press, 2015: 29~51.
[25]Mey J L. Pragmatics: An Introduction (2nd edition)[M].Oxford: Blackwell, 2001.
[26]Meyer R & Mleinek I. How prosody signals force and focus - a study of pitch accents in Russian yes–no questions[J]. Journal of Pragmatics, 2006, 8(10): 1615~1635.
[27]Mubenga K S. Film Discourse and Pragmatics in Screen Translation: A Contrastive Analysis of Speech Acts in French and English[D]. Ph.D. Thesis, University of the Witwatersrand, Johannesburg, 2008.
[28]Mubenga K S. Towards a multimodal pragmatic analysis of film discourse in audiovisual translation[J]. Meta: Journal des Traducteurs, 2009, 54 (3): 466~484.
[29]Romero-Trillo J. Pragmatics and Corpus Linguistics[C]. Berlin : Walter de Gruyter, 2008.
[30]Rühlemann C. What can a corpus tell us about pragmatics?[A]. In O’Keeffe A & McCarthy M (Eds). The Routledge Handbook of Corpus Linguistics[C]. London: Routledge, 2010: 288~301.
[31]Rühlemann C & Aijmer K. Corpus pragmatics: laying the foundations[A]. In Aijmer K & Rühlemann C (Eds.). Corpus Pragmatics: A Handbook[C]. Cambridge University Press, 2014: 1~26.
[32]Searle J R. Speech Acts: An Essay in the Philosophy of Language[M]. London: Cambridge University Press, 1969.
[33]Searle J R. Expression & Meaning:Studies in the Theory of Speech Act[M].Beijing: Foreign Language Teaching & Research Press, 2001.
[34]Searle J R & Vanderveken D. Foundations of Illocutionary Logic[M]. Cambridge:Cambridge University Press, 1985.
[35]Weisser M. SPAACy: a semi-automate tool for annotating dialogue acts[A]. In Institute of Language and Information Studies(Ed.). Language,Information and Lexicography(Vols 12/13)[C].  Seoul:Yonsei University, 2003:131~156. 
[36]Weisser M. Speech act annotation[A]. In Aijmer K & Rühlemann C (Eds.). Corpus Pragmatics: A Handbook[C]. Cambridge:Cambridge University Press, 2015: 84~110.
[37]Wennerstrom A. The Music of Everyday Speech: Prosody and Discourse Analysis[M]. Oxford: Oxford University Press, 2001.
[38]陈新仁,钱永红. 多模态分析法在语用学研究中的应用[J]. 中国外语,2011(5): 89~93.
[39]顾曰国. John Searle 的言语行为理论与心智哲学[J]. 国外语言学,1994(2): 1~8.
[40]顾曰国. 语言学海外自选集[M]. 北京:外语教学与研究出版社,2010.
[41]顾曰国. 论言思情貌整一原则与鲜活话语研究[J]. 当代修辞学,2013(6): 1~19.
[42]顾曰国. 意向性、意识、意图、目的(标)与言语行为——从心智哲学到语言哲学[J]. 当代语言学,2017(3).
[43]顾曰国,张永伟. 静态图像库的信息检索与知识本体[J]. 当代语言学,2013(2): 214~229.
[44]黄立鹤. 言语行为研究的另一个界面:现场即席话语视角[J]. 浙江外国语学院学报,2014(3): 45~53.
[45]黄立鹤. 语料库4.0:多模态语料库建设及其应用[J]. 解放军外国语学院学报,2015a(3): 1~7,48.
[46]黄立鹤. 通感、隐喻与多模态隐喻[J].语文与国际研究(中国台湾),2015b(13): 1~13.
[47]黄立鹤. 现场即席话语与多模态研究:意义、理论与方法[J]. 北京科技大学学报(社会科学版),2016(5):29~36.
[48]黄立鹤. 多模态修辞学的构建与研究:兼论修辞学与语用学的连接[J].当代语言学,2017(3).
[49]匡川. 基于语料库的汉语感谢言语行为研究[D]. 成都:电子科技大学硕士学位论文, 2013.
[50]刘陈艳. 情态序列作为言语行为套语的习得研究——用基于语料库的方法[J]. 解放军外国语学院学报,2013(1): 62~66.
[51]刘艳. 普通话的情感语音韵律分析[D]. 南京师范大学硕士学位论文, 2011.
[52]钱永红,陈新仁. 语料库方法在语用学研究中的运用[J]. 外语教学理论与实践,2014(2): 15~20, 26.
[53]向娟. 承诺类言语行为中的语义韵和被承诺者角色——基于语料库的承诺类言语行为的言后效果研究[D]. 上海交通大学硕士学位论文, 2007.
[1] 巩雪先,王晓红,任晓霏. 基于语料库的翻译汉语介词使用特征研究[J]. 北京第二外国语学院学报, 2019, 41(1): 56-66.
[2] 毛现桩. 英国电视公益广告态度意义多模态认知评价分析——以交通安全类电视公益广告语篇为例[J]. 北京第二外国语学院学报, 2018, 40(6): 40-52.
[3] 刘宁. 基于语料库的中美媒体关于中国雾霾报道的对比研究 ——以批评话语分析为视角[J]. 北京第二外国语学院学报, 2018, 40(5): 37-53.
[4] 赵秀凤. 多模态隐喻场景对涉华国际关系的建构——多模态隐喻研究的社会维度[J]. 北京第二外国语学院学报, 2017, 39(6): 26-39.
[5] 刘 银 杨文彬. 反腐倡廉公益平面广告中的多模态隐喻和转喻[J]. 北京第二外国语学院学报, 2017, 39(6): 40-56.
[6] 雷 茜. 格林海姆• 洛雷拼贴小说《女性世界》人物认知研究——多模态认知文体学视角[J]. 北京第二外国语学院学报, 2017, 39(6): 57-68.
[7] 韩 颖. 学术英语听力多模态混合式学习模式设计[J]. 北京第二外国语学院学报, 2017, 39(5): 98-110.
[8] 郭恩华 张德禄. 基于会话分析的多模态交际研究探索——论序列分析在CA多模态交际研究中的应用[J]. 北京第二外国语学院学报, 2017, 39(3): 31-45.
[9] 冯德正. 多模态语篇分析的基本问题探讨[J]. 北京第二外国语学院学报, 2017, 39(3): 1-11.
[10] 黄立波. 基于专门用途语料库的翻译研究综述[J]. 北京第二外国语学院学报, 2017, 39(2): 70-82.
[11] 李德超 杨晓琳. 基于语料库的“more and more”及其触发环境研究:词汇触发理论的视角[J]. 北京第二外国语学院学报, 2017, 39(1): 116-126.
[12] 李 洋 王少爽. 基于文献计量的中国语料库口译研究评述[J]. 北京第二外国语学院学报, 2016, 38(5): 71-83.
[13] 陈子娟 耿敬北. 景区提示标识的多模态语篇分析与构建策略研究[J]. 北京第二外国语学院学报, 2016, 38(2): 28-41.
[14] 郭桂杭 梁 倩. 从CRISIS探究美国经济状况——基于语料库的CRISIS研究[J]. 北京第二外国语学院学报, 2015, 37(2): 1-.
[15] 李 丽. 基于认知解析的商务词语搭配教学[J]. 北京第二外国语学院学报, 2015, 37(10): 73-.