MULTIMODALITY: MENAFSIR VERBAL, MEMBACA GAMBAR,DAN MEMAHAMI TEKS

Budi Hermawan

Abstract


Abstrak

 Tulisan ini ditujukan khususnya untuk memenuhi dua tujuan utama. Pertama, tulisan ini memperkenalkan dan menjelaskan multimodality sebagai sebuah ‘prosedur analisa’ yang harus digunakan untuk menganalisa teks yang menggunakan lebih dari satu semiotic mode, khususnya yang menggunakan mode verbal dan mode gambar atau imej secara bersamaan dalam sebuah kesempatan penyampaian makna. Kedua, tulisan ini menjelaskan langkah-langkah teknis prosedur analisa multimodality yang dapat digunakan untuk menganalisa teks seperti tersebut dan memberikan contoh penggunaan langkah analisa. Dengan demikian, tulisan ini juga mengeksplorasi manfaat yang dapat diperoleh dari penggunaan ‘prosedur analisa’ ini untuk menganalisa teks. Tulisan ini mendukung argumen yang ditawakan diantaranya oleh Kress dan van Leeuwen (2006), dan Machin dan Myer (2012), yang menyakini bahwa pesan yang disampaikan dengan semiotic mode berbeda secara bersamaan (verbal dan imej) dalam sebuah teks tidak dapat dianalisa hanya dengan alat analisa lingusitik saja, tetapi mengharuskan dua alat analisa yang berbeda yaitu linguistics, dan image analysis tool seperti reading image yang saling mendukung menuju pemahaman makna yang lebih menyeluruh. Bentuk hubungan yang tercipta dari verbal dan imej sebagai dua semiotic mode berbeda dalam sebuah teks juga dipaparkan dalam tulisan ini.

Kata-kata kunci: multimodality, semiotic mode, teks, mode verbal, mode imej

 

Abstract

This article was especially to serve two main purposes; firstly, it introduces and elaborates multimodality as a ‘ procedure of analysis’ to use to analyze texts which use more than one semiotic mode, particularly those that use verbal and images at the same time. Secondly, this article both explicates technical steps of the procedure that can be used to analyze given texts, and provides an example of the application of the steps. Hence, though implicitly, the article explores the strengths to gain from the application of the procedure. The article supports the argument offered, among others, by Kress and van Leeuwen (2006), and Machin and Myer (2012), who argue that messages sent in a text using two different semiotic modes at the same time, verbal and visual, should be analyzed by a tool of analysis that combines the analysis of verbal and visual such as Systemic Functional Linguistics (SFL) for the analysis of verbal, and Reading Images for the analysis of the images. These, work together to unearth the messages to allow us better interpretation and understanding of the messages. The relations between verbal-visual are also discussed in this article 

Keywords: Multimodality, semiotic mode, text, verbal, images

Full Text:

PDF

References


Archer, Arlene & Stent, Stacey. 2011. Red Socks and Purple Rain: The Political Uses of Colour in Late Apartheid South Africa. Visual Communication, 10: 115.

Arnheim, R. 1969. Visual Thinking. Berkeley and Los Angeles: University of California Press.

Barker, C. 2000. Cultural Studies:Theory and Practice. London : SAGE Publications. Ltd.

Bednarek, M. dan Caple, H. 2012. News Discourse. London and New York: Continuum .

Bezemer, J. & Kress, G. 2008. Writing in Multimodal Texts: A Social Semiotic Account of Designs for Learning. Written Communication, 25 : 166.

Chen, Y. 2010. Exploring Dialogic Engagement with Readers in Multimodal EFL Textbooks in China. Visual Communication.

Eggins, S. 2004. An introduction to Systemic Functional Linguistics, 2nd ed. London: Continuum International Publishing Group.

Halliday, M.A.K. 1994. An Introduction to Functional Grammar, second edition. New York: Routledge, Chapman and Hall, Inc.

Halliday, M.A.K. dan Matthiessen, Christian, M.I.M. 2004. An Introduction to Functionnal Grammar, 3rd edition. Great Britain: Arnold.

Iedema, R. 2003. Multimodality, Resemiotization: Extending the Analysis of Discourse as Multi-semiotic Practice. Visual Comunication, 1-30.

Koller, V. 2008. 'Not just A Colour': Pink as A Gender and Sexuality Marker in Visual Communication. Visual Communication, 7: 395.

Kress, G. & Van Leeuwen, T. 2006. Reading Images: The Grammar of Visual Design. London: Routledge.

Kress, G. & Van Leeuwen, T. 1996. Front Pages: (The Critical) Analysis of Newspaper Layaout. In Bell, Allan. and Garret, Peter (Eds), Approaches to Media Discourse. Oxford: Blackwell.

Kress, G. & Van Leeuwen, T. 1998. Front Pages: (The Critical) Analysis of Newspaper Layaout. In Bell, Allan. and Garret, Peter (Eds), Approaches to Media Discourse. Oxford: Blackwell.

Kress, G. & Van Leeuwen, T. 2001. Multimodal Discourse The Modes and Media of Contemporaray Communication. Great Britain: Arnold.

Kress, G. & Van Leeuwen, T. 2002. Colour as A Semiotic Mode: Notes for A Grammar of Colour. Visual Communication, 1-27.

Liu, Yu & O'Halloran, Kay L. 2009. Intersemiotic Texture: Analyzing Cohesive Devices between Language and Images. Social Semiotic, 367-388.

Machin, D & Myer, A. 2012. How to Do Critical Discourse Analysis. London: SAGE Publication Ltd.

Martinec, Radan & Salway, Andrew. 2005. A System for Image-Text Relation in New (and Old) Media. Visual Communication, 4:337

O'Halloran, K. L. 2008. Systemic Functional-Multimodal Discourse Analysis (SF-MDA): Constructing Ideational Meaning Using Language and Visual Imagery. Visual Communication , 443-473.

Rodriguez, L & Dimitrova, Daniela. 2011. The Levels of Visual Framing. Visual Literacy, 48-65.

Royce, T. 2002. Multimodality in the TESOL Classroom: Exploring Visual-Verbal Synergy. Tesol Quarterly, Vol. 36 No. 2 Summer.

Unsworth, L. 2001. Describing Visual Literacy. In Teaching Multiliteracy Across Curriculum: Changing context of text and image in classroom (pp. 71-112). Buckingham; Philadelphia: Open University Press.

Van Leeuwen, T. 2008. Discourse and Practice. New Tools for Critical Discourse Analysis. New York: Oxford University Press.

Van Leeuwen, T. 2009. Discourse as the Recontextualization of Social Practice: A Guide. Dalam Ruth Wodak dan Michael Meyer (Eds), Methods of Critical Discourse Analysis, 2ed. London: SAGE Publications Inc.




DOI: https://doi.org/10.17509/bs_jpbsp.v13i1.756

Refbacks

  • There are currently no refbacks.


Copyright (c)



    p-ISSN 1412-0712  |  e-ISSN 2527-8312

Lisensi Creative Commons

JPBS is published by:

Fakultas Pendidikan Bahasa dan Sastra (Faculty of Language and Literature Education), Universitas Pendidikan Indonesia,

in cooperation with

TEFLIN, and APPBIPA

View My Stats