MULTILITERACIES AND SEMIOTICS
DOI:
https://doi.org/10.26512/les.v25i2.56048Palavras-chave:
interview, multiliteracy, social semioticsResumo
Professor Len Unsworth is the Research Director of Educational Semiotics in English and Literacy Pedagogy in the Institute for Learning Sciences and Teacher Education (ILSTE) at the Australian Catholic University (ACU) in Sydney. Len has been involved in educational research for over 30 years, including nine recent Australian Research Council funded projects. His key research interests include: literacy and learning in school curriculum areas; literature for children and adolescents; literacy development in the English curriculum K-12; and the pedagogic role of explicit knowledge about language and the meaning-making resources of images and image-language interaction in both paper and digital media texts, including animation and film. Prior to commencing at ACU in 2014, Len was Professor in Education at Griffith University, following earlier roles as Head of the School of Education at the University of New England and Head of the School of Development and Learning in the Faculty of Education at the University of Sydney.
Downloads
Referências
ABBAS, Z.; WHITE, P. R. Attitudinal positioning and journalistic commentary in politically fraught circumstances: Editorializing about the killing of Osama bin Laden. Journal of Research in Applied Linguistics, v. 12, n. 2, p. 89-102, 2021.
BARTON, G.; UNSWORTH, L. Music, multiliteracies and multimodality: Exploring the book and movie versions of Shaun Tan’s The Lost Thing. Australian Journal of Language and Literacy, v. 37, n. 1, p. 3-20, 2014.
BEDNAREK, M.; CAPLE, H. ‘Value added’: Language, image and news values. Discourse, context & media, v. 1, n. 2, p. 103-113, 2012.
CAPLE, H. Intermodal Relations in Image Nuclear News Stories. In: UNSWORTH, L. (ed.). Multimodal Semiotics: Functional Analyses in Contexts of Education. Continuum, 2008a. p. 123-138.
CAPLE, H. Reconciling the co-articulation of meaning between words and pictures: exploring instantiation and commitment in image-nuclear news stories. In: MAHBOOB, A.; KNIGHT, N. (ed.). Questioning Linguistics. Cambridge Scholars Press, 2008b. p. 77-94.
CAPLE, H. Doubling-up: allusion and bonding in multi-semiotic news stories. In BEDNAREK, M.; MARTIN, J. R. (ed.). New discourse on language: Functional perspectives on multimodality, identity, and affiliation. Continuum, 2010. p. 111-133.
CAPLE, H. Photojournalism: A social semiotic approach. Springer, 2013.
CAPLE, H.; KNOX, J. S. Online news galleries, photojournalism and the photo essay. Visual Communication, v. 11, n. 2, p. 207-236, 2012.
CAPLE, H.; KNOX, J. S. A framework for the multimodal analysis of online news galleries: What makes a “good” picture gallery? Social Semiotics, v. 25, n. 3, p. 292-321, 2015.
CAPLE, H.; KNOX, J. S. Genre (less) and purpose (less): Online news galleries. Discourse, context & media, v. 20, p. 204-217, 2017.
CHANDLER, P.; O'BRIEN, A.; UNSWORTH, L. Towards a 3D digital multimodal curriculum for the upper primary school. Australian Educational Computing, v. 25, n. 1, p. 34-40, 2010.
CHANDLER, P.; UNSWORTH, L.; O'BRIEN, A. Evaluation of students’ digital animated multimodal narratives and the identification of high-performing classrooms. Journal of Literacy and Technology, v. 13, n. 3, p. 80-128, 2012.
COFFIN, C.; DEREWIANKA, B. Multimodal layout in school history books: The texturing of historical interpretation. In: Text type and texture. University of Toronto Press, 2009. p. 191-215.
DEREWIANKA, B.; COFFIN, C. Time visuals in history textbooks:Some pedagogic issues. In: UNSWORTH, L. (ed.). Multimodal Semiotics: Functional Analysis in Contexts of Education. Continuum, 2008. p. 187-200.
ECONOMOU, D. Pulling Readers In: WHITE, P. R. R.; THOMSON, E. A. (ed.). Communicating Conflict: Multilingual Case Studies of the News Media. London, 2008. p. 253–280.
ECONOMOU, D. Standing out on Critical Issues: Evaluation in Large Verbal-visual Displays in Australian Broadsheets. In: BOWCHER, W. (ed.). Multimodal Texts from Around the World: Cultural and Linguistic Insights. Palgrave Macmillan, 2012. p. 246 - 272.
GE, Y.; UNSWORTH, L.; WANG, K. The effects of explicit visual cues in reading biological diagrams. International Journal of Science Education, v. 39, n. 5, p. 605-626, 2017.
GE, Y.-P.; CHUNG, C.-H.; WANG, K.-H.; CHANG, H.-P.; UNSWORTH, L. Comparing the images in Taiwanese and Australian science textbooks by grammar of visual design: An Example of biological classification. Chinese Journal of Science Education, v. 22, n. 2, p. 109-134, 2014.
GE, Y.-P.; UNSWORTH, L.; WANG, K.-H. The effects of explicit visual cues in reading biological diagrams. International Journal of Science Education, v. 39, n. 5, 605-626, 2017.
GE, Y.-P.; UNSWORTH, L.; WANG, K.-H.; CHANG, H.-P. Image design for enhancing science learning: helping students build taxonomic meanings with salient tree structure images. In: TANG, K.-S.; DANIELSSON, K. (ed.), Global developments in literacy research for science education. Springer, 2018a. p. 237-258.
GE, Y.-P.; UNSWORTH, L.; WANG, K.-H.; CHANG, H.-P. What Images Reveal: a Comparative Study of Science Images between Australian and Taiwanese Junior High School Textbooks [journal article]. Research in Science Education, v. 48, n. 6, p. 1409-1431, 2018b. DOI: https://doi.org/10.1007/s11165-016-9608-9
HALLIDAY, M. A. K. Language as a social semiotic: The social interpretation of language and meaning. Edward Arnold, 1978.
HALLIDAY, M. A. K.; FAWCETT, R. P.; YOUNG, D. J. New Developments in Systemic Linguistics: Theory and application. Pinter, 1988.
HALLIDAY, M. A. K.; HASAN, R. Language, context and text: Aspects of language in a social-semiotic perspective. Deakin University Press, 1985.
HALLIDAY, M. A. K.; MATTHIESSEN, C. An introduction to functional grammar. 4th ed. Arnold, 2004.
KNOX, J. Visual-verbal communication on online newspaper home pages. Visual Communication, v. 6, n. 1, p. 19-53, 2007. DOI: https://doi.org/10.1177/1470357207071464
KNOX, J. S. Punctuating the home page: image as language in an online newspaper. Discourse & communication, v. 3, n. 2, p. 145-172, 2009a.
KNOX, J. S. Visual minimalism in hard news: Thumbnail faces on the smh online home page. Social Semiotics, v. 19, n. 2, p. 165-189, 2009b.
KNOX, J. S. Online newspapers: evolving genres and evolving theory. In Applied linguistics methods: a reader: systemic functional linguistics, critical discourse analysis and ethnography (pp. 33-51). Routledge, Taylor and Francis Group, 2010.
KRESS, G. Visual and verbal modes of representation in electronically mediated communication: the potentials of new forms of of text. In I. Snyder (Ed.), Page to screen: Taking literacy into the electronic era. Allen and Unwin, 1997. p. 53-79.
KRESS, G. Literacy in the New Media Age. Routledge, 2003.
KRESS, G. Multimodality: A social semiotic approach to contemporary communication. Routledge, 2010. DOI: https://doi.org/10.4324/9780203970034
KRESS, G.; VAN LEEUWEN, T. Reading Images: The grammar of visual design. 3rd ed. Routledge, 2021. DOI: https://doi.org/10.4324/9781003099857
MACKEN-HORARIK, M. Working the Borders in Racist Discourse: The Challenge of the ‘Children Overboard Affair’ in News Media Texts. Social Semiotics, v. 13, n. 3, p. 283-303, 2003.
MARTIN, J. R. English text: System and structure. Benjamins, 1992.
MARTIN, J. R. Revisiting field: Specialized knowledge in secondary school science and humanities discourse. In: MARTIN, J. R.; MATON, K.; DORAN, Y. J. (ed.). Accessing Academic Discourse: Systemic Functional Linguistics and Legitimation Code Theory. Routledge, 2020. p. 114-148.
MARTIN, J. R.; MATRUGLIO, E. Revisiting mode: Context in/dependency in Ancient History classroom discourse. In: MARTIN, J. R.; MATON, K.; DORAN, Y. J. (ed.). Accessing Academic Discourse: Systemic Functional Linguistics and Legitimation Code Theory. Routledge, 2020. p. 89-113.
MARTIN, J. R.; UNSWORTH, L. Reading Images for Knowledge Building: Analyzing Infographics in School Science. Routledge, 2024.DOI: https://doi.org/10.4324/9781003164586
MILLS, K.; UNSWORTH, L. iPad Animations: Powerful Multimodal Practices for Adolescent Literacy and Emotional Language. Journal of Adolescent & Adult Literacy, v. 61, n. 6, p. 609-620, 2018. DOI: https://doi.org/10.1002/jaal.717
MILLS, K.; UNSWORTH, L.; SCHOLES, L. Literacy for Digital Futures: Mind, Body, Text. Routledge, 2023. DOI: https://doi.org/10.4324/9781003137368
NGO, T.; UNSWORTH, L.; FEEZ, S. Enhancing expressions of attitudes: Achieving equity for international students in everyday communication. TESOL in Context: TESOL as a Global Trade: Ethics, Equity and Ecology, Special Edition, 2012.
NGO, T.; UNSWORTH, L.; HERRINGTON, M. Teacher Orchestration of Language and Gesture in Explaining Science Concepts in Images. Research in Science Education, n. 52, p. 1013–1030, 2022. DOI: https://doi.org/https://doi.org/10.1007/s11165-021-10011-z
O'BRIEN, A.; CHANDLER, P.; UNSWORTH, L. 3D multimodal authoring in the middle years: a research project. Synergy, v. 8, n. 1, p. 1-5, 2010. DOI: http://www.slav.vic.edu.au/synergy/volume-8-number-2-2010/research/79-3d-multi.
RUTHERFORD, L.; BITTMAN, M.; BROWN, J.; UNSWORTH, L. Digital Natives: New and old media and children's outcomes. AUstralian Journal of Education, v. 55, n. 2, p. 73-87, 2011.
SHANAHAN, C.; SHANAHAN, T. Disciplinary literacy. In Handbook of research on teaching the English language arts. Routledge, 2017. p. 281-308.
TAVASSOLI, F.; JALILIFAR, A.; WHITE, P. R. British newspapers’ stance towards the Syrian refugee crisis: An appraisal model study. Discourse & Society, v. 30, n. 1, p. 64-84, 2019.
UNSWORTH, L. Choosing and using information books in junior primary science. In: UNSWORTH, L. (ed.). Literacy learning and teaching: Language as social practice in the primary school. Macmillan, 1993.
UNSWORTH, L. Scaffolding reading of science explanations: Accessing the grammatical and visual forms of specialised knowledge. Reading, v. 31, n. 3, p. 30-42, 1997.
UNSWORTH, L. Explaining school science in book and CD ROM formats: Using semiotic analyses to compare the textual construction of knowledge. International Journal of Instructional Media, v. 26, n. 2, p. 159-179, 1999.
UNSWORTH, L. Comparing school science explanations in books and computer-based formats: The role of images, image/text relations and hyperlinks. International Journal of Instructional Media, v. 31, n. 3, p. 283-301, 2004.
UNSWORTH, L. e-literature for children: enhancing digital literacy learning. Routledge/Falmer, 2006a.
UNSWORTH, L. Multiliteracies and a metalanguage of image/text relations: Implications for teaching English as a first or additional language in the 21st century. Tales out of school: Identity and English language teaching. Special edition of TESOL in Context., Series S, n. 1, p. 147-162, 2006b.
UNSWORTH, L. Multiliteracies, e-Literature and English Teaching. Language and Education, v. 22, n. 1, p. 62-75, 2008.
UNSWORTH, L. Re-configuring image-language relations and interpretive possibilities in picture books as animated movies: A site for developing multimodal literacy pedagogy. Ilha do Desterro: A Journal of English Language, Literatures in English and Cultural Studies (Special Issue on Multimodality), v. 64, p. 15-47, 2013.
UNSWORTH, L. Multimodal Reading Comprehension: Curriculum Expectations and Large-scale Literacy Testing Practices. Pedagogies: An International Journal, v. 9, p. 26-44, 2014.
UNSWORTH, L. (ed.). Learning from Animations in Science Education: Innovating in Semiotic and Educational Research. Springer, 2020. DOI: https://doi.org/10.1007/978-3-030-56047-8.
UNSWORTH, L. (ed.). Coding Animated Narratives: Classroom Practices for Developing Digital Multimodal Authoring. Primary English Teaching Association Australia, 2024.
UNSWORTH, L.; BUSH, R. Introducing multimodal literacy to young children learning English as a Second Language. In: COLE, D.; PULLEN, D. (ed.). Multiliteracies in Motion: Current Theory and Practice. Routledge, 2010. p. 59-83.
UNSWORTH, L.; CHAN, E. Assessing integrative reading of images and text in group reading comprehension tests. Curriculum Perspectives, v. 28, n. 3, p. 71-76, 2008.
UNSWORTH, L.; CHAN, E. Bridging multimodal literacies and national assessment programs in literacy. Australian Journal of Language and Literacy, v. 32, n. 3, p. 245-257, 2009.
UNSWORTH, L.; COPE, J.; NICHOLLS, L. Multimodal literacy and large-scale literacy tests: Curriculum relevance and responsibility. Australian Journal of Language and Literacy, v. 42, n. 2, p. 128-139, 2019.
UNSWORTH, L.; HERRINGTON, M. Visualization Type and Frequency in Final Year High School Science Examinations. Research in Science Education, v. 53, n. 4, p. 707-725, 2023. https://doi.org/10.1007/s11165-022-10094-2
UNSWORTH, L.; MILLS, K. A. English language teaching of attitude and emotion in digital multimodal composition. Journal of Second Language Writing, v. 47, 100712, 2020. https://doi.org/https://doi.org/10.1016/j.jslw.2020.100712
UNSWORTH, L.; THOMAS, A.; BUSH, R. The role of images and image-text relations in group 'Basic Skills Tests' of literacy for children in the primary school years. Australian Journal of Language and Literacy, v. 27, n. 1, p. 46-65, 2004.
UNSWORTH, L.; THOMAS, A.; SIMPSON, A.; ASHA, J. Children's literature and computer based teaching. McGraw-Hill/Open University Press, 2005.
UNSWORTH, L.; TYTLER, R.; FENWICK, L.; HUMPHREY, S.; CHANDLER, P.; HERRINGTON, M.; PHAM, L. Multimodal Literacy in School Science: Transdisciplinary Perspectives on Theory, Research and Pedagogy. Routledge, 2022. DOI: https://doi.org/10.4324/9781003150718
VAN LEEUWEN, T. Introducing Social Semiotics. Routledge, 2005.
VAN LEEUWEN, T. Multimodality and Identity. Routledge, 2022.
WHITE, P. R. R. The attitudinal work of news journalism images – a search for visual and verbal analogues. Quaderni del CeSLiC Occasional Papers del CeSLiC, p. 6-42. 2014. Disponível em: http://amsacta.unibo.it/4110/
ZAPPAVIGNA, M.; LOGI, L. Emoji and Social Media Paralanguage. Cambridge University Press, 2024a.
ZAPPAVIGNA, M.; LOGI, L. How emoji make meaning and enact ambient affiliation: a social semiotic account of emoji-text relations in TikTok comments. Social Semiotics, p. 1-21, 2024b.
ZHAO, S.; UNSWORTH, L. Touch design and Narrative Interpretation: a social semiotic approach to Picture book Apps. In: KUCIRKOVA, N.; FALLOON, G. (ed.). Apps, Technology and Younger Learners: International evidence for teaching. Routledge, 2017. p. 89-102.
Downloads
Publicado
Edição
Seção
Licença
Copyright (c) 2024 Marisa Mendonca Carneiro
Este trabalho está licenciado sob uma licença Creative Commons Attribution 4.0 International License.
Autores/as que publicam nesta revista concordam com os seguintes termos:
Autores/as mantêm os direitos autorais e concedem à revista o direito de primeira publicação, sendo o trabalho simultaneamente licenciado sob a Creative Commons Attribution 4.0 International license que permite o compartilhamento do trabalho com reconhecimento da autoria do trabalho e publicação inicial nesta revista.
