Clustering Methods for Identifying Key Framing Elements in Multimodal News Coverage of the Belt and Road Initiative: A Cross-platform Study
DOI:
https://doi.org/10.52152/RCR.V12.11Keywords:
Multimodal Framing Analysis, Belt and Road Initiatives, News Coverage, Clustering Method of Framing Elements, Audience EngagementAbstract
This study aims to determine the effectiveness of clustering strategies in the analysis of framing aspects in MMNs with regard to the Belt and Road Initiative (BRI). This paper seeks to understand how text, images and videos help in the construction of the BRI, a major geo-political and economic undertaking spear headed by China. To this end, this study intends to use a more sophisticated clustering approach that would allow identification of the main framing constituents and their interaction in the context of the specific media segments. The method adopted in the study combines text analysis, visual content analysis and extraction of frames from the videos as a way of capturing the dimensions of news coverage. The concept of multimodal framing is vital, especially when studying how such a large-scale global project like the BRI is framed. Thinking types involve textual factors like headlines or keywords and thematic stories together with visions like images and video clips addressed to find out the patterns and frames. The research applies NLP tools for textual content, image analysis for images, and video scribes for the classification of video clips. These methods combined provide a systematic way in which the presentation of content in multifaceted media can be studied, and give evidence on the continuity and disparity of the framing within platforms. It is only when one plays the different modes of communication against one another, that the study shows how each of them contributes to the construction of the public understanding of the BRI. In doing so, the study thus offers a holistic perspective of the nature and forms of the dominant frames alongside their differences across the media; a perspective that fills the gap left by existing research regarding how all the features of multimodal composition work together to shape the audience’s perception. This research contributes to the field of media and communication by proving the fact that how clustering technique is effective in multimodal analysis and how the current framework provides the foundation for future research related to the media framing that happens in the cross-media environment.
References
Ahva, L., & Hellman, M. (2015). Citizen eyewitness images and audience engagement in crisis coverage. International Communication Gazette, 77(7), 668-681. https://doi.org/10.1177/1748048515601559
Alonso Belmonte, I., & Porto, M. D. (2020). Multimodal framing devices in European online news. Language and Communication, 71, 55-71. https://doi.org/10.1016/j.langcom.2019.12.001
Altay, S., Nielsen, R. K., & Fletcher, R. (2024). News can help! The impact of news media and digital platforms on awareness of and belief in misinformation. International Journal of Press/Politics, 29(2), 459-484. https://doi.org/10.1177/19401612221148981
Annamoradnejad, I., Fazli, M. A., Habibi, J., & Tavakoli, S. (2019). Cross-cultural studies using social networks data. IEEE Transactions on Computational Social Systems, 6(4), 627-636. https://doi.org/10.1109/TCSS.2019.2919666
Barkemeyer, R., Figge, F., Hoepner, A., Holt, D., Kraak, J. M., & Yu, P. S. (2017). Media coverage of climate change: An international comparison. Environment and Planning C: Politics and Space, 35(6), 1029-1054. https://doi.org/10.1177/0263774X16680818
Belair-Gagnon, V., Nelson, J. L., & Lewis, S. C. (2019). Audience engagement, reciprocity, and the pursuit of community connectedness in public media journalism. Journalism Practice, 13(5), 558-575. https://doi.org/10.1080/17512786.2018.1542975
Berhanu, K., & Raj, S. (2020). The trustworthiness of travel and tourism information sources of social media: perspectives of international tourists visiting Ethiopia. Heliyon, 6(3), e03439. https://doi.org/10.1016/j.heliyon.2020.e03439
Bhuiyan, M. M., Whitley, H., Horning, M., Lee, S. W., & Mitra, T. (2021). Designing transparency cues in online news platforms to promote trust: Journalists’ & consumers’ perspectives. Proceedings of the ACM on Human-Computer Interaction, 5(CSCW2). https://doi.org/10.1145/3479539
Blassnig, S., & Esser, F. (2022). The “Audience Logic” in digital journalism: An exploration of shifting news logics across media types and time. Journalism Studies, 23(1), 48-69. https://doi.org/10.1080/1461670X.2021.2000339
Broersma, M. (2019). Audience engagement. The International Encyclopedia of Journalism Studies, 1-6. https://doi.org/10.1002/9781118841570.iejs0060
Cedillo, C. V. (2018). From the editor. The Journal of Multimodal Rhetorics, 2(2), 2-3.
Chauhan, A., & Hughes, A. L. (2020). Trustworthiness perceptions of social media resources named after a crisis event. Proceedings of the ACM on Human-Computer Interaction, 4(CSCW1). https://doi.org/10.1145/3392849
Chyi, H. I., & Chadha, M. (2012). News on new devices: Is multi-platform news consumption a reality? Journalism Practice, 6(4), 431-449. https://doi.org/10.1080/17512786.2011.629125
Cvetkovic, I., & Pantic, M. (2018). Multimodal discursivity: Framing European Union Borders in live-blogs. Journal of Communication Inquiry, 42(4), 318-339. https://doi.org/10.1177/0196859918786273
Dancygier, B. (2023). Multimodal media: Framing climate change. Discourse Studies, 25(2), 220-236. https://doi.org/10.1177/14614456231154724
Debras, C., & L’Hôte, E. (2015). Framing, metaphor and dialogue: A multimodal approach to party conference speeches. Metaphor and the Social World, 5(2), 177-204.
Faustini, P. H. A., & Covões, T. F. (2020). Fake news detection in multiple platforms and languages. Expert Systems with Applications, 158, 113503. https://doi.org/10.1016/j.eswa.2020.113503
Ferrer-Conill, R., & Tandoc, E. C. (2018). The audience-oriented editor: Making sense of the audience in the newsroom. Digital Journalism, 6(4), 436-453. https://doi.org/10.1080/21670811.2018.1440972
Gajardo, C., & Costera Meijer, I. (2023). How to tackle the conceptual inconsistency of audience engagement? The introduction of the dynamic model of audience engagement. Journalism, 24(9), 1959-1979. https://doi.org/10.1177/14648849221080356
Geers, S. (2020). News consumption across media platforms and content: A typology of young news users. Public Opinion Quarterly, 84(S1), 332-354. https://doi.org/10.1093/poq/nfaa010
Gergen, K. J., Gulerce, A., Lock, A., & Misra, G. (1996). Psychological science in cultural context. American Psychologist, 51(5), 496-503. https://doi.org/10.1037//0003-066x.51.5.496
Gierth, L., & Bromme, R. (2020). Attacking science on social media: How user comments affect perceived trustworthiness and credibility. Public Understanding of Science, 29(2), 230-247. https://doi.org/10.1177/0963662519889275
Grimmelikhuijsen, S., De Vries, F., & Zijlstra, W. (2018). Breaking bad news without breaking trust: The effects of a press release and newspaper coverage on perceived trustworthiness. Journal of Behavioral Public Administration, 1(1). https://doi.org/10.30636/jbpa.11.16
Guess, A., Aslett, K., Tucker, J., Bonneau, R., & Nagler, J. (2021). Cracking open the news feed: Exploring what U.S. Facebook users see and share with large-scale platform data. Journal of Quantitative Description: Digital Media, 1. https://doi.org/10.51685/jqd.2021.006
Hafez, K. (1999). International news coverage and the problems of media globalization. In search of a ‘new global-local nexus’. Innovation: The European Journal of Social Science Research, 12(1), 47-62. https://doi.org/10.1080/13511610.1999.9968587
Halfmann, A., Dech, H., Riemann, J., Schlenker, L., & Wessler, H. (2019). Moving closer to the action: How viewers’ experiences of eyewitness videos in TV news influence the trustworthiness of the reports. Journalism and Mass Communication Quarterly, 96(2), 367-384. https://doi.org/10.1177/1077699018785890
Heikkilä, H., & Ahva, L. (2015). The relevance of journalism: Studying news audiences in a digital era. Journalism Practice, 9(1), 50-64. https://doi.org/10.1080/17512786.2014.928465
Hiltz, S. R., & Gonzalez, J. J. (2012, November). Assessing and improving the trustworthiness of social media for emergency management: A literature review. Proceedings of the Norwegian Information Security Conference (NISK), Bodo, Norway (pp. 19-21). Retrieved from https://www.researchgate.net/profile/Jose-Gonzalez-19/publication/259291060_Assessing_and_Improving_the_Trustworthiness_of_Social_Media_for_Emergency_Management_A_Literature_Review/links/56bc55c608ae70d57b40676b/Assessing-and-Improving-the-Trustworthiness-of-Social-Media-for-Emergency-Management-A-Literature-Review.pdf
Hindle, K., & Klyver, K. (2007). Exploring the relationship between media coverage and participation in entrepreneurship: Initial global evidence and research implications. International Entrepreneurship and Management Journal, 3(2), 217-242. https://doi.org/10.1007/s11365-006-0018-8
Hopmann, D. N., Shehata, A., & Strömbäck, J. (2015). Contagious media effects: How media use and exposure to game-framed news influence media trust. Mass Communication and Society, 18(6), 776-798. https://doi.org/10.1080/15205436.2015.1022190
Hu, Y. (2020). Multimodal framing : How multimodal elements influence framing effects in the debates of plastic (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (No. 30503212)
Ionel, D., & Alexandru-Gabriel, B. (2019). New trends in sustainable business and consumption Romanian food waste analyses. Amfiteatru Economic Journal, 17, 29.
Jungblut, M., & Zakareviciute, I. (2019). Do pictures tell a different story? A multimodal frame analysis of the 2014 Israel-Gaza conflict. Journalism Practice, 13(2), 206-228. https://doi.org/10.1080/17512786.2017.1412804
Katz, J. E., & Lai, C.-H. (2009). News blogging in cross-cultural contexts: A report on the struggle for voice. Knowledge, Technology & Policy, 22(2), 95-107. https://doi.org/10.1007/s12130-009-9072-1
Kim, H. S., Suh, Y. J., Kim, E. mee, Chong, E., Hong, H., Song, B., . . . Choi, J. S. (2022). Fact-checking and audience engagement: A study of content analysis and audience behavioral data of fact-checking coverage from news media. Digital Journalism, 10(5), 781-800. https://doi.org/10.1080/21670811.2021.2006073
Lawrence, R. G., Radcliffe, D., & Schmidt, T. R. (2018). Practicing engagement: Participatory journalism in the Web 2.0 era. Journalism Practice, 12(10), 1220-1240. https://doi.org/10.1080/17512786.2017.1391712
Lee, H., & Yang, J. (2014). Political knowledge gaps among news consumers with different news media repertoires across multiple platforms. International Journal of Communication, 8(1), 597-617.
Matsumoto, D. (2007). Culture, context, and behavior. Journal of Personality, 75(6), 1285-1320. https://doi.org/10.1111/j.1467-6494.2007.00476.x
Meier, K. (2009). Credibility and trustworthiness in the digital future. Retrieved from https://www.researchgate.net/publication/357834352_TRANSPARENCY_IN_JOURNALISM_Credibility_and_trustworthiness_in_the_digital_future
Meier, K., Kraus, D., & Michaeler, E. (2018). Audience engagement in a post-truth age: What it means and how to learn the activities connected with it. Digital Journalism, 6(8), 1052-1063. https://doi.org/10.1080/21670811.2018.1498295
Mihelj, S., Kondor, K., & Štětka, V. (2022). Establishing trust in experts during a crisis: Expert trustworthiness and media use during the COVID-19 pandemic. Science Communication, 44(3), 292-319. https://doi.org/10.1177/10755470221100558
Moturu, S. T., & Liu, H. (2011). Quantifying the trustworthiness of social media content. Distributed and Parallel Databases, 29(3), 239-260. https://doi.org/10.1007/s10619-010-7077-0
Nelson, J. L. (2021). The next media regime: The pursuit of ‘audience engagement’ in journalism. Journalism, 22(9), 2350-2367. https://doi.org/10.1177/1464884919862375
Nelson, J. L., & Lei, R. F. (2018). The effect of digital platforms on news audience behavior. Digital Journalism, 6(5), 619-633. https://doi.org/10.1080/21670811.2017.1394202
Ng, R., & Tan, Y. W. (2021). Diversity of COVID-19 news media coverage across 17 countries: The influence of cultural values, government stringency and pandemic severity. International Journal of Environmental Research and Public Health, 18(22). https://doi.org/10.3390/ijerph182211768
Nwankpa, N., Ezeji, A., & Chile, S. (2021). One war, different coverage: Exploring cultural influences on international media framing of the Iraq War. American Journal of Communication, 3(1), 1-14. https://doi.org/10.47672/ajc.665
Osatuyi, B., & Hughes, J. (2018). A tale of two internet news platforms-realvs. Fake: An elaboration likelihood model perspective. Proceedings of the Annual Hawaii International Conference on System Sciences, 2018-January, 3986-3994. https://doi.org/10.24251/hicss.2018.500
Pavelka, J. (2014). The factors affecting the presentation of events and the media coverage of topics in the mass media. Procedia - Social and Behavioral Sciences, 140, 623-629. https://doi.org/10.1016/j.sbspro.2014.04.482
Pentzold, C., Sommer, V., Meier, S., & Fraas, C. (2016). Reconstructing media frames in multimodal discourse: The John/Ivan Demjanjuk trial. Discourse, Context and Media, 12, 32-39. https://doi.org/10.1016/j.dcm.2016.03.001
Pflaeging, J., & Stöckl, H. (2021). The rhetoric of multimodal communication. Visual Communication, 20(3), 319-326. https://doi.org/10.1177/14703572211010200
Ramírez, C. O. (2023). Conceptual complexes in multimodal advertising. Cultura, Lenguaje y Representacion, 30, 179-205. https://doi.org/10.6035/clr.6977
Ren, J., Dong, H., Popovic, A., Sabnis, G., & Nickerson, J. (2024). Digital platforms in the news industry: How social media platforms impact traditional media news viewership. European Journal of Information Systems, 33(1), 1-18. https://doi.org/10.1080/0960085X.2022.2103046
Ross Arguedas, A. A., Badrinathan, S., Mont’Alverne, C., Toff, B., Fletcher, R., & Nielsen, R. K. (2024). Shortcuts to trust: Relying on cues to judge online news from unfamiliar sources on digital platforms. Journalism, 25(6), 1207-1229. https://doi.org/10.1177/14648849231194485
Ryan, S. (2021). Fake news, epistemic coverage and trust. Political Quarterly, 92(4), 606-612. https://doi.org/10.1111/1467-923X.13003
Schwanholz, J., Graham, T., & Stoll, P. T. (2017). Managing democracy in the digital age: Internet regulation, social media use, and online civic engagement. Managing Democracy in the Digital Age: Internet Regulation, Social Media Use, and Online Civic Engagement, 1-270. https://doi.org/10.1007/978-3-319-61708-4
Steensen, S., Ferrer-Conill, R., & Peters, C. (2020). (Against a) Theory of audience engagement with news. Journalism Studies, 20, 1662-1680. https://doi.org/10.1080/1461670X.2020.1788414
Tong, J. (2023). From content to context: A qualitative case study of factors influencing audience perception of the trustworthiness of COVID-19 data visualisations in UK newspaper coverage. Journalism, 25(7), 1481-1499. https://doi.org/10.1177/14648849231190725
Torrent, T. T., Matos, E. E. D. S., Belcavello, F., Viridiano, M., Gamonal, M. A., Costa, A. D. D., & Marim, M. C. (2022). Representing context in Framenet: A multidimensional, multimodal approach. Frontiers in Psychology, 13, 838441.
Wallace, J. (2018). Modelling contemporary gatekeeping: The rise of individuals, algorithms and platforms in digital news dissemination. Digital Journalism, 6(3), 274-293. https://doi.org/10.1080/21670811.2017.1343648
Wessler, H., Wozniak, A., Hofer, L., & Lück, J. (2016). Global multimodal news frames on climate change: A comparison of five democracies around the world. International Journal of Press/Politics, 21(4), 423-445. https://doi.org/10.1177/1940161216661848
Westlund, O., & Ekström, M. (2018). News and participation through and beyond proprietary platforms in an age of social media. Media and Communication, 6(4), 1-10. https://doi.org/10.17645/mac.v6i4.1775
Wijenayake, S., Hettiachchi, D., Hosio, S., Kostakos, V., & Goncalves, J. (2021). Effect of conformity on perceived trustworthiness of news in social media. IEEE Internet Computing, 25(1), 12-19. https://doi.org/10.1109/MIC.2020.3032410
Wilcox, S. A. (2003). Cultural context and the conventions of science journalism: Drama and contradiction in media coverage of biological ideas about sexuality. Critical Studies in Media Communication, 20(3), 225-247. https://doi.org/10.1080/07393180302772
Wonneberger, A., Meijers, M. H. C., & Schuck, A. R. T. (2020). Shifting public engagement: How media coverage of climate change conferences affects climate change audience segments. Public Understanding of Science, 29(2), 176-193. https://doi.org/10.1177/0963662519886474
Wozniak, A., Lück, J., & Wessler, H. (2015). Frames, stories, and images: The advantages of a multimodal approach in comparative media content research on climate change. Environmental Communication, 9(4), 469-490. https://doi.org/10.1080/17524032.2014.981559
Xu, K., Liu, F., Mou, Y., Wu, Y., Zeng, J., & Schäfer, M. S. (2020). Using machine learning to learn machines: A cross-cultural study of users’ responses to machine-generated artworks. Journal of Broadcasting and Electronic Media, 64(4), 566-591. https://doi.org/10.1080/08838151.2020.1835136
Yuan, E. (2011). News consumption across multiple media platforms: A repertoire approach. Information Communication and Society, 14(7), 998-1016. https://doi.org/10.1080/1369118X.2010.549235
Zayani, M. (2021). Digital journalism, social media platforms, and audience engagement: The case of AJ+. Digital Journalism, 9(1), 24-41. https://doi.org/10.1080/21670811.2020.1816140
Zhang, Z., & Gupta, B. B. (2018). Social media security and trustworthiness: Overview and new direction. Future Generation Computer Systems, 86, 914-925. https://doi.org/10.1016/j.future.2016.10.007
Zheng, Y., Zhong, B., & Yang, F. (2018). When algorithms meet journalism: The user perception to automated news in a cross-cultural context. Computers in Human Behavior, 86, 266-275. https://doi.org/10.1016/j.chb.2018.04.046
Downloads
Published
Issue
Section
License
Copyright (c) 2024 Review of Communication Research
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
The philosophy of the journal is to be open and to make all articles accessible. It is our belief that open access is a must in the future of science.
Authors who publish with RCR accept a slightly modified Creative Commons Attribution-NonCommercial 3.0 Unported License.
You, as author, retain the copyrights for your paper, but the Review of Communication Research is granted exclusivity for publication of the article. The agreement allows others to share the work with an acknowledgement of the work's authorship and publication in this journal. We do not want third parties to make a commercial use of the article, unless we agree it with authors.
The journal will run an open review process as well as a traditional peer review process.
When the manuscript is accepted for publication, it will get a doi number and get available online to facilitate early citation.
The journal will post the published article to many public repositories for further diffusion and permanence.
You, as author, are permitted and encouraged to post your work online (e.g., in institutional repositories or on your website), as it can lead to productive exchanges, as well as earlier and greater citation of published work.
If you have any doubts, please, contact the editor: editor@rcommunication.org
Many thanks for submitting your work to this journal.
