Analysis of user cognitive network evolution of 360-degree knowledge short video based on embodied Experience

MA Xiaoyue, SUN Mingfei

Chinese Journal of Journalism & Communication ›› 2023, Vol. 45 ›› Issue (3) : 130-156.

PDF(1995 KB)
PDF(1995 KB)
Chinese Journal of Journalism & Communication ›› 2023, Vol. 45 ›› Issue (3) : 130-156.
Research Articles

Analysis of user cognitive network evolution of 360-degree knowledge short video based on embodied Experience

Author information +
History +

Abstract

In the context of the rapid growth of the application scale of virtual reality technology, it is of great significance to explore the dynamic interactive mechanism between user-embodied experience and knowledge cognition in the context of 360-degree knowledge short video to effectively improve its communication effect. Based on embodied cognition theory, this study constructs a coding framework from two dimensions of embodied experience and video content cognition of users. On this basis, cognitive network analysis is used to encode the data and construct the user cognitive network. The correlation between different cognitive elements is analyzed by taking the bullet-chatting released by users of 360-degree knowledge short videos on Bilibili website as the data source. The dynamic evolution of user cognitive network is explored. It is found that users’ cognitive experience is related to cognition of video content. There is a highest relationship between the participation, presence in cognitive experience and focus on the plot, and outcome in content cognization. Users’ cognitive network differs at different times. In the learning process, users significantly enhance the focus on deep content cognitive elements and the invocation of embodied experience. The depth and complexity of cognitive nodes association gradually increase, reflecting the continuous improvement of user cognitive construction in the process of 360-degree video viewing.

Key words

360-degree video / knowledge content perception / embodied experience / cognitive network analysis

Cite this article

Download Citations
MA Xiaoyue , SUN Mingfei. Analysis of user cognitive network evolution of 360-degree knowledge short video based on embodied Experience[J]. Chinese Journal of Journalism & Communication. 2023, 45(3): 130-156

References

[1]
蔡辰, 刘思琦, 孙晓宁(2022). 弹幕用户的偶发学习过程模型构建——一项现象学研究. 《现代情报》,(1),108-118.
[2]
曾丽, 高权, 陈晓亮(2016). 游客具身体验视角下传统乡村旅游地的地方重构——婺源案例. 《旅游学刊》, (11),69-79.
[3]
陈忆金, 卓林锴, 赵一鸣(2021). 学习类视频弹幕用户的交互行为研究. 《图书馆论坛》,(9),95-101.
[4]
宫贺(2021). 独白与对话之间:重新理解“卷入”的概念边界与操作维度. 《新闻与传播研究》,(10),76-91.
[5]
胡艺龄, 聂静, 张天琦, 吴忭(2021). 具身认知视域下VR技术赋能实验教学的效果探究. 《现代远程教育研究》,(5),94-102.
[6]
凯文·罗宾,斯弗兰克·威伯斯特,何朝阳,王希华,陈光(2003). 虚拟技术,新的知识空间?. 《现代传播》,(2),106-108.
[7]
黎镇霆, 刘晨(2022). 观鸟活动的具身体验及其影响:基于流动性视角的研究. 《旅游学刊》,(5),69-79.
[8]
李唯嘉, 周泉(2022). “我觉得像是玩游戏”:用户对VR新闻的使用体验研究. 《国际新闻界》,(4),78-95.
[9]
刘海龙(2018). 传播中的身体问题与传播研究的未来. 《国际新闻界》,(2),37-46.
[10]
刘海龙, 束开荣(2019). 具身性与传播研究的身体观念——知觉现象学与认知科学的视角. 《兰州大学学报(社会科学版)》,(2),80-89.
[11]
刘海朦, 胡静, 贾垚焱, 吕丽(2021). 具身视角下历史文化街区旅游体验质量研究——以江汉路及中山大道历史文化街区为例. 《华中师范大学学报(自然科学版)》,(1),128-136.
[12]
刘思琦, 曾祥敏(2022). 知识类短视频关键构成要素及传播逻辑研究——基于B站知识类短视频的定性比较分析(QCA). 《新闻界》,(2),30-39+48.
[13]
马捷, 张光媛, 徐晓晨, 蒲泓宇(2018). 数字阅读与纸质阅读理解效果及沉浸体验实验研究——以科普知识为例. 《图书情报工作》,(16),35-46.
[14]
梅洛-庞蒂(1945/2001). 《知觉现象学》(姜志辉译). 北京: 商务印书馆.
[15]
彭兰(2019). 智能时代人的数字化生存——可分离的“虚拟实体”、“数字化元件”与不会消失的“具身性”. 《新闻记者》,(12),4-12.
[16]
彭文辉, 王中国, 上超望, 史玲玲(2021). 学习共同体演化动态及其参与者交互模式研究——数据驱动的社会认知网络分析. 《电化教育研究》,(11),69-76.
[17]
孙瑞英, 王旭(2017). “具身认知”视阈下阅读对情绪的调节. 《图书馆论坛》,(4),103-110.
[18]
唐·伊德(2004/2008). 《让事物“说话”:后现象学与技术科学》(韩连庆译). 北京: 北京大学出版社.
[19]
王美倩, 郑旭东(2016). 基于具身认知的学习环境及其进化机制:动力系统理论的视角. 《电化教育研究》,(6),54-60.
[20]
王长潇, 卢秋竹(2021). 听书抑或看书?——具身认知理论视角下媒介对阅读效果的影响. 《编辑之友》,(4),61-66.
[21]
徐翔, 王雨晨(2021). 社会回音室:网络传播中的信息趋同及其媒介逻辑——基于“今日头条”样本的计算传播学分析. 《国际新闻界》,(7),99-124.
[22]
许玮, 祝思璇(2022). 同伴互评对学习者知识建构过程的实证研究——基于时间序列的认知网络分析. 《现代教育技术》,(1),44-53.
[23]
叶浩生(2011). 有关具身认知思潮的理论心理学思考. 《心理学报》,(5),589-598.
[24]
叶浩生(2014). “具身”涵义的理论辨析. 《心理学报》,(7),1032-1042.
[25]
张宁, 段小宣, 袁勤俭(2022). 数字人文视频的用户弹幕评论行为生成机制. 《图书馆论坛》,(8),1-14.
[26]
张文娟(2022). 具身性之思想溯源、概念廓清与学科价值——一种对具身传播研究的元认知. 《新闻与传播研究》,(9),112-125+128.
[27]
张一兵(2013). 意蕴:遭遇世界中的上手与在手——海德格尔早期思想构境. 《中国社会科学》,(1),132-150+207-208.
[28]
赵猛(2016). 《胡塞尔的具身化知觉理论研究》. 北京: 中国社会科学出版社.
[29]
赵海明(2022). 基于“人—机”关系视角的具身传播再认识——一种媒介现象学的诠释. 《新闻大学》(7),14-26+116-117.
[30]
中泰证券(2021). 传媒行业:加速泛化的B站.检索于 https://stock.finance.sina.com.cn/stock/go.php/vReport_Show/kind/industry/rptid/665670750078/index.phtml.
[31]
朱婧雯(2022). 建构主义视域下媒介化知识传播与社会认知. 《中州学刊》,(1),166-172.
[32]
周鼎, 夏立新, 秦晓琪, 孙哲林(2022). 在线学习社区知识交流行为模型构建研究——基于扎根理论的探索. 《现代情报》,(1),54-63.
[33]
周平红, 周洪茜, 张屹, 林利(2021). 深度学习视域下学习者协同知识建构历程的社会认知网络特征分析. 《电化教育研究》,(9),99-107.
[34]
Ahn S. J., Bostick J., Ogle E., Nowak K. L., McGillicuddy K. T. & Bailenson J. N. (2016). Experiencing nature: Embodying animals in immersive virtual environments increases inclusion of nature in self and involvement with nature. Journal of Computer-Mediated Communication, 21(6), 399-419.
[35]
Aitamurto T., Aymerich-Franch L., Saldivar J., Kircos C., Sadeghi Y. & Sakshuwong S. (2022). Examining augmented reality in journalism: Presence, knowledge gain, and perceived visual authenticity. New Media & Society, 24(6), 1281-1302.
This article examines the impact of augmented reality (AR) visualizations on users’ sense of physical presence, knowledge gain, and perceptions of the authenticity of journalistic visuals. In a mixed experimental design, 79 participants were randomly assigned to view three The New York Times articles on a mobile phone featuring one of three viewing modalities: (1) AR visualizations, (2) interactive (non-AR) visualizations, or (3) non-interactive, static visualizations. AR induced a greater sense of physical presence compared to the other modalities. The findings suggest that immersive properties of AR can contribute to journalism’s goal of engaging the audience. However, AR was not a superior medium for informing the participants, and the viewing modality did not have an effect on the perceived authenticity of the visuals. The findings indicate a need for more efficient ways to relay information through journalistic AR visualizations while keeping the user engaged in an immersive experience.
[36]
Allport D. A., Antonis B. & Reynolds P. (1972). On the division of attention: A disproof of the single channel hypothesis. Quarterly Journal of Experimental Psychology, 24(2), 225-235.
[37]
Barbot B. & Kaufman J. C. (2020). What makes immersive virtual reality the ultimate empathy machine? Discerning the underlying mechanisms of change. Computers in Human Behavior, 111, 106431.
[38]
Blumenthal V. & Jensen Ø. (2019). Consumer immersion in the experience scape of managed visitor attractions: The nature of the immersion process and the role of involvement. Tourism Management Perspectives, 30, 159-170.
This article focuses on consumer immersion and explores how interactions with the experiencescape can influence the immersion process. The study presented in this article is explorative in nature and utilize a grounded theory approach. Data was collected through a combination of participant observation and semi-structured interviews with visitors participating in themed sailing trips offered at the Roskilde Viking Ship Museum in Denmark. Data analysis revealed three distinct stages in the immersion process: "involvement triggers", "involvement words" and "state of immersion". Each stage was connected to an increasingly higher level of involvement. Findings further indicated that the visitors' progression through the immersion process was dynamic and appeared to be moderated by the visitors' individual reactions to the incidents that occurred during the experience. This article provides new insights into the nature of the immersion process that have practical and theoretical implications for attraction management as well as experience design.
[39]
Bowman D., Swiecki Z., Cai Z., Wang Y., Eagan B., Linderoth J. & Shaffer D. W. (2021, February). The mathematical foundations of epistemic network analysis. Paper presented at Third International Conference on Quantitative Ethnography. Virtual Event.
[40]
Daassi M. & Debbabi S. (2021). Intention to reuse AR-based apps: The combined role of the sense of immersion, product presence and perceived realism. Information & Management, 58(4), 103453.
[41]
Dodoo N. A. & Youn S. (2021). Snapping and chatting away: Consumer motivations for and outcomes of interacting with Snapchat AR ad lens. Telematics and Informatics, 57, 101514.
[42]
Foxman M., Markowitz D. M. & Davis D. Z. (2021). Defining empathy: Interconnected discourses of virtual reality’s prosocial impact. New Media & Society, 23(8), 2167-2188.
While a consumer revolution in virtual reality (VR) has piqued the interest of many fields, industries, and professions, it is unclear when, how, and to what degree the technology can elicit empathy. To better understand how the relationship between VR and empathy is communicated and defined, we performed qualitative and quantitative thematic analyses on popular ( N = 640) and academic articles ( N = 53) that included both terms. Findings revealed empathy is an aspirational term for journalists and researchers to showcase the potential of immersive media for prosocial change. Writers in both corpora suggested that empathetic experiences could lead to prosocial action through VR, but do not consistently define or measure empathy, given the inherent complexities surrounding the term. Drawing on seminal research in the field, we conclude with a definition of empathy related to immersive media.
[43]
Hamari J. (2015). Why do people buy virtual goods? Attitude toward virtual good purchases versus game enjoyment. International Journal of Information Management, 35(3), 299-308.
[44]
Hardee G. M. & McMahan R. P. (2017). FIJI: a framework for the immersion-journalism intersection. Frontiers in ICT, 4, 21.
[45]
Hardy B. W. (2021). Embodied cognition in communication science. Communication Theory, 31(4), 633-653.
[46]
Hsu M. E. & Cheng M. T. (2021). Immersion experiences and behavioral patterns in game-based learning. British Journal of Educational Technology, 52(5), 1981-1999.
[47]
Hudson S., Matson-Barkat S., Pallamin N. & Jegou G. (2019). With or without you? Interaction and immersion in a virtual reality experience. Journal of Business Research, 100, 459-468.
This collaborative research between a team of digital technology developers and academic researchers investigates how social interaction affects visitors' experience during a virtual reality (VR) underwater seascape exploration. Prior research in immersive VR focused more on individual perceptions of immersion, interactive features and enjoyment. Analysis of focus-group discussions revealed three categories of immersion, interaction with the virtual environment (VE) and social interaction salient to satisfaction with the experience. Moderated mediation analysis of survey results from a full-scale trial (N = 234) show that the three variables had a significant role in experience satisfaction and loyalty intentions. Specifically, immersion mediates person-VE interaction effects on satisfaction and loyalty. The results contrast with previous findings from online gaming contexts, showing that social interactions decrease the impact of immersion on satisfaction and loyalty. We call for caution in the positioning and communication of VR experiences and for further research in other settings.
[48]
Kelly-Hedrick M., Grunberg P. H., Brochu F. & Zelkowitz P. (2018). “It’s totally okay to be sad, but never lose hope”: content analysis of infertility-related videos on YouTube in relation to viewer preferences. Journal of Medical Internet research, 20(5), e10199.
[49]
Kim D. & Ko Y. J. (2019). The impact of virtual reality (VR) technology on sport spectators’ flow experience and satisfaction. Computers in Human Behavior, 93, 346-356.
[50]
Luo Q., Hu S. & Guo Y. (2021). ‘Right here, right now!’: embodied experiences of pop concert participants. Current Issues in Tourism, 1-16.
[51]
Paciello M., D'Errico F., Saleri G. & Lamponi E. (2021). Online sexist meme and its effects on moral and emotional processes in social media. Computers in Human Behavior, 116, 106655.
[52]
Peukert C., Pfeiffer J., Meißner M., Pfeiffer T. & Weinhardt C. (2019). Shopping in virtual reality stores: the influence of immersion on system adoption. Journal of Management Information Systems, 36(3), 755-788.
[53]
Pimentel D., Kalyanaraman S., Lee Y. H. & Halan S. (2021). Voices of the unsung: The role of social presence and interactivity in building empathy in 360 video. New Media & Society, 23(8), 2230-2254.
360 video is considered an “empathy machine,” in part because it places audiences in the perspective of the other. Despite its popularity, its influence on empathy is not fully understood. Two possible mechanisms driving empathy within 360 video are social presence (sense of being with others) and interactivity (degree of control over media content). To elucidate how 360 videos can encourage empathic outcomes through these factors, a 2 (social presence: high/low) × 2 (interactivity: high/low) between-subjects experiment ( N = 110) was conducted testing 360 videos about Alaskan climate change refugees. Results demonstrate that social presence contributes to prosocial behaviors (donations) through empathic concern, an effect augmented by interactivity. Unexpectedly, the social presence manipulation also contributed to greater perceived interactivity. Collectively, results are promising and elucidate the role of social presence and interactivity in immersive storytelling.
[54]
Qin Y. (2021). Attractiveness of game elements, presence, and enjoyment of mobile augmented reality games: The case of Pokemon Go. Telematics and Informatics, 62, 101620.
[55]
Reychav I. & Wu D. (2015). Mobile collaborative learning: The role of individual learning in groups through text and video content delivery in tablets. Computers in Human Behavior, 50, 520-534.
[56]
Schaefer M., Denke C., Heinze H. J. & Rotte M. (2014). Rough primes and rough conversations: Evidence for a modality-specific basis to mental metaphors. Social Cognitive and Affective Neuroscience, 9(11), 1653-1659.
How does our brain organize knowledge? Traditional theories assume that our knowledge is represented abstractly in an amodal conceptual network of formal logic symbols. The theory of embodied cognition challenges this view and argues that conceptual representations that constitute our knowledge are grounded in sensory and motor experiences. We tested this hypothesis by examining how the concept of social coordination is grounded metaphorically in the tactile sensation of roughness. Participants experienced rough or smooth touch before being asked to judge an ambiguous social interaction. Results revealed that rough touch made social interactions appear more difficult and adversarial, consistent with the rough metaphor. This impact of tactile cues on social impressions was accompanied by a network including primary and secondary somatosensory cortices, amygdala, hippocampus and inferior prefrontal cortex. Thus, the roughness of tactile stimulation affected metaphor-relevant (but not metaphor-irrelevant) behavioral and neural responses. Receiving touch from a rough object seems to trigger the application of associated ontological concepts (or scaffolds) even for unrelated people and situations (but not to unrelated or more general feelings). Since this priming was based on somatosensory brain areas, our results provide support for the theory that sensorimotor grounding is intrinsic to cognitive processes. © The Author (2013). Published by Oxford University Press. For Permissions, please email: journals.permissions@oup.com.
[57]
Schaefer M., Cherkasskiy L., Denke C., Spies C., Song H., Malahy S., Heinz A., Ströhle A. & Bargh J. A. (2018). Incidental haptic sensations influence judgment of crimes. Scientific Reports, 8(1), 1-10.
[58]
Shin D. (2018). Empathy and embodied experience in virtual environment: To what extent can virtual reality stimulate empathy and embodied experience?. Computers in human behavior, 78, 64-73.
[59]
Shin D. (2019). How do users experience the interaction with an immersive screen?. Computers in Human Behavior, 98, 302-310.
Ultra-high definition television (UHDTV) is designed using a variety of immersive technologies that are believed to promote user engagement. This study examines the immersion feature of UHDTV by focusing on user experience (UX) to determine whether there is a favorable response by users and whether immersion improves their viewing experience. Further, it examines the relationship between UX and the quality perception of UHDTV to develop a conceptual model for users' quality of experience (QoE) with respect to UHDTV. It uses multiple methods combining experiment (to measure the effect of the immersive experience) and survey (to model the UHDTV UX). The results imply an optimum level of immersion as well as the need for user-based quality measurement. The results confirm the existing models of predicting user intentions with digital technologies and have potential to provide new insights to the research of immersive technologies.
[60]
Shin D. (2022). The actualization of meta affordances: Conceptualizing affordance actualization in the metaverse games. Computers in Human Behavior, 133, 107292.
[61]
Shin D. & Biocca F. (2018). Exploring immersive experience in journalism. New Media & Society, 20(8), 2800-2823.
Although virtual reality (VR) has been widely used to deliver news stories in immersive journalism (IJ), it is not clear how people are actually experiencing these stories and their contexts. Focusing on the immersion feature of VR stories, this study explicates the user experience to determine what it is like to experience news stories in VR and how immersion improves viewing experiences in IJ. This study proposes a VR experience model in the IJ context that integrates cognitive, affective, and behavioral factors as the primary influencing determinants. The results indicate that the meaning of immersion strongly depends on the users’ traits and contexts and that the function of immersion is strongly determined by the users’ own cognition and intentions. VR stories are viewed and accepted based on the manner that users imagine and intend to experience them. The model demonstrates the users’ cognitive processes of experiencing quality, value, and satisfaction, which determine how people empathize with and embody VR stories. The results confirm the relationship between immersion and both empathy and embodiment, implying a new conceptualization of immersion in the IJ context.
[62]
Shin D., Chotiyaputta V. & Zaid B. (2022). The effects of cultural dimensions on algorithmic news: How do cultural value orientations affect how people perceive algorithms?. Computers in Human Behavior, 126, 107007.
[63]
Slater M. & Wilbur S. (1997). A framework for immersive virtual environments (FIVE): Speculations on the role of presence in virtual environments. Presence: Teleoperators & Virtual Environments, 6(6), 603-616.
[64]
Sundar S. S., Kang J. & Oprean D. (2017). Being there in the midst of the story: How immersive journalism affects our perceptions and cognitions. Cyberpsychology, Behavior, and Social Networking, 20(11), 672-682.
[65]
Tse A., Jennett C., Moore J., Watson Z., Rigby J. & Cox A. L. (2017, May). Was I there? Impact of platform and headphones on 360 video immersion. Paper presented at the 2017 CHI conference extended abstracts on Human Factors in Computing Systems. Denver.
[66]
Wang G., Gu W. & Suh A. (2018, July). The effects of 360-degree VR videos on audience engagement:evidence from the New York Times. Paper presented at 4th Conference on HCI in Business, Government, and Organizations. Las Vegas.
[67]
Witmer B. G. & Singer M. J. (1998). Measuring presence in virtual environments: A presence questionnaire. Presence, 7(3), 225-240.
The effectiveness of virtual environments (VEs) has often been linked to the sense of presence reported by users of those VEs. (Presence is defined as the subjective experience of being in one place or environment, even when one is physically situated in another.) We believe that presence is a normal awareness phenomenon that requires directed attention and is based in the interaction between sensory stimulation, environmental factors that encourage involvement and enable immersion, and internal tendencies to become involved. Factors believed to underlie presence were described in the premier issue of Presence: Teleoperators and Virtual Environments. We used these factors and others as the basis for a presence questionnaire (PQ) to measure presence in VEs. In addition we developed an immersive tendencies questionnaire (ITQ) to measure differences in the tendencies of individuals to experience presence. These questionnaires are being used to evaluate relationships among reported presence and other research variables. Combined results from four experiments lead to the following conclusions: the PQ and ITQ are internally consistent measures with high reliability; there is a weak but consistent positive relation between presence and task performance in VEs; individual tendencies as measured by the ITQ predict presence as measured by the PQ; and individuals who report more simulator sickness symptoms in VE report less presence than those who report fewer symptoms.
[68]
Zong C. & Zhang Z. (2020, July). Study on Learning Effects and Platform Design Strategies of English Short Videos from the Perspective of Flow Experience. Paper presented at 22nd Conference on Human-Computer Interaction. Honolulu.

Funding

the National Natural Science Foundation of China(72174164)
PDF(1995 KB)

Accesses

Citation

Detail

Sections
Recommended

/