Gender Bias in Social Chatbots: A Conversation Test Study Based on Xiaoice Series of Chatbots

MA Zhonghong; WU Xichang

PDF(1803 KB)

Chinese Journal of Journalism & Communication ›› 2024, Vol. 46 ›› Issue (4) : 72-89.

Specific Topic/Artificial Intelligence and Algorithms Research

Gender Bias in Social Chatbots: A Conversation Test Study Based on Xiaoice Series of Chatbots

MA Zhonghong ,
WU Xichang

Author information +

History +

Abstract

As AI social chatbots are seen as human communicators, it is crucial to understand the problems of gender bias in their interactions with humans. Using the method of conversation test, this paper designs a series of questions for testing gender bias of robots and to test the gender bias of three mainstream social chatbots in China. The interaction texts are analyzed through qualitative coding analysis.The results indicate that social chatbots exhibit significant gender bias in self-perception of gender, gender stereotypes, gender equality, and response to gender harassment, which are unrelated to the male and female gender roles of the social chatbots themselves. The gender bias of social chatbots as products of human-computer interaction technology, they are constructed by user participation, dialog system technical support, technology companies and program developers. The result is that AI, as represented by social chatbots, replicates and reinforces the construct power of gender bias in the gender culture of human society in learning and imitation.

Key words

artificial intelligence / social chatbots / Xiaoice series / gender bias / conversation test

Cite this article

EndNote

Ris (Procite)

Bibtex

Download Citations

MA Zhonghong , WU Xichang. Gender Bias in Social Chatbots: A Conversation Test Study Based on Xiaoice Series of Chatbots[J]. Chinese Journal of Journalism & Communication. 2024, 46(4): 72-89

References

List( Publishing order | Descend order by publishing year | Descend order by cited within ) Chart analysis

[1]	蔡润芳(2017). 人机社交传播与自动传播技术的社会建构——基于欧美学界对Socialbots的研究讨论. 《当代传播》,(6),53-58. Cited in this article [1]

[2]	陈昌凤(2022). 人机何以共生:传播的结构性变革与滞后的伦理观. 《新闻与写作》,(10),5-16. Cited in this article [1]

[3]	陈英, 肖峰(2011). 技术女性主义述评. 《科学技术哲学研究》,(1),67-72. Cited in this article [1]

[4]	洪杰文, 许琳惠(2021). 社交网络中社交机器人行为及其影响研究——基于国外相关文献的综述. 《全球传媒学刊》,(4),68-85. Cited in this article [1]

[5]	郭全中, 张金熠(2023). 人机交互(HCI)的历史演进、核心驱动与未来趋势. 《新闻与传播研究》,(7),11-15. Cited in this article [1]

[6]	贾熹滨, 李让, 胡长建, 陈军成(2017). 智能对话系统研究综述. 《北京工业大学学报》,(9),1344-1356. Cited in this article [1]

[7]	梁爽(2021). 从“刺激-反馈”到“情感交流”:移动应用人机交互的模式演变与发展历程. 《青年记者》,(4),27-28. Cited in this article [1]

[8]	刘霓(2002). 技术与男性气质:应予瓦解的等式——女性主义技术研究述评. 《国外社会科学》,(4), 66-72. Cited in this article [1]

[9]	陶锋(2019). 人工智能中的性别歧视. 《浙江学刊》,(4),12-20. Cited in this article [1]

[10]	沃尔特·李普曼(1922/2006). 《公众舆论》(阎克文,江红译). 上海: 上海人民出版社. Cited in this article [1]

[11]	袁艳, 朱琳(2021). AI(爱)心陪伴:中国儿童陪伴机器人的网络化身体与多重男性气质. 《传播与社会学刊》,(57),225-254. Cited in this article [1]

[12]	张洪忠, 段泽宁, 韩秀(2019). 异类还是共生:社交媒体中的社交机器人研究路径探讨. 《新闻界》,(2),10-17. Cited in this article [1]

[13]	周钰颖, 闵勇, 江婷君, 吴晔, 金小刚, 蔡和(2022). 社交媒体机器人的研究现状、挑战与展望. 《小型微型计算机系统》(10),2113-2121. Cited in this article [1]

[14]	Bakan, D. (1966). The duality of human existence: An essay on psychology and religion. Chicago, IL: Rand McNally. Cited in this article [1]

[15]	Bergen, H. (2016). ‘I’ d blush if I could’: Digital assistants, disembodied cyborgs and the problem of gender. Word and Text, A Journal of Literary Studies and Linguistics, 6(1), 95-113. Cited in this article [1]

[16]	Corea, G, Klein, R, Hanmer, J, et al. (1985). Man-made women: How reproductive technologies affect women. London, UK: Hutchinson. Cited in this article [1]

[17]	Dourish, P. (2001). Where the action is. Cambridge, MA: MIT Press. Cited in this article [1]

[18]	Eyssel, F., & Hegel, F. (2012). (S) he’s got the look: Gender stereotyping of robots 1. Journal of Applied Social Psychology, 42(9), 2213-2230. Cited in this article [1]

[19]	Gambino, A., Fox, J., & Ratan, R. A. (2020). Building a stronger CASA: Extending the computers are social actors paradigm. Human-Machine Communication, 1, 71-85. Cited in this article [1]

[20]	Go, E., & Sundar, S. S. (2019). Humanizing chatbots: The effects of visual, identity and conversational cues on humanness perceptions. Computers in Human Behavior, 97, 304-316. Cited in this article [1]

[21]	Harding, S G. (1986). The science question in feminism. Ithaca, NY: Cornell University Press. Cited in this article [1]

[22]	Haraway, D. (1987). A manifesto for cyborgs: Science, technology, and socialist feminism in the 1980s. Australian Feminist Studies, 2(4), 1-42. Cited in this article [1]

[23]	Keijsers, M., Bartneck, C., & Eyssel, F. (2021). What’s to bullying a bot? Correlates between chatbot humanlikeness and abuse. Interaction Studies, 22(1), 55-80. Cited in this article [1]

[24]	Lee, E. J., Nass, C., & Brave, S. (2000, April). Can computer-generated speech have gender? An experimental test of gender stereotype. In CHI’00 extended abstracts on Human factors in computing systems. Den Haag, Netherlands. Cited in this article [1]

[25]	MacKenzie, D., & Wajcman, J. (1999). The social shaping of technology. Buckingham, UK: Open University Press. Cited in this article [2]

[26]	Maréchal, N. (2016). Automation, algorithms, and politics\| when bots tweet: Toward a normative framework for bots on social networking sites (feature). International Journal of Communication, 10, 10. Cited in this article [1]

[27]	Nass, C., Moon, Y., Fogg, B. J., Reeves, B., & Dryer, C. (1995, May). Can computer personalities be human personalities?. In Conference companion on Human factors in computing systems. Denver, Colorado. Cited in this article [1]

[28]	Nass, C., Moon, Y., & Green, N. (1997). Are machines gender neutral? Gender-stereotypic responses to computers with voices. Journal of Applied Social Psychology, 27(10), 864-876. Cited in this article [1]

[29]	Ojeda, C. (2021). The political responses of virtual assistants. Social Science Computer Review, 39(5), 884-902. Cited in this article [1]

[30]	Plant, S.(2016). Zeros and ones:Digital Women and the New Technoculture. Rotterdam, NLD: Experimental Publishing. Cited in this article [1]

[31]	Sarikaya, R. (2017). The technology behind personal digital assistants: An overview of the system architecture and key components. IEEE Signal Processing Magazine, 34(1), 67-81. Cited in this article [1]

[32]	Schuetzler, R. M., Grimes, G. M., & Scott Giboney, J. (2020). The impact of chatbot conversational skill on engagement and perceived humanness. Journal of Management Information Systems, 37(3), 875-900. Cited in this article [1]

[33]	Shum, H. Y., He, X. D., & Li, D. (2018). From Eliza to XiaoIce: Challenges and opportunities with social chatbots. Frontiers of Information Technology & Electronic Engineering, 19, 10-26. Cited in this article [1]

[34]	Suchman, L. A. (1987). Plans and situated actions:The problem of human-machine communication. Cambridge, UK: Cambridge University Press. Cited in this article [1]

[35]	Suhaili, S. M., Salim, N., & Jambli, M. N. (2021). Service chatbots: A systematic review. Expert Systems with Applications, 184, 115461. Cited in this article [1]

[36]	Wajcman, J.(2007). From women and technology to gendered technoscience. Information, Community and Society, 10(3), 287-298.

[37]	Wajcman, J. (1991). Feminism confronts technology. Cambridge, UK: Polity Press. Cited in this article [1]

[38]	Wajcman, J. (2010). Feminist theories of technology. Cambridge Journal of Economics, 34(1), 143-152. Cited in this article [1]

[39]	West, M., Kraut, R., & Ei Chew, H. (2019). I’d blush if I could: Closing gender divides in digital skills through education. Paris, FR: EQUALS and UNESCO. Cited in this article [1]

[40]	Xu, K. (2019). First encounter with robot Alpha: How individual differences interact with vocal and kinetic cues in users’ social responses. New Media & Society, 21(11-12), 2522-2547. Cited in this article [1]

Funding

This paper is a phased achievement of the National Social Science Fund project “Research on the Practice of Youth Women’s Digital Media Culture”(19BXW112)