Algorithm Aversion in News Consumption: An Experimental Study on Subjective Evaluation Biases of Recommended Texts

ZHANG Meng, WANG Jingkai, YANG Jiaming

Chinese Journal of Journalism & Communication ›› 2026, Vol. 48 ›› Issue (2) : 115-137.

PDF(1756 KB)
PDF(1756 KB)
Chinese Journal of Journalism & Communication ›› 2026, Vol. 48 ›› Issue (2) : 115-137.
Research Articles

Algorithm Aversion in News Consumption: An Experimental Study on Subjective Evaluation Biases of Recommended Texts

Author information +
History +

Abstract

Focusing on “algorithm aversion” within the context of news consumption, this study employs a controlled experiment to systematically examine the differences in news consumers’ subjective evaluations of algorithm-recommended versus human-recommended texts. It further explores the moderating effects of demographic characteristics and content preferences on recommendation preferences. A total of 800 participants were involved in the experiment, with three dimensions—willingness to accept recommendations, perceived personalization, and overall evaluation—measured using Likert scales. Data were analyzed using independent samples t-tests, multiple linear regressions, and path analyses. The statistical results reveal that human recommendations significantly outperform algorithmic recommendations overall, eliciting higher subjective satisfaction in the dimension of users’ overall evaluation, thereby verifying the existence of “algorithm aversion” in the Chinese news consumption sector. Although the algorithm group generally scored lower in the dimensions of recommendation willingness and perceived personalization, these differences did not reach statistical significance. Multiple linear regressions and interaction effect analyses indicate that variables such as occupation, gender, daily news reading time, and active news-seeking behavior significantly impact subjective evaluations across different recommendation modes. Notably, significant or marginally significant interaction effects were observed in certain dimensions for “occupation × recommendation mode” and “content preference × recommendation mode”, indicating that occupation and news content preferences moderate users' subjective evaluations of recommendation approaches. For instance, among users with a high preference for international news, the satisfaction gap between the algorithmic and human recommendation groups is narrowed. Furthermore, the three-dimensional path analysis demonstrates that overall evaluation partially mediates the effect of perceived personalization on the willingness to accept recommendations. The findings suggest that when algorithmic recommendations demonstrate a precise understanding of user interests, users are more likely to tolerate algorithmic opacity, which enhances their overall evaluation, whereas relying solely on technical optimization yields limited outcomes.

Key words

Algorithm aversion / news consumption / algorithmic recommendation / human curation / subjective evaluation

Cite this article

Download Citations
ZHANG Meng , WANG Jingkai , YANG Jiaming. Algorithm Aversion in News Consumption: An Experimental Study on Subjective Evaluation Biases of Recommended Texts[J]. Chinese Journal of Journalism & Communication. 2026, 48(2): 115-137

References

[1]
杜严勇(2022). 厌恶算法还是欣赏算法?——人工智能时代的算法认知差异与算法信任建构. 《哲学分析》,(3),151-165+199.
[2]
胡扬, 匡远配, 祝子丽(2023). 区块链技术在国家审计中的应用——基于技术信任的视角. 《审计研究》,(1),39-47.
[3]
张萌, 杨家明(2023). 日常算法审计与计算基础设施修复——基于倒置视角的考察. 《新闻大学》,(8),88-100+120.
[4]
赵一骏, 许丽颖, 喻丰, 金旺龙(2024). 感知不透明性增加职场中的算法厌恶. 《心理学报》,(4),497-514.
[5]
Al-Htaybat, K., & von Alberti-Alhtaybat, L. (2017). Big data and corporate reporting: Impacts and paradoxes. Accounting, Auditing & Accountability Journal, 30(4), 850-873.
[6]
Appelbaum, D., Kogan, A., Vasarhelyi, M., & Yan, Z. (2017). Impact of business analytics and enterprise systems on managerial accounting. International Journal of Accounting Information Systems, 25, 29-44.
[7]
BBC. (2017, July). BBC Annual Plan for 2017/18. https://downloads.bbc.co.uk/aboutthebbc/insidethebbc/howwework/reports/pdf/BBC_Annual_Plan_2017-18.pdf.
[8]
Beck, A. H., Sangoi, A. R., Leung, S., Marinelli, R. J., Nielsen, T. O., van de Vijver M. J., & Koller, D. (2011). Systematic analysis of breast cancer morphology uncovers stromal features associated with survival. Science Translational Medicine, 3(8), 108-113.
[9]
Bhattacherjee, A., & Lin, C-P. (2015). A unified model of IT continuance: Three complementary perspectives and crossover effects. European Journal of Information Systems, 24(4), 364-373.
[10]
Bodó B., Helberger, N., Eskens, S., & Möller, J. (2019). Interested in diversity. Digital Journalism, 7(2), 206-229.
[11]
Burton, J. W., Stein, M. K., & Jensen, T. B. (2020). A systematic review of algorithm aversion in augmented decision making. Journal of Behavioral Decision Making, 33, 220-239.
[12]
Berger, B., Adam, M., Rühr, A., & Benlian, A. (2021). Watch me improve—algorithm aversion and demonstrating the ability to learn. Business & Information Systems Engineering, 63(1), 55-68.
[13]
Castelo, N., Bos, M. W., & Lehmann, D. R. (2019). Task-dependent algorithm aversion. Journal of Marketing Research, 56(5), 809-825.
[14]
Dawes, R. M. (1979). The robust beauty of improper linear models in decision making. American Psychologist, 34(7), 571-582.
[15]
Dzindolet, M.T., Pierce, L.G., Beck, H.P., & Dawe, L.A. (2002). The perceived utility of human and automated aids in a visual detection task. Human Factors: The Journal of the Human Factors and Ergonomics Society, 44(1), 79-94.
[16]
Diab, D. L., S. Y. Pui, Yankelevich, & S. Highhouse. (2011). Lay perceptions of selection decision aids in US and Non-Us samples. International Journal of Selection and Assessment, 19(2), 209-216.
[17]
Dietvorst, B. J., Simmons, J. P., & Massey, C. (2015). Algorithm Aversion: People erroneously avoid algorithms after seeing them err. Journal of Experimental Psychology: General, 144(1), 114-126.
[18]
Dietvorst, B. J., Simmons, J.P., & Massey, C. (2018). Overcoming algorithm aversion: People will use imperfect algorithms if they can (even slightly) modify them. Management Science, 64(3), 1155-1170.
[19]
Dietvorst, B. J., & Bharti, S. (2020). People reject algorithms in uncertain decision domains because they have diminishing sensitivity to forecasting error. Psychol Science, 31(10), 1302-1314.
[20]
Dietvorst, B. J., & Bartels, D.M. (2022). Consumers object to algorithms making morally relevant tradeofs because of algorithms’ consequentialist decision strategies. Journal of Consumer Psychology, 32, 406-424.
[21]
Elvestad, E., Arild, B., & Toril, A. (2014, July 22). The polarized news audience? A longitudinal study of news-seekers and news-avoiders in Europe. https://ssrn.com/abstract=2469713.
[22]
Filiz, I., Judek, J. R., Lorenz, M., & Spiwoks, M. (2021). Reducing algorithm aversion through experience. Journal of Behavioral and Experimental Finance, 31, 100524.
[23]
Grove, W. M., Zald, D. H., & Lebow, B. S. et al. (2000). Clinical versus mechanical prediction: A meta-analysis. Psychological Assessment, 12(1), 19-30.
[24]
Gomez-Uribe, Carlos A., & Neil, H. (2015). The Netflix Recommender System: Algorithms, business value, and innovation. ACM Transactions on Management Information Systems, 6(4), 1-19.
[25]
Germann, M., & Merkle, C. (2023). Algorithm aversion in delegated investing. Journal of Business Economics, 93(9), 1691-1727.
[26]
Highhouse, S. (2008). Stubborn reliance on intuition and subjectivity in employee selection. Industrial and Organizational Psychology, 1(3), 333-342.
[27]
Hoffman, R. R., Johnson, M., & Bradshaw, J. M. (2013). Trust in automation. IEEE Intelligent Systems, 28(1), 84-88.
[28]
Hsu, P. Y., Lei, H. T., Huang, S. H., Liao, T. H., Lo, Y. C., & Lo, C. C. (2019). Effects of Sentiment on recommendations in social network. Electronic Markets, 29(2), 253-262.
[29]
Jussupow, E., Benbasat, I., & Heinzl, A. (2020). Why are We Averse towards Algorithms? A comprehensive literature review on algorithm aversion. Proceedings of the 28th European Conference on Information Systems (ECIS). https://aisel.aisnet.org/ecis2020_rp/168
[30]
Jung, M., & Seiter, M. (2021). Towards a better understanding on mitigating algorithm aversion in forecasting: An experimental study. Journal of Management Control, 32(4), 495-516.
[31]
Kaufmann, E. (2021). Algorithm appreciation or aversion? Comparing in-service and pre-service teachers’ acceptance of computerized expert models. Computers and Education: Artificial Intelligence, 2, 100028.
[32]
Logg, J. M., Minson, J. A., & Moore, D. A. (2019). Algorithm appreciation: People prefer algorithmic to human judgment. Organizational behavior and human decision processes, 151, 90-103.
[33]
Logg, J. (2017, March 28). Theory of machine: When do people rely on algorithms?, [Paper presentation]. Harvard Business School Working Paper, No. 17-086.
[34]
Longoni, C., A., Bonezzi & C., K. Morewedge. (2019). Resistance to medical artificial intelligence. Journal of Consumer Research, 46(4), 629-650.
[35]
Ludwig, K., Grote, A., Iana, A., Alam, M., Paulheim, H., Sack, H., & Müller, P. (2023). Divided by the algorithm? The (limited) effects of content-and sentiment-based news recommendation on affective, ideological, and perceived polarization. Social Science Computer Review, 41(6), 2188-2210.
[36]
Mahmud, H., Islam, A. K. M. N., Ahmed, H. I., & Smolander, K. (2022). What influences algorithmic decision-making? A systematic literature review on algorithm aversion. Technological Forecasting & Social Change, 175, 121390.
[37]
New York Times. (2014, March 24). The New York Times: Innovation. https://nytco-assets.nytimes.com/2024/04/InnovationReport.pdf
[38]
Neil, T., Judith, M., Natali, H., & Damian, T. (2019). My friends, editors, algorithms, and I: Examining audience attitudes to news selection. Digital Journalism, 7(4), 447-469.
[39]
Pariser, E. (2011). The filter bubble: What the Internet is hiding from you. The Penguin Press.
[40]
Quattrone, P. (2016). Management accounting goes digital: Will the move make it wiser? Management Accounting Research, 31, 118-122.
[41]
Rozado, D., Al-Gharbi, M., & Halberstadt, J. (2023). Prevalence of prejudice-denoting words in news media discourse: A chronological analysis. Social Science Computer Review, 41(1), 99-122
[42]
Sears, David O., & Jonathan L. Freedman. (1967). Selective exposure to information: A critical review. Public Opinion Quarterly, 31(2), 194-213.
[43]
Sunstein, C. R. (2001). Echo chambers: Bush v. gore, impeachment, and beyond. Princeton University Press.
[44]
Stieglitz, S., & Dang-Xuan, L. (2013). Emotions and information diffusion in social media—sentiment of microblogs and sharing behavior. Journal of Management Information Systems, 29(4), 217-248.
[45]
Solon, O. (2016, November 10). Facebook’s failure: Did fake news and polarized politics get trump elected? The Guardian. https://www.theguardian.com/technology/2016/nov/10/facebook-fake-news-election-conspiracy-theories.
[46]
Yeomans, M., Shah, A., Mullainathan, S., & Kleinberg, J. (2019). Making sense of recommendations. Journal of Behavioral Decision Making, 32(4), 403-414.

Funding

General Program of National Social Science of China “Research on Algorithmic Cognitive Warfare and Computational Propaganda Mechanisms in Great Power Games”(23BXW053)
PDF(1756 KB)

Accesses

Citation

Detail

Sections
Recommended

/