探索与争鸣 ›› 2025, Vol. 1 ›› Issue (8): 106-115.

• 技术与文明 • 上一篇    下一篇

人工智能与未来社会(二十)|人机交互中的情感操控“黑洞”——基于虚拟聊天伴侣的反思

吴静   

  • 出版日期:2025-09-20 发布日期:2025-08-20
  • 作者简介:吴静,南京师范大学哲学系教授。(南京 210043)
  • 基金资助:
    国家社科基金重大项目“当代新兴增强技术前沿的人文主义哲学研究”(20&ZD045)

Emotional Manipulation “Black Hole” in Human-Computer Interaction: Reflections based on Virtual Chat Partners

Wu Jing
  

  • Online:2025-09-20 Published:2025-08-20

摘要: 算法的取悦性导致其奖励机制侧重于吸引用户,可能引发隐私、认知和情感等多方面的问题。在人机交互中,算法粘性与关系边界存在张力,将关系亲密度作为核心目标会引发一系列问题,如社交技能退化、社会凝聚力下降等。同时,可解释性陷阱与皮格马利翁效应交织,加剧了用户的情感依赖和对技术本质的误解,形成情感操控的“黑洞”。为构建健康的人机关系,算法设计应摒弃将单纯增强关系亲密度作为核心目标的思路,在性能、可解释性与用户独立性间寻求根本性平衡。监管层面也需持续加强引导,使技术发展符合人类利益,从而实现人机和谐共生、协同发展。

关键词: 虚拟聊天伴侣, 人机交互, 算法, 边界, 情感

Abstract:

he pleasing nature of algorithms leads their reward mechanisms to focus on attracting users, which may trigger various issues concerning privacy, cognition, and emotion. In human-computer interaction, there is tension between algorithm stickiness and relationship boundaries. Taking relationship intimacy as the core objective can lead to a series of problems, such as the degradation of social skills and the decline of social cohesion. At the same time, the interpretability trap is intertwined with the Pygmalion effect, which exacerbates users’ emotional dependence and misunderstandings of the essence of technology, forming an emotional manipulation “black hole”. To build a healthy human-computer relationship, algorithm design should abandon the idea of simply enhancing relationship intimacy as the core goal and seek a fundamental balance among performance, interpretability, and user independence. The regulatory level also needs to be continuously strengthened to ensure that technological development aligns with human interests, thereby achieving harmonious coexistence and coordinated development between humans and machines.

Key words: