☮ ♥ ♬ 🧑‍💻<p>“Breakthroughs in large language models (<a href="https://ioc.exchange/tags/LLMs" class="mention hashtag" rel="tag">#<span>LLMs</span></a>) have made conversations with <a href="https://ioc.exchange/tags/chatbots" class="mention hashtag" rel="tag">#<span>chatbots</span></a> feel more natural and human-like. Applications such as Replika and Character.ai, which allow users to chat with artificial intelligence (#<a href="https://ioc.exchange/tags/AI" class="mention hashtag" rel="tag">#<span>AI</span></a>) versions of famous actors and science-fiction characters, are becoming popular, especially among young <a href="https://ioc.exchange/tags/users" class="mention hashtag" rel="tag">#<span>users</span></a>. As a <a href="https://ioc.exchange/tags/neuroscientist" class="mention hashtag" rel="tag">#<span>neuroscientist</span></a> studying <a href="https://ioc.exchange/tags/stress" class="mention hashtag" rel="tag">#<span>stress</span></a>, <a href="https://ioc.exchange/tags/vulnerability" class="mention hashtag" rel="tag">#<span>vulnerability</span></a> and <a href="https://ioc.exchange/tags/resilience" class="mention hashtag" rel="tag">#<span>resilience</span></a>, I’ve seen how easily people react to even the smallest emotional cues — even when they know that those cues are artificial. For example, study participants exhibit measurable physiological responses when shown videos of computer-generated avatars expressing sadness or fear.”</p><p>…</p><p>“Because these AI systems are <a href="https://ioc.exchange/tags/trained" class="mention hashtag" rel="tag">#<span>trained</span></a> on vast amounts of emotionally expressive human language, their outputs can come across as surprisingly natural. *LLMs often mirror human emotional patterns, not because they understand emotions, but because their responses resemble how people talk.*”</p><p>…</p><p>“Now is the time to establish mandatory <a href="https://ioc.exchange/tags/safeguards" class="mention hashtag" rel="tag">#<span>safeguards</span></a> for all emotionally responsive AI.”</p><p>“Emotional influence isn’t a glitch. It’s a core feature of LLMs. If we celebrate their ability to comfort or advise, we must also confront their capacity to mislead or manipulate. We’ve built machines that sound like they care. Now, we must ensure that they don’t hurt the very people who turn to them for support. That means giving emotionally responsive AI not just more capabilities, but clearer boundaries.”</p><p><a href="https://ioc.exchange/tags/ZivBenZion" class="mention hashtag" rel="tag">#<span>ZivBenZion</span></a> / <a href="https://ioc.exchange/tags/neurosciene" class="mention hashtag" rel="tag">#<span>neurosciene</span></a> / <a href="https://ioc.exchange/tags/AI" class="mention hashtag" rel="tag">#<span>AI</span></a> / <a href="https://ioc.exchange/tags/GuardRails" class="mention hashtag" rel="tag">#<span>GuardRails</span></a> / <a href="https://ioc.exchange/tags/control" class="mention hashtag" rel="tag">#<span>control</span></a> / <a href="https://ioc.exchange/tags/WhiteCollar" class="mention hashtag" rel="tag">#<span>WhiteCollar</span></a> &lt;<a href="https://www.nature.com/articles/d41586-025-02031-w" target="_blank" rel="nofollow noopener noreferrer" translate="no"><span class="invisible">https://www.</span><span class="ellipsis">nature.com/articles/d41586-025</span><span class="invisible">-02031-w</span></a>&gt; (paywall) / &lt;<a href="https://archive.md/IyddU" target="_blank" rel="nofollow noopener noreferrer" translate="no"><span class="invisible">https://</span><span class="">archive.md/IyddU</span><span class="invisible"></span></a>&gt;</p>