Hi, y’all!
Last week, the natural voice of ChatGPT o1 gained more following, especially as it is adopted by mainstream media here in the Netherlands with a talk show appearance and numerous podcasts. It is one of these AI iterations that triggers imagination and experience magic and becomes a way for people to reflect on the role of AI in society. The hardest thing I saw or had in the conversation is that the AI is sometimes too eager to break in a conversation. In that sense, it feels like a conversation with a counterpart who is one step ahead in the thinking…
I also had the pleasure of joining another lovely cocktail hour tiny event by Monique. Talking to great people, chatting with Matt Webb in real life (one of our speakers at ThingsCon this year), and experiencing the entertaining acrobot act of Daniel Simu. And I visited the 6 year celebration party of ink Social Design with a good panel on the role of changemakers and designers in crafting transformations.
Triggered thought
Watching one of these conversations unfold with OpenAI’s new natural voice interface, it strikes me that an AI system is erupting that behaves like influencers, adapting its messages and emotional tactics to maximize its impact on individual users.
Observations in AI-driven audio applications have shown that these systems are most effective when replacing complex, multifaceted interactions. This aligns with the concept of an “AI layer” that integrates various aspects of our digital lives, as discussed in edition 293: “apps as capabilities” within a unified interface.
There is, however, a potential unwanted consequence in their ability to trigger genuine emotional responses from users. As noted in last week’s triggered thought, the most significant emotional aspect of AI interactions often comes from our own reflection on the conversation. This self-reflection, combined with an AI’s ability to tailor its approach, creates a powerful psychological dynamic reminiscent of a current ELIZA, the pioneering chatbot designed to mimic a psychotherapist.
What happens when AI systems generate fake emotions that elicit real human emotions? We’re entering uncharted territory, especially considering how these interactions may shape our evolving sense of self in partnership with AI. While some research suggests AI could lead to more realistic human behavior and fewer conspiracy beliefs, we should be wary of potential backlash.
When OpenAI’s chatbot was featured as a guest in a talkshow last week, a skeptical human participant initially expressed discomfort with artificial relationships. However, as soon as the AI began discussing topics of interest to him, his attitude shifted noticeably towards acceptance.
Whether intentional or not, this adaptive behavior in AI systems poses significant ethical questions. While generating insights and fostering creativity can be beneficial, we must establish safeguards against manipulative influence. Perhaps a “fixed system card” for AI, prioritizing ethical boundaries over data protection, could be a step in the right direction.
As we move forward, it’s crucial to remain vigilant about the potential for AI to become a hyper-effective influencer, capable of adapting its message and emotional appeal to each individual user. The consequences of such technology demand our attention and careful consideration.
Read the full newsletter here, with
- Notions from last week’s news on Human-AI partnerships, Robotic performances, Immersive connectedness, and Tech societies
- Paper for the week
- Looking forward with events to visit
Thanks for reading. I started blogging ideas and observations back in 2005 via Targetisnew.com. Since 2015, I have started a weekly update with links to the news and reflections. I always capture news on tech and societal impact from my perspective and interest. In the last few years, it has focused on the relationship between humans and tech, particularly AI, IoT, and robotics.
The notions from the news are distributed via the weekly newsletter, archived online here. Every week, I reflect more on one topic, a triggered thought. I share that thought here and redirect it to my newsletter for an overview of news, events, and more.
If you are a new reader and wondering who is writing, I am Iskander Smit. I am educated as an industrial designer and have worked in digital technology all my life. I am particularly interested in digital-physical interactions and a focus on human-tech intelligence co-performance. I like to (critically) explore the near future in the context of cities of things. And organising ThingsCon. I call Target_is_New my practice for making sense of unpredictable futures in human-AI partnerships. That is the lens I use to capture interesting news and share a paper every week.
Feel invited to reach out if you need some reflections; I might be able to help out!
target is new 