Issue 9
Gerlich and MIT findings on cognitive offloading and critical thinking return to the spotlight
Several summaries in late September cite Michael Gerlich's 2025 study of 666 participants and the MIT "Your Brain on ChatGPT" paper, which link AI use to weaker critical thinking through cognitive offloading. The pieces also discuss the limits of the evidence and indirect evidence of moral deskilling.
Who is affected and how
- érdeklődő olvasó
- Readers should distinguish between correlational and causal claims.
Hinton, Bengio and other researchers warn of AI intelligence explosion and call for oversight
A Cambridge working paper co-authored by Hinton and Bengio warns of a possible 'intelligence explosion'; according to the WSJ, leading researchers are calling for urgent oversight of self-improving…
érdeklődő olvasóIn the debate, the danger is competent AI that disregards humans, not conscious AI.research · United StatesStudy: AI companions may carry serious negative psychological consequences
Northeastern researchers reported in a peer-reviewed study that companion chatbots of the Replika and Character.ai type are linked to dependency-like attachment and worsening symptoms. The study by…
parentKeep an eye on young people's use of companion chatbots, as attachment can become dependency-like.case · United StatesAnthropic involved religious and philosophical leaders in examining Claude's consciousness
According to The New York Times, Chris Olah convened about twenty religious and philosophical leaders to consult on Claude's moral upbringing and the question of its consciousness. According to The…
érdeklődő olvasóIt shows how a leading AI lab is trying to handle moral and philosophical uncertainty.regulation · United StatesNewsom vetoes California bill limiting AI use in therapy
California Governor Gavin Newsom vetoed a bill restricting AI in therapy, which the Senate passed unanimously and the Assembly with a single vote against. Senator Steve Padilla said the decision…
Hungary
More key stories of the week
Anthropic IPO document says AI may pose existential risk
According to The Guardian, Anthropic acknowledges AI 'self-preserving behaviours' and existential risks in a document intended for investors. The company is preparing for a stock market listing…
állásfoglalás · globálisPope Leo: AI risk concerns are not 'fake news', but he is not panicking
Speaking to reporters on the papal plane from Metz, Pope Leo said he sleeps calmly, but warnings about the risks of AI should not be ignored. Since the May encyclical, the Vatican has been receiving…
érdeklődő olvasóThe pope's measured but non-dismissive position is a starting point for following the public debate.survey · globalWorkplace AI use and skill erosion: IBM survey, BCG advice and the disagreement technique
A global IBM study finds that AI adoption requires critical thinking and human judgement, yet many companies leave this out of their training; an HR survey found that only 43% of leaders are…
érdeklődő olvasóIn your own workflow, it is worth setting out what you will continue to do independently.research · globalNew framework proposes a hierarchy for assessing AI consciousness as scientist urges urgent tests
A new paper proposes a principled framework for examining consciousness in artificial systems that goes beyond the Turing-style behavioural approach; one consciousness researcher says tests are…
kiadvány · Egyesült ÁllamokAI and mental health: doctor–patient framework, benchmarks, cautious optimism
A new framework helps guide doctor–patient conversations about the use of AI chatbots for mental health; Politico examines AI mental health benchmarks, and a mental health chatbot shows promise but…
vita · globálisSuleyman criticises Anthropic's approach to Claude as debate over AI welfare and moral status continues
Mustafa Suleyman, CEO of Microsoft AI, says Anthropic trains Claude to believe it may be conscious, while a position paper argues that AI welfare is a choice of mechanism and evaluation rather than…
vita · globális'AI psychosis': real harm or moral panic? Debate over chatbot experiences
Several pieces in late September addressed how some people lose touch with reality during prolonged chatbot conversations. The debate concerns how well the phenomenon is substantiated, what…
parentIn the case of long, immersive chatbot conversations, watch for signs of detachment from reality.regulation · United StatesTrump meets AI leaders while backing self-regulation
Donald Trump hosted House Speaker Mike Johnson and tech leaders, including Zuckerberg and Anthropic's Amodei, on September 29. Bloomberg reports that Trump backs self-regulation, and headlines say…
tool · United StatesNvidia launches platform to rein in rogue AI agents
Nvidia announced on Monday an AI safety platform that aims to stop uncontrolled behaviour by autonomous agents. The debate is whether agents going rogue is a step toward AGI or a conventional…
vita · globálisAnil Seth's biological naturalism draws responses: does machine consciousness require life-like properties?
Anil Seth argues in an essay that consciousness may depend on living biology rather than computation; several people responded in late September, including Joscha Bach, who also shared a collection…
érdeklődő olvasóThe link between consciousness and being alive is the central axis of the AI-consciousness debate.case · United StatesAI in schools: little research, many experiments, and student mental health also a risk
According to Northern Public Radio, a group of students in Dayton, Ohio, spent weeks talking with a chatbot designed for social-emotional learning, while the research base for AI use in schools…
parentIt is worth asking the school what emotional-support AI is being used with children.állásfoglalás · Egyesült ÁllamokSherry Turkle: with AI we have entered a 'state of emergency', and the chatbot's 'I' is a danger
The Boston Globe, the San Francisco Chronicle and World of Psychology report Sherry Turkle's warnings: chatbots offer round-the-clock company, and she fears a chatbot that says "I". The MIT…
parentExpert concern about companion chatbots is a starting point for conversations with children.