Warnings from AI researchers and company leaders that increasingly autonomous systems could threaten humanity have intensified in the United States and internationally, though experts remain divided over the likelihood and mechanism of human extinction. Former Anthropic and OpenAI researcher Jacob Coxon said on Sept. 9 that developers were “racing straight to self-improving superintelligence,” while Anthropic researcher Evan Hubinger put the chance of extinction within a decade at more than 10% [independentaustralia.net][vesti.bg]. Anthropic CEO Dario Amodei and OpenAI CEO Sam Altman have separately called for slower development so that safety testing and safeguards can keep pace [technologyreview.com][vnexpress.net]. Other researchers and science writers say the more immediate risks are less speculative: misuse in cyberattacks, fraud, manipulation, autonomous weapons and biological threats. Wired reported that scientists consider AI-enabled bioweapons an unlikely route to human extinction, while noting that AI could lower barriers to harmful activity [wired.com]. A September Politico poll found that about two-thirds of Americans saw at least a moderate chance that advanced AI could destroy humanity, while a CBS News poll found that Americans generally favor slowing development and imposing government restrictions rather than stopping AI research altogether [futurism.com][cbsnews.com]. Highlights: • Public anxiety: The Politico poll found that 17% of Americans were almost certain AI could wipe out humanity [futurism.com]. • Poll divide: Seventy percent of respondents who voted for Kamala Harris in 2024 viewed AI as a moderate or higher existential risk, compared with 60% of Trump voters [futurism.com]. • Cybersecurity baseline: EFF said lawmakers should ground AI rules in established cybersecurity practices and close gaps in existing law rather than regulate only named models [eff.org]. Perspectives: Anthropic governance proposal: Dario Amodei’s call to slow frontier AI development also proposed giving third-party evaluators access comparable to that of company employees to oversee training and safety processes [storm.mg]. (Storm Media) AI-risk skeptics: Journalist Olivier Tesquet argued that extinction messaging can serve AI companies’ economic interests by attracting investment and reinforcing dominant firms, and warned against overly restrictive regulation [rts.ch]. (RTS) U.S. public: CBS polling found that Americans generally do not want to halt AI development because they see strategic, medical and scientific benefits, even while worrying that models or users could harm people [cbsnews.com]. (CBS News) Electronic Frontier Foundation: EFF said post-incident reports showed that longstanding cybersecurity practices could have prevented or substantially mitigated the Hugging Face incident, without requiring futuristic controls [eff.org]. (Electronic Frontier Foundation) "They are racing straight toward self-improving superintelligence and gambling with our lives." — Jacob Coxon Sources: • Will A.I. Kill Us? Can It Hack My Bank Account? Your A.I. Questions Answered - nytimes.com • It may be too late to save humanity from AI, mathematicians warn - reddit.com • The Majority of Americans Are Now Terrified of AI - futurism.com • Why AI Isn’t Likely to Wipe Out Humanity With Bioweapons - wired.com • Could AI really kill us all? Your questions, answered. - technologyreview.com • AI could ‘kill all humans’: How safe are Nigerians? - vanguardngr.com • Na de vele incidenten die aan het licht kwamen: zijn we de controle over AI kwijt? - gva.be • Čoho sa naozaj báť pri AI? Vyhubenie ľudstva je nepravdepodobné, iné bezpečnostné riziká sú skutočné, hovoria experti - dennikn.sk • AI가 인류를 위협할 수 있다는 우려, 근거는 무엇이고 얼마나 현실적일까? - bbc.com • La IA probablemente acabe con un mundo, pero no con la humanidad - lasillavacia.com • هل يمكن للذكاء الاصطناعي أن يقضي على البشرية؟ - aawsat.com • Your questions about the AI apocalypse, answered - vox.com • The AI thread - mudspike.com • Všichni tu kvůli umělé inteligenci umřeme. Šance na konec lidstva kvůli AI není malá - lidovky.cz • D'autres fins du monde sont possibles - heidi.news • Наистина ли изкуственият интелект ще убие всички ни? И как точно? - vesti.bg • Fra hackerangreb til dommedagsadvarsler: Forstå balladen om AI her - borsen.dk • Pacing the AI Frontier: the risk of artificial unintelligence - computerweekly.com • Scots AI author on why the people building artificial intelligence think it could kill us - dailyrecord.co.uk • Heres What the AI Apocalypse Could Look Like - indiavision.com • ¿El peligro somos los humanos? La verdadera amenaza de la IA y su exponencial crecimiento - tvazteca.com • Could AI Become a Threat to Humanity? ChatGPT and Claude Answer Shahzeb Khanzada’s Questions - urdupoint.com • Jak může umělá inteligence zničit lidstvo? Experti nastínili pět scénářů - denik.cz • AI-topmannen voorspellen doem. Is AI echt een existentieel gevaar? - nrc.nl • The Download: AI’s extinction risk and bioweapons threat - technologyreview.com • Künstliche Intelligenz: „Geh, opfere dich – wenn du den endgültigen Tod annimmst“: Protokoll des KI-Angriffs, der die Welt verschreckt - handelsblatt.com • Most Brits think AI could destroy civilisation - reddit.com • L’IA va-t-elle « détruire l’humanité » ? La mise en garde du chercheur pionnier Yoshua Bengio, pour qui « on perd le contrôle » - leparisien.fr • Will AI harm humans? CBS News poll finds Americans want to slow development but not stop it - cbsnews.com • Amodei, Anthropic’s Leader, Exposed A.I.’s Dangers. It’s Time to Act. - nytimes.com • Stopgap Measures to Address Immediate AI Security Threats - lesswrong.com • If Tech Leaders Think A.I. Will Kill Us, Why Build It? - nytimes.com • Hedging the AI doomsday risk - interest.co.nz • The specter of AI-enabled bioweapons is a wake-up call for biotech - technologyreview.com • Löscht KI uns alle aus? Wir haben 12 Persönlichkeiten befragt, die es wissen sollten - bzbasel.ch • « L’IA a le potentiel de nous tuer tous » : le nouvel avertissement glaçant d’un ex-chercheur de Google DeepMind - leparisien.fr • Will die KI wirklich die Weltherrschaft? - wienerzeitung.at • AI giants sound alarm while racing towards superintelligence - independentaustralia.net • Tony Blair urges people to 'trust AI' despite growing fears it'll wipe out humanity - reddit.com • AI Threats, Real and Imagined. Plus, Extremely Real NYPD Misconduct - hellgatenyc.com • Opiniones dividas sobre el uso de la IA, ¿amenaza u oportunidad? - diariolibre.com • Will AI harm humans? Poll finds Americans want to slow development but not stop - cbsnews.com • Milliardenverluste an der Börse: Wie die KI-Sicherheitsdebatte ganze Branchen ins Wanken bringt - fr.de • The Anthropic Incident - greaterkashmir.com • Le risque "d'extinction de l'humanité" sert les intérêts des géants de l'IA, estime Olivier Tesquet - rts.ch • Trying to Picture Doomsday? 1983’s ‘WarGames’ Already Showed Us One Way AI Could End the World - indiewire.com • Pregunté a la IA si iba a aniquilarnos. La respuesta no me tranquilizó del todo - elpais.com • Giới công nghệ 'chia phe' vì AI nổi loạn - vnexpress.net • 'AI가 만드는 AI'...속도조절론 핵심엔 '재귀적 자기개선'에 대한 공포 - jtbc.co.kr • ¿Hay un 10% de probabilidad de que la IA nos mate a todos? - elpais.com • The A.I. Industry’s New Worry: ‘Liability Exposure’ - nytimes.com • As the world panics over "out of control" AI Trump rides to the rescue - newsbiscuit.com • Esej Petra Koubského: Poprvé se začínám bát. Umělé inteligence ne, společenské reakce na ni ano - denikn.cz • Az AI úgy ráijesztett az emberiségre, hogy egyre több fejlesztő ébred öntudatra, mielőtt a gépek is ezt teszik - hvg.hu • Cinco maneras de imaginar el apocalipsis algorítmico - lanacion.com.ar • Prijeti scenarij iz Terminatora? Znanstvenici poslali upozorenje: 'Mogla bi ubiti sve ljude' - net.hr • Technology won’t solve our problems if we don’t know what to ask - thepress.co.nz • AI companies worry about the tech harming humans in the future. But it may damage the US economy even sooner - reddit.com • A Swarm of AI Agents Could ‘Take Over the Internet’ Within 6 Months, Scientists Say - popularmechanics.com • La IA fuera de control: por qué debemos actuar ahora - lanacion.com.ar • Frédéric Taddeï : "Mais pourquoi l’IA voudrait-elle nous tuer ?" - marianne.net • Theoloog Esselink: techbedrijven verpakken AI als verlossing, en dat voedt de eindtijdangst - nd.nl • Is AI More The Mask Than The Monster? - stluciachronicle.com • Is Trump’s AI obsession walking the world into disaster? – podcast - theguardian.com • 阿將伊崮喜瀾觀點:算法鐵幕Ⅲ—AI最後的防火牆可能不是人類寫下的規則 - storm.mg • Die KI ist kein Monster – erst der Mensch macht die Maschine gefährlich [premium] - diepresse.com • EFF to Lawmakers: Ground AI Cybersecurity Rules in Best Practices - eff.org • Is the nuclear non-proliferation pact a model for regulating runaway AI? - newspaceeconomy.ca • Is Trump’s AI obsession walking the world into disaster? | Politics Weekly America - theguardian.com • Kommer tekniken på riktigt utrota oss inom tio år? - etc.se --- 📰 Story aggregated by Kagi News
Comments