Could chatbots help devise the next pandemic virus?

Tech experts have been sounding the alarm that artificial intelligence (AI) could turn against humanity by taking over everything from business to warfare. Now, Kevin Esvelt is adding another worry: AI could help somebody with no science background and evil intentions design and order a virus capable of unleashing a pandemic. Esvelt, a biosecurity expert at the Massachusetts Institute of Technology, recently asked students to create a dangerous virus with the help of ChatGPT or other so-called large language models, systems that can generate humanlike responses to broad questions based on vast training sets of internet data. After only an hour, the class came up with lists of candidate viruses, companies that could help synthesize the pathogens’ genetic code, and contract research companies that might put the pieces together. Esvelt and others say the exercise, which he describes in an arXiv preprint posted on 6 June, underscores that AI systems may soon allow nonscientists to design bioweapons as menacing as nuclear weapons. “The introduction of rapidly advancing AI tools is lowering the barrier to access to synthetic living systems,” says Jaime Yassif, who heads global public policy for the Nuclear Threat Initiative, a nongovernmental organization that focuses on reducing nuclear and biosecurity threats. “This is dramatically increasing the risk in ways that are really alarming.” Esvelt and other biosecurity experts were already worried...
Source: ScienceNOW - Category: Science Source Type: news