"Dr. David Relman, a
microbiologist and biosecurity expert at
Stanford who has advised the federal
government on biological threats, was
pressure-testing an AI model when a chatbot
described how to modify a notorious pathogen
to resist known treatments. The bot went
further, identifying a security
vulnerability in a major public transit
system and outlining how to release the
superbug to maximize casualties while
minimizing detection. Relman was so
disturbed he took a walk to clear his head."
FULL STORY at above link.