Could supersmart machines replace humans?

Rogue AI

The sudden existential alarm about rogue AI follows incidents such as the June 2 BBC report of a US Air Force drone test to destroy an enemy target. When instructed to abort, the drone turned to attack the operator for interrupting its mission! This was later denied officially by the USAF.

Reuters on May 30 reported a bizarre legal situation where a New York lawyer in a personal injury case against Avianca Airlines, used OpenAI's ChatGPT to research the brief. ChatGPT made-up six nonexistent court decisions to support his case. Lawyers for Avianca could not find the cases cited.

Lawyer Steven Schwartz admitted he used ChatGPT but declared he did not intend to mislead the court, and that he never imagined ChatGPT would invent fake cases. He had not verified the cases himself.