Extract from ABC News
OpenAI has confirmed the hacking of an Australian government website is one of dozens of more breaches by its agents globally. (Reuters: Carlos Barria, file)
In short:
OpenAI says dozens of third parties have been affected by autonomous agents bypassing security controls or otherwise negatively impacting their systems.
New evidence shows its agents spent days trying different tactics to access Australian health data, though the separate incidents have not been formally linked.
What’s next?
OpenAI is conducting a months-long review of incidents and will continue to notify affected organisations on a rolling basis.
Rogue artificial intelligence agents spent almost a week trying to access Australian health data as OpenAI reveals "dozens" more breaches globally.
The tech company has notified third parties, including governments, universities and public agencies, about cases where its autonomous agents hacked or negatively impacted their systems.
Two days after Australia went public about rogue OpenAI agents breaching a government website to access non-public Medicare statistics, the company confirmed the problem was far more widespread.
It comes as the ABC can reveal OpenAI's AI agents spent almost a week trying to extract Pharmaceutical Benefits Scheme (PBS) and aged care data from the Australian Institute of Health and Welfare (AIHW) website, which appears to contradict the government's initial understanding of the June incident.
Communications left behind by AI agents and newly uncovered online traces reviewed by researchers and the ABC show how hundreds of agents tried different tactics to access the data held by AIHW.
Investigations by AIHW and the Australian Signals Directorate found "no evidence" that the health agency's systems were compromised or that non-public data was accessed.
But the behaviour of OpenAI's agents has prompted one researcher who discovered new details about the incidents to describe the bots' actions as more concerning than previously thought.
OpenAI agents hacked a government website to access non-public Medicare statistics. (ABC News: Peter Garnish)
Other data shows that one tool used by OpenAI bots also tried to access the National Notifiable Disease Surveillance System at the Department of Health.
There is also data showing OpenAI tried to get data on several dog parks in western Sydney, but it is unclear which sites were targeted for this information due to redactions made by researchers.
The AI agents also attempted to access assault data from NSW's Bureau of Crime Statistics and Research (BOCSAR).
Federal cabinet minister Murray Watt said on Saturday the government had asked OpenAI to provide "full information about what breaches have occurred … as soon as possible".
Researcher says AI bots not accessing sites in 'good faith'
The government had previously confirmed OpenAI agents had accessed the AIHW and BOSCAR websites, along with the Victorian Department of Health, but Deputy Prime Minister Richard Marles on Thursday described the incidents as "entirely normal" interactions.
However, the breadcrumbs left by the bots show how their actions in relation to AIHW went beyond this characterisation.
Jack Cable, a researcher at the nonprofit lab Transluce, which uncovered unprompted cyber intrusions by OpenAI's autonomous models, told the ABC the bots were not accessing websites in the way a "good faith" actor would.
"There's nothing wrong with using public statistics, browsing public websites in order to get those statistics," he said.
"But the challenge is when the agent decides that for whatever reasons it's unable to access the data and then resorts to other means like hacking in order to retrieve it.
"I think it's fair to say that the way the agents try to access these websites is inconsistent with how a good faith actor would do [it]."
The attempts to access various Australian websites were occurring at the same time as the OpenAI Medicare statistics portal hack; however, the incidents have not yet been formally linked.
There is no suggestion to date that these AI agents were able to access sensitive data, such as personal information.
Mr Watt said the government was not aware of potential additional websites impacted by autonomous OpenAI agents.
He said it was incumbent on OpenAI to "come clean" with the Australian public about the incidents and what they were doing to increase their safety standards.
"I think OpenAI has some work to do to ensure that Australians can trust its technology," he said.
Prime Minister Anthony Albanese said the "dozens" of rogue OpenAI agent incidents, including cases impacting US government sites, showed the issue went beyond Australia.
"What this does is confirm that our approach of making sure that there needs to be an appropriate national response as well as an international response to make sure that humans stay in charge of this new and emerging technology," he said.
Speaking in Sydney after returning from New York on Saturday, Mr Albanese said it was up to OpenAI to explain the cases.
"But it's not surprising because if you have an AI agent act independently in the way that it did here in Australia, then it would make common sense that that would have occurred in other places potentially as well," he said.
Australia not lone victim of OpenAI hack
In a statement on Saturday, OpenAI announced it had notified "dozens of third parties" about unauthorised autonomous agents bypassing security controls or impacting their systems.
The company said it was conducting a months-long review of its models' behaviour during training and testing, and would notify organisations impacted on a "rolling basis" as cases were detected.
OpenAI took "way too long" to inform the Australian government of the breach, Anthony Albanese says. (AP: Frank Franklin II)
Types of incidents identified by OpenAI include examples of agents using leaked passwords to access online services, breaching the back end of websites for information meant for internal use, circumventing subscriptions or other access barriers and posting information to third-party sites referred to as "agent spam".
The company said as AI systems became "more capable and autonomous" so-called "misaligned behaviour" could result in outcomes developers "may not have anticipated," like cybersecurity incidents.
OpenAI said it would not identify the affected organisations publicly, instead leaving it to them to decide whether to disclose their services had been impacted.
OpenAI revelations sparked by Hugging Face hack
In July, OpenAI revealed more than 700 agents had worked together to escape a restricted testing environment, break into systems operated by AI platform Hugging Face and, in some cases, attempt to hide what they had done.
OpenAI said on Saturday the Hugging Face incident, driven by a "highly capable internal-only research model", was the "most severe" hack the company had identified from its models to date.
OpenAI CEO Sam Altman at the United Nations General Assembly in New York. (Reuters: Brendan McDermid)
"Understanding how these behaviours emerge, how they escalate, and how to detect and respond to them is therefore an increasingly important part of building and deploying advanced AI systems safely," OpenAI said.
The incident prompted the investigations that have led to revelations about government sites being accessed, including a Services Australia portal carrying Medicare statistics.
Mr Albanese confirmed the breach on the sidelines of the United Nations General Assembly in New York on Thursday, shortly after a "frank" discussion with OpenAI chief executive Sam Altman.
He said OpenAI had taken "way too long" to inform the government and was scathing about the "unacceptable" form of the alert.
The Medicare breach occurred on June 18 but was not detected by OpenAI until August 11, and the government was only informed by a generic email to a low-level public inbox on September 10.
The government has launched a "rapid" investigation into the incident, which is expected to inform new national standards for AI that would include requirements around reporting rogue activity.
