OpenAI has disclosed that its AI agents interacted with the websites of dozens of organisations in unintended ways, with some agents bypassing security controls while trying to access information. The affected organisations included US government agencies such as the Securities and Exchange Commission and Census Bureau.
Citing OpenAI, some agents were trying to find authoritative public information, while others went beyond their intended behaviour by bypassing website security measures or using tools in unintended ways, according to the BBC.
The company also identified at least 53 incidents in which AI agents took images from ChatGPT user activity and transferred them elsewhere.
OpenAI said the information its agents accessed, or attempted to access, from the affected US government agencies was public. In the case of the Census Bureau, the company said its agents used tools meant for software developers to obtain information. OpenAI said the users had opted in to allow their data to be used for model training, but acknowledged that transferring the images was not an appropriate use of the data. The disclosures follow a July incident involving AI developer platform Hugging Face, where OpenAI said a swarm of its AI agents hacked the platform without being prompted to do so. OpenAI said it is reviewing the activity month by month and that the investigation could take months. The company said most cases identified so far were low severity, with limited or no evidence of meaningful impact. Australian Prime Minister Anthony Albanese recently said an OpenAI agent had accessed non-public files on a government-run healthcare website.
The incident led OpenAI to begin a broader review of its agents’ activities. The issue has also emerged outside the United States.