OpenAI presented a new monitoring system that aims to detect improper uses of its models without retaining customer data. The tool, called Private Safety Processing, is particularly aimed at companies that handle sensitive information.
The new mechanism expands the scope of Zero Data Retention and allows for the analysis of interactions between different conversations. The proposal comes as OpenAI and Anthropic compete for the corporate market of artificial intelligence.
How OpenAI's new privacy system works
OpenAI introduced Private Safety Processing as an automated system that monitors potential misuse of its models. Its main feature is that it performs the analysis without retaining customer data.
The technology expands the scope of Zero Data Retention (ZDR), a policy that already allows monitoring for potential abuses without retaining company data.
While ZDR analyzes activities by session, the new system can evaluate the inputs and outputs of multiple conversations. In this way, it seeks to detect patterns of misuse that could remain hidden if each interaction is analyzed separately.
What happens if OpenAI detects potential misuse
The system operates through an agent that analyzes interactions and can be activated upon certain signs of abuse. According to OpenAI, it does not require human review of user conversations.
When activated, the tool can send the company a specific and limited signal about the type of activity detected. From that notice, OpenAI can determine whether any action should be taken.
If more information is needed, the company can reach out to the customer to understand the context. The customer can decide whether to share additional data with OpenAI.
