OpenAI will incorporate into its model Astra a reasoning technique called “recurrent depth”. The method allows processing a query multiple times in a loop, rather than following a linear sequence.
According to The Information, the technique is also known as “opaque recurrence” and could make it more difficult to monitor the thought process of the models. AI security experts expressed concern about its potential effects.
What is Astra's new reasoning technique
Reasoning models typically generate a thought chain with the steps they follow when trying to solve a problem. Although that representation is not perfect, it can serve as a tool to detect problematic or misaligned behaviors.
In the case of opaque recurrence, the model addresses the same query multiple times through a looping process. This leaves fewer readable traces and can complicate conventional tracking of its reasoning.
Experts' concerns are related to the possibility that this technique reduces monitoring of the thought chain, especially if its use increases in future models.
Security experts questioned the use of opaque recurrence
Buck Shlegeris, CEO of Redwood, said he is “extremely concerned” about reports of the use of opaque recurrence in Astra. He suggested that more intensive application could significantly reduce the ability to monitor thought chains.
AI security specialist Zvi Mowshowitz also questioned the technique. He warned about the risk of competition among labs that could lead to an increasing use of these methods.
Mowshowitz stated that more intensive use of these techniques would likely harm monitoring of reasoning.
.
