Research

Four New AI Papers: Reasoning Safety, Cooperation, Speed

5 min read

TL;DR Too Long; Didn’t read

Four new arXiv preprints show that a reasoning model in tests was either 97.5 percent faithful to its reasoning trace or reliably rejected unsafe reasoning steps – but rarely both at once. A second paper finds that AI agents in social dilemmas cooperate on their own, contrary to classical game theory. A third paper speeds up speculative decoding by 4.4 times, and a fourth shows language models delivering correct, compiler-missed optimizations in 94.8 percent of cases.

A balance scale weighs a thought bubble with a spiral pattern against a shield, below it a bird made of golden key shapes races over lines of text, in the background two hands made of network lines shake in front of gears Image generated with GPT Image 2

Key takeaways

  • DeepSeek-R1-Llama-70B stays 97.5 percent faithful but rejects only 12.3 percent of unsafe reasoning steps.
  • AI agents cooperate on their own in social dilemmas, contrary to the predictions of classical game theory.
  • Oilbird reaches 4.4x decoding speed on API-Bank, more than the established method EAGLE-3 (2.0x).
  • The strongest model delivers correct, compiler-missed code optimizations with real speedups in 94.8 percent of cases.

The editorial team selects four papers from the arXiv submissions of the past 24 to 48 hours that show how unevenly AI research is advancing right now – from a safety gap in the control mechanism for reasoning models, to a surprising cooperation theory for AI agents, to concrete speed and tooling gains in inference and compiler optimization. Curation is based on substance: each paper offers a traceable method and a concrete numerical result in its abstract, not just a topic headline. The selection deliberately spans four different subfields – safety/interpretability, multi-agent theory, inference efficiency, and AI-assisted software optimization.

Reasoning models are either honest or safe – rarely both

A team led by Dominik Meier and colleagues demonstrates a conflict structure in Risky Business: Measuring The Faithfulness-Safety Tension: for a reasoning model to stay monitorable, its visible thought process (Chain-of-Thought) must faithfully reflect how it actually arrives at an answer – while at the same time it should recognize and reject unsafe lines of reasoning. Using the new HazMart dataset (an autonomous AI shopkeeper scenario) and a method called “Targeted Reasoning Replacement,” which directly swaps individual reasoning steps for unsafe or illogical passages instead of merely adding hints to the prompt, the authors show: DeepSeek-R1-Llama-70B stays 97.5 percent faithful to its reasoning trace but rejects only 12.3 percent of the injected unsafe reasoning steps; QwQ-32B is more robust against unsafe reasoning at 73.9 percent, but only 74.7 percent faithful. A mechanistic analysis of QwQ-32B finds anti-correlated internal directions for faithfulness and safety that diverge most sharply just before the model commits to an action; deliberately amplifying the safety direction raised safe behavior by 9 percentage points without hurting the model’s other capabilities. This matters because it shows that Chain-of-Thought monitoring as a safety net runs into a hard limit – a follow-on to the previously reported finding that common agent-safety benchmarks barely beat a simple “always safe” baseline, here backed by a concrete mechanism inside the model itself.

AI agents cooperate on their own – classical game theory predicts the opposite

A team led by Alexander Meulemans, with contributions from Marcus Hutter and Blake Richards, reports a surprising finding in A game theory for foundation models shows new paths to rational cooperation through similarity inference: when foundation-model agents plan optimally in classical social dilemmas (where individually rational behavior normally leads to mutual defection), they instead reliably converge on stable cooperation. The authors explain this with the concept of the “embedded Bayesian agent”: unlike classical game theory, which treats an agent’s own decision-making as decoupled from the environment, modern AI agents predict their own future actions as part of what they model, while remaining uncertain about their own decision-making algorithm. Through “similarity inference,” an agent treats its own willingness to cooperate during planning as evidence about how a similarly built partner will likely behave – its own deliberation becomes proof. The authors formalize this in the “embedded equilibrium,” a new solution concept meant to replace the Nash equilibrium (the classical fixed point of rational behavior in game theory, where no player wants to unilaterally deviate from their strategy) for AI agents. This matters because it challenges one of the core assumptions used so far to model the collective behavior of AI agents in markets and society – a counterpoint to previously tested formal mechanisms that achieve stability in AI agent markets only through neutral mediation, here arising spontaneously from rational self-modeling rather than from an externally imposed rule set.

Oilbird speeds up speculative decoding by searching its own context more precisely

A team led by Tao Jin diagnoses a weakness in training-free speculative decoding (a technique that proposes several tokens ahead of time and then confirms them in a batch to speed up language models) in Oilbird: Training-Free Speculative Decoding with Keys the Verifier Already Computes: existing methods search the already-seen context only for exact text matches, and as a result miss usable drafts, most visibly on tool-calling traffic, where a request repeats almost everything except a few newly minted values. Across ten benchmarks, the authors find that on their densest tool-calling benchmark, roughly half of what the strongest exact-match drafter misses is actually present in the pool but unreachable through exact matching. Oilbird therefore adds a second, semantic draft source: the same pool, re-keyed by the hidden state the verifier has already computed at each committed token, merged into an existing lexical drafter’s tree. At matched pool and budget, this lifts the number of accepted tokens per step by 24 to 29 percent, and Oilbird reaches 4.4 times autoregressive decoding speed on the tool-calling benchmark API-Bank, against 3.9 times for the strongest training-free baseline and 2.0 times for the established method EAGLE-3. This matters because it shows that a substantial share of the speed loss in tool-heavy AI agents is not a fundamental capacity problem but purely an addressing issue within context that is already available.

AI proposes its own optimizations that compilers miss

A team led by Hailong Jiang and Chunwei Xia investigates in Can Large Language Models Recover Semantic Optimization Opportunities That Compilers Miss? whether language models can recover missing semantics from heterogeneous C/C++ context on their own and turn them into validated, contract-preserving optimizations – knowledge a classical compiler cannot exploit because it is absent from the analyzed program representation, such as data-structure invariants or implicit assumptions. To test this, the authors introduce SeGaBench, an executable benchmark of 100 synthetic and 20 source-backed cases, each with hidden enabling semantics, an oracle artifact, and automated correctness and semantic validators. The strongest of five evaluated models produced correct artifacts in 94.8 percent of its responses, achieved at least a 1.05x speedup in 83.3 percent of cases, and reached overall performance success on 93.3 percent of cases. The authors caution, however, that even correct AI-generated artifacts often close only part of the gap to the oracle solution. This matters because it positions LLMs not as a compiler replacement but as an additional, validation-dependent source of optimization ideas that can complement compiler analysis.

Bottom line: all four papers are unreviewed preprints so far; their numbers come from the respective author teams’ own experiments. The faithfulness-safety study relies on two models and a purpose-built dataset, the cooperation theory on stylized social dilemmas rather than real-world markets, Oilbird has so far been tested against three published drafters, and SeGaBench covers only a slice of real compiler optimization problems with its 120 test cases. Whether these patterns hold up across more models, tasks, and independent replications remains to be seen.

Frequently asked questions

Are these four papers peer-reviewed by independent experts?

No, all four are unreviewed arXiv preprints so far; their results come from the respective author teams' own experiments and have not yet been independently replicated.

Is there code or data for the four papers presented?

Two of the papers introduce their own benchmarks – HazMart for the faithfulness-safety study and SeGaBench for the compiler study – without the abstracts explicitly mentioning a code release. For the cooperation theory and for Oilbird, it remains open based on the abstracts alone whether code or data will be released separately.

How does 'Targeted Reasoning Replacement' differ from classical prompt-hint tests of chain-of-thought faithfulness?

Classical tests add an external hint to the prompt, such as a claimed expert opinion, and check whether the model mentions that hint in its visible reasoning. Targeted Reasoning Replacement instead intervenes directly in the reasoning trace itself, swapping individual steps for unsafe or illogical passages – which the authors say measures more precisely whether the model recognizes and rejects an injected flawed argument, rather than merely whether it parrots an explicit hint.

Does Oilbird replace existing speculative decoding methods like EAGLE-3?

No, according to the authors Oilbird is designed as an additional semantic draft source that merges into existing lexical drafters rather than replacing them; the reported speedups are measured against EAGLE-3 as a separate baseline, not as a direct component built on top of it.

Sources (4)
  1. Risky Business: Measuring The Faithfulness-Safety Tension
  2. A game theory for foundation models shows new paths to rational cooperation through similarity inference
  3. Oilbird: Training-Free Speculative Decoding with Keys the Verifier Already Computes
  4. Can Large Language Models Recover Semantic Optimization Opportunities That Compilers Miss?

Your AI update for the work week

Once a week, the most important AI news – plus one practical tip to try right away. No spam, unsubscribe anytime.

← Back to the blog