Alibaba’s new FIPO algorithm doubles the depth of AI inference

Machine Learning


TL;DR

  • New algorithm: Alibaba’s Qwen team unveiled FIPO, a reinforcement learning algorithm that weights each token by its downstream impact, rather than distributing rewards equally.
  • Improved performance: FIPO more than doubles the inference chain length and improves AIME 2024 accuracy from 50% to 56%, comparable to OpenAI’s o1-mini.
  • Our commitment to open source: The Qwen research team plans to release the entire FIPO training system built on the verl framework as open source.
  • Internal tension: This open source research release stands in contrast to Alibaba’s product division, which recently shut down Qwen3.5-Omni and moved away from its open source tradition.
  • Limitations: This evaluation only covers mathematical inference on one dataset, and it remains untested whether the gains extend to code or other domains.

Alibaba’s Qwen research team announced FIPO, a reinforcement learning algorithm that tackles stubborn upper bounds in AI inference. Standard training rewards all tokens equally and gives logical turning points the same weight as commas. FIPO breaks through this barrier by assigning each token a reward proportional to its downstream impact, more than doubling the length of the inference chain in mathematical benchmarks.

FIPO addresses key limitations of current RL training for inference models. Standard approaches such as Group Relative Policy Optimization (GRPO) allocate a uniform reward across a sequence of tokens. The researchers argue that this blatant credit assignment causes the inference chain to grow to a certain length and then plateau, imposing a performance ceiling that prevents the model from developing deeper problem-solving strategies.

On the AIME 2024 math benchmark, FIPO’s accuracy improved from 50% to 56%, reaching a maximum of 58%. According to the FIPO paper, Chiyu Ma et al. The Qwen team said it will open source the entire training system.

The combination of improved performance and full transparency positions FIPO as a potential accelerator for the open source AI community. Many of the competing RL advances in inference are still locked in their own walls, leaving independent researchers with no choice but to reverse engineer the technology from published papers rather than directly building working code.

How FIPO works

Rather than uniformly distributing a single reward signal, FIPO uses future-KL divergence to change the weighting of tokens across all positions following a certain point. Tokens that start productive inference chains receive more rewards, while tokens that lead the model to a dead end are penalized. Dense token-level advantage signals distinguish important inference steps from routine fillers.

“We argue that this coarse-grained credit allocation fails to distinguish between important logical pivots and trivial tokens, imposing a performance ceiling.”

Chiyu Ma et al., Alibaba Qwen research team (via arXiv)

An important design choice is that FIPO accomplishes this without using a separate value model. Proximity policy optimization (PPO) techniques require an auxiliary value network pre-trained on long thought chain data, which introduces external knowledge and makes it difficult to distinguish whether performance gains are due to the algorithm or pre-trained helpers. Because its value model incorporates synthetic inference data, external information seeps into the training loop, making results difficult to interpret and reproduce.