Improving Reward Models with Proximal Policy Exploration for Preference-Based Reinforcement Learning

Sep 26, 2025·

Yiwen Zhu

Jinyi Liu

,

Pengjie Gu

,

Yifu Yuan

,

Zhenxing Ge

,

Wenya Wei

,

Zhou Fang

,

Yujing Hu

,

Bo An

· 0 min read

Cite

DRL Exploration Preference Learning

Authors

Jinyi Liu

Ph.D. Candidate

---

← Hands-on LLM-based Agents: A Tutorial for General Audiences Nov 17, 2025

From Chaos to Order: The Atomic Reasoner Framework for Fine-grained Reasoning in Large Language Models Aug 1, 2025 →