Publications

Yiwen Zhu, Jinyi Liu, Pengjie Gu, Yifu Yuan, Zhenxing Ge, Wenya Wei, Zhou Fang, Yujing Hu, Bo An (2025). Improving Reward Models with Proximal Policy Exploration for Preference-Based Reinforcement Learning. NeurIPS 2025.

Jinyi Liu, Yan Zheng, Rong Cheng, Qiyu Wu, Wei Guo, Fei Ni, Hebin Liang, Yifu Yuan, Hangyu Mao, Fuzheng Zhang, Others (2025). From Chaos to Order: The Atomic Reasoner Framework for Fine-grained Reasoning in Large Language Models. SCALR@COLM 2025.

Jing Liang, Hongyao Tang, Yi Ma, Jinyi Liu, Yan Zheng, Shuyue Hu, Lei Bai, Jianye Hao (2025). Squeeze the Soaked Sponge: Efficient Off-policy Reinforcement Finetuning for Large Language Model. arXiv preprint arXiv:2507.06892.

Qian Zhang, Yan Zheng, Jinyi Liu, Hebin Liang, Lanjun Wang, Jianye Hao (2025). Unlocking Multi-Agent Debate Potential: Enhancing Effective Scaling through Role Allocation Strategies. ICML 2025 Workshop on Multi-Agent Systems in the Era of Foundation Models: Opportunities, Challenges and Futures.

Yibin Chen, Jinyi Liu, Yan Zheng, Yifu Yuan, Jianye Hao (2025). War of Thoughts: Competition Stimulates Stronger Reasoning in Large Language Models. Findings of the Association for Computational Linguistics: ACL 2025.

Rong Cheng, Jinyi Liu, Yan Zheng, Fei Ni, Jiazhen Du, Hangyu Mao, Fuzheng Zhang, Bo Wang, Jianye Hao (2025). DualRAG: A Dual-Process Approach to Integrate Reasoning and Retrieval for Multi-Hop Question Answering. Proceedings of the Association for Computational Linguistics: ACL 2025.

Yifu Yuan, Haiqin Cui, Yibin Chen, Zibin Dong, Fei Ni, Longxin Kou, Jinyi Liu, Pengyi Li, Yan Zheng, Jianye Hao (2025). From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation. arXiv preprint arXiv:2505.08548.

Yibin Chen, Yifu Yuan, Zeyu Zhang, Yan Zheng, Jinyi Liu, Fei Ni, Jianye Hao, Hangyu Mao, Fuzheng Zhang (2025). SheetAgent: towards a generalist agent for spreadsheet reasoning and manipulation via large language models. Proceedings of the ACM on Web Conference 2025.

Yihang Xiao, Jinyi Liu, Yan Zheng, Xiaohan Xie, Jianye Hao, Mingzhi Li, Ruitao Wang, Fei Ni, Yuxiao Li, Jintian Luo, Others (2024). Cellagent: An llm-driven multi-agent framework for automated single-cell data analysis. BioRxiv.

Yiwen Zhu, Jinyi Liu, Yifu Yuan, Wenya Wei, Zhenxing Ge, Zhou Fang, Yujing Hu, Bo An, Others (2024). Optimizing Reward Models with Proximal Policy Exploration in Preference-Based Reinforcement Learning. NeurIPS 2024 Workshop on Behavioral Machine Learning.