Empowering Multi-Turn Tool-Integrated Reasoning with Group Turn Policy Optimization

arXiv — cs.LGThursday, November 20, 2025 at 5:00:00 AM
  • The introduction of Group Turn Policy Optimization (GTPO) marks a significant advancement in training Large Language Models (LLMs) for multi
  • This development is crucial as it enhances the efficiency and effectiveness of LLMs in performing complex reasoning tasks, potentially leading to more sophisticated applications in various fields such as AI
  • The evolution of reinforcement learning techniques, including GTPO, reflects ongoing efforts to optimize LLMs, addressing issues like training stagnation and mode collapse, while also highlighting the importance of fine
— via World Pulse Now AI Editorial System

Was this article worth reading? Share it

Recommended Readings
Teaching According to Students' Aptitude: Personalized Mathematics Tutoring via Persona-, Memory-, and Forgetting-Aware LLMs
PositiveArtificial Intelligence
The paper introduces TASA (Teaching According to Students' Aptitude), a personalized mathematics tutoring framework that utilizes Large Language Models (LLMs) to adapt instruction based on students' evolving knowledge and cognitive retention. TASA integrates a structured student persona and event memory to enhance learning by addressing individual proficiency levels and forgetting patterns, aiming to improve the effectiveness of mathematics education.
A Data-driven ML Approach for Maximizing Performance in LLM-Adapter Serving
PositiveArtificial Intelligence
The study presents a data-driven machine learning approach aimed at optimizing the performance of Large Language Model (LLM) adapters in GPU serving environments. It addresses the challenge of maximizing throughput while preventing request starvation by determining the optimal configuration of concurrent and parallel adapters. The introduction of a Digital Twin for LLM-adapter systems facilitates efficient training data generation, with experiments showing a throughput accuracy within 5.1% of real results.
Mathematical Analysis of Hallucination Dynamics in Large Language Models: Uncertainty Quantification, Advanced Decoding, and Principled Mitigation
NeutralArtificial Intelligence
Large Language Models (LLMs) are advanced linguistic tools that can produce outputs that may sound plausible but are often factually incorrect, a phenomenon known as hallucination. This study introduces a mathematical framework to analyze, quantify, and mitigate these hallucinations. It employs probabilistic modeling and Bayesian uncertainty estimation to develop refined metrics and strategies, including contrastive decoding and retrieval-augmented grounding, aimed at enhancing the reliability of LLMs.
GRPO-RM: Fine-Tuning Representation Models via GRPO-Driven Reinforcement Learning
PositiveArtificial Intelligence
The paper presents Group Relative Policy Optimization for Representation Model (GRPO-RM), a reinforcement learning method aimed at fine-tuning large language models (LLMs). It establishes a predefined output set to replace token sequence sampling, facilitating the generation of an output group essential for GRPO's optimization. A specialized reward function is also introduced to cater to representation models, with extensive experiments validating the method's effectiveness across various real-world datasets.
ReFactX: Scalable Reasoning with Reliable Facts via Constrained Generation
PositiveArtificial Intelligence
The paper presents ReFactX, a scalable method designed to enhance the reliability of Large Language Models (LLMs) by enabling them to access external knowledge without relying on additional models or services. This approach utilizes constrained generation with a prefix-tree index, allowing for efficient retrieval of factual information from a Knowledge Graph. The method aims to address persistent issues of knowledge gaps and hallucinations in LLM outputs.
Investigating Hallucination in Conversations for Low Resource Languages
NeutralArtificial Intelligence
Large Language Models (LLMs) have shown exceptional ability in text generation but often produce factually incorrect statements, known as 'hallucinations'. This study investigates hallucinations in conversational data across three low-resource languages: Hindi, Farsi, and Mandarin. The analysis of various LLMs, including GPT-3.5 and GPT-4o, reveals that while Mandarin has few hallucinated responses, Hindi and Farsi exhibit significantly higher rates of inaccuracies.
ConInstruct: Evaluating Large Language Models on Conflict Detection and Resolution in Instructions
NeutralArtificial Intelligence
ConInstruct is a benchmark designed to evaluate Large Language Models (LLMs) on their ability to detect and resolve conflicts in user instructions. While many existing assessments focus on adherence to instructions, ConInstruct addresses the often-overlooked scenarios where conflicting constraints arise. Initial evaluations show that proprietary LLMs generally perform well in conflict detection, with DeepSeek-R1 and Claude-4.5-Sonnet achieving the highest F1-scores.
Leveraging the Power of Large Language Models in Entity Linking via Adaptive Routing and Targeted Reasoning
PositiveArtificial Intelligence
The paper presents ARTER (Adaptive Routing and Targeted Entity Reasoning), a novel approach to Entity Linking (EL) that utilizes large language models (LLMs) without extensive fine-tuning. ARTER combines candidate generation, context-based scoring, adaptive routing, and selective reasoning to improve efficiency. It categorizes contextual mentions into easy and hard cases, processing them with a low-computational linker and targeted LLM reasoning. ARTER outperforms existing methods like ReFinED by up to 4.47% on standard benchmarks.