Understanding and Mitigating Over-refusal for Large Language Models via Safety Representation

arXiv — cs.CLTuesday, November 25, 2025 at 5:00:00 AM
  • A recent study has highlighted the issue of over-refusal in large language models (LLMs), which occurs when these models excessively decline to generate outputs due to safety concerns. The research proposes a new approach called MOSR, which aims to balance safety and usability by addressing the representation of safety in LLMs.
  • This development is significant as it seeks to enhance the practical usability of LLMs while maintaining safety standards. By mitigating over-refusal, the proposed method could lead to more effective applications of LLMs in various fields, including natural language processing and AI-driven solutions.
  • The challenge of balancing safety and performance in LLMs is a recurring theme in AI research. While advancements like MOSR aim to improve usability, other studies have also focused on issues such as evaluation-awareness, label length bias, and the need for diverse output generation, indicating a broader discourse on optimizing LLMs for real-world applications.
— via World Pulse Now AI Editorial System

Was this article worth reading? Share it

Recommended apps based on your readingExplore all apps
Continue Readings
SwiftMem: Fast Agentic Memory via Query-aware Indexing
PositiveArtificial Intelligence
SwiftMem has been introduced as a query-aware agentic memory system designed to enhance the efficiency of large language model (LLM) agents by enabling sub-linear retrieval through specialized indexing techniques. This system addresses the limitations of existing memory frameworks that rely on exhaustive retrieval methods, which can lead to significant latency issues as memory storage expands.
PrivGemo: Privacy-Preserving Dual-Tower Graph Retrieval for Empowering LLM Reasoning with Memory Augmentation
PositiveArtificial Intelligence
PrivGemo has been introduced as a privacy-preserving framework designed for knowledge graph (KG)-grounded reasoning, addressing the risks associated with using private KGs in large language models (LLMs). This dual-tower architecture maintains local knowledge while allowing remote reasoning through an anonymized interface, effectively mitigating semantic and structural exposure.
STO-RL: Offline RL under Sparse Rewards via LLM-Guided Subgoal Temporal Order
PositiveArtificial Intelligence
A new offline reinforcement learning (RL) framework named STO-RL has been proposed to enhance policy learning from pre-collected datasets, particularly in long-horizon tasks with sparse rewards. By utilizing large language models (LLMs) to generate temporally ordered subgoal sequences, STO-RL aims to improve the efficiency of reward shaping and policy optimization.
When KV Cache Reuse Fails in Multi-Agent Systems: Cross-Candidate Interaction is Crucial for LLM Judges
NeutralArtificial Intelligence
Recent research highlights that while KV cache reuse can enhance efficiency in multi-agent large language model (LLM) systems, it can negatively impact the performance of LLM judges, leading to inconsistent selection behaviors despite stable end-task accuracy.
LoFT-LLM: Low-Frequency Time-Series Forecasting with Large Language Models
PositiveArtificial Intelligence
The introduction of LoFT-LLM, a novel forecasting pipeline, aims to enhance time-series predictions in finance and energy sectors by integrating low-frequency learning with large language models (LLMs). This approach addresses challenges posed by limited training data and high-frequency noise, allowing for more accurate long-term trend analysis.

Ready to build your own newsroom?

Subscribe to unlock a personalised feed, podcasts, newsletters, and notifications tailored to the topics you actually care about