Adaptive Layer-Wise Transformations for Post-Training Quantization of Large Language Models

SwiftMem has been introduced as a query-aware agentic memory system designed to enhance the efficiency of large language model (LLM) agents by enabling sub-linear retrieval through specialized indexing techniques. This system addresses the limitations of existing memory frameworks that rely on exhaustive retrieval methods, which can lead to significant latency issues as memory storage expands.

PrivGemo has been introduced as a privacy-preserving framework designed for knowledge graph (KG)-grounded reasoning, addressing the risks associated with using private KGs in large language models (LLMs). This dual-tower architecture maintains local knowledge while allowing remote reasoning through an anonymized interface, effectively mitigating semantic and structural exposure.

A new offline reinforcement learning (RL) framework named STO-RL has been proposed to enhance policy learning from pre-collected datasets, particularly in long-horizon tasks with sparse rewards. By utilizing large language models (LLMs) to generate temporally ordered subgoal sequences, STO-RL aims to improve the efficiency of reward shaping and policy optimization.

Recent research highlights that while KV cache reuse can enhance efficiency in multi-agent large language model (LLM) systems, it can negatively impact the performance of LLM judges, leading to inconsistent selection behaviors despite stable end-task accuracy.

Qalb has been introduced as the largest state-of-the-art Urdu large language model, developed to address the underrepresentation of Urdu in modern natural language processing (NLP) systems. This model utilizes a two-stage approach involving continued pre-training on a dataset of 1.97 billion tokens, which includes diverse Urdu texts and English Wikipedia data.

A novel Price-Incentive Mechanism (PRINCE) has been proposed to enhance Multi-Tenant Split Federated Learning (SFL) for Foundation Models (FMs) like GPT-4, enabling efficient fine-tuning on resource-constrained devices while maintaining privacy. This mechanism addresses the coordination challenges faced by multiple SFL tenants with diverse fine-tuning needs.

The introduction of LoFT-LLM, a novel forecasting pipeline, aims to enhance time-series predictions in finance and energy sectors by integrating low-frequency learning with large language models (LLMs). This approach addresses challenges posed by limited training data and high-frequency noise, allowing for more accurate long-term trend analysis.