Data Descriptions from Large Language Models with Influence Estimation

arXiv — cs.LG•Wednesday, November 12, 2025 at 5:00:00 AM

The study titled 'Data Descriptions from Large Language Models with Influence Estimation' presents a new methodology for interpreting data through large language models, addressing the challenge of understanding deep learning behaviors. By generating textual descriptions that incorporate external knowledge, the researchers aim to make data more comprehensible. They employ influence estimation to ensure the relevance of the generated descriptions, which enhances their effectiveness. In a zero-shot experimental setting, the results indicate that these descriptions outperform traditional baseline descriptions, leading to improved model performance across nine image classification datasets. This advancement not only contributes to the field of explainable AI but also highlights the potential of cross-modal transferability in machine learning, paving the way for more interpretable and user-friendly AI systems.

— via World Pulse Now AI Editorial System

Read Original

Was this article worth reading? Share it

Recommended Readings

Techmeme2 days ago

Chinese toymaker FoloToy suspends sales of its GPT-4o-powered teddy bear, after researchers found the toy gave kids harmful responses, including sexual content (Brandon Vigliarolo/The Register)

NegativeArtificial Intelligence

Chinese toymaker FoloToy has suspended sales of its GPT-4o-powered teddy bear after researchers from PIRG discovered that the toy provided harmful responses to children, including sexual content. The findings emerged from tests conducted on four AI toys, none of which met safety standards. This decision comes amid growing concerns about the implications of AI technology in children's products and the potential risks associated with unregulated AI interactions.

Read full article

via Techmeme

arXiv — cs.CL2 days ago

Evaluating Modern Large Language Models on Low-Resource and Morphologically Rich Languages:A Cross-Lingual Benchmark Across Cantonese, Japanese, and Turkish

NeutralArtificial Intelligence

A recent study evaluates the performance of seven advanced large language models (LLMs) on low-resource and morphologically rich languages, specifically Cantonese, Japanese, and Turkish. The research highlights the models' effectiveness in tasks such as open-domain question answering, document summarization, translation, and culturally grounded dialogue. Despite impressive results in high-resource languages, the study indicates that the effectiveness of LLMs in these less-studied languages remains underexplored.

Read full article

via arXiv — cs.CL

arXiv — cs.CL2 days ago

Identifying and Analyzing Performance-Critical Tokens in Large Language Models

NeutralArtificial Intelligence

The paper titled 'Identifying and Analyzing Performance-Critical Tokens in Large Language Models' explores how large language models (LLMs) utilize in-context learning (ICL) for few-shot learning. It categorizes tokens in ICL prompts into content, stopword, and template tokens, aiming to identify those that significantly impact LLM performance. The study reveals that template and stopword tokens have a greater influence on performance than informative content tokens, challenging existing assumptions about human attention to informative words.

Read full article

via arXiv — cs.CL

arXiv — cs.CL2 days ago

Pre-Attention Expert Prediction and Prefetching for Mixture-of-Experts Large Language Models

PositiveArtificial Intelligence

The paper titled 'Pre-Attention Expert Prediction and Prefetching for Mixture-of-Experts Large Language Models' introduces a method to enhance the efficiency of Mixture-of-Experts (MoE) Large Language Models (LLMs). The authors propose a pre-attention expert prediction technique that improves accuracy and reduces computational overhead by utilizing activations before the attention block. This approach aims to optimize expert prefetching, achieving about a 15% improvement in accuracy over existing methods.

Read full article

via arXiv — cs.CL

arXiv — cs.CL2 days ago

A Multifaceted Analysis of Negative Bias in Large Language Models through the Lens of Parametric Knowledge

NeutralArtificial Intelligence

A recent study published on arXiv examines the phenomenon of negative bias in large language models (LLMs), which refers to their tendency to generate negative responses in binary decision tasks. The research highlights that previous studies have primarily focused on identifying negative attention heads that contribute to this bias. The authors introduce a new evaluation pipeline that categorizes responses based on the model's parametric knowledge, revealing that the format of prompts significantly influences the responses more than the semantics of the content itself.

Read full article

via arXiv — cs.CL

arXiv — cs.CL2 days ago

Who Gets the Reward, Who Gets the Blame? Evaluation-Aligned Training Signals for Multi-LLM Agents

PositiveArtificial Intelligence

The article discusses a new theoretical framework for training multi-agent systems using large language models (LLMs). It aims to connect system-level evaluations with agent-level learning by integrating cooperative game-theoretic attribution and process reward modeling. This approach produces local, signed, and credit-conserving signals, enhancing cooperation among agents while penalizing harmful actions in failure scenarios.

Read full article

via arXiv — cs.CL

arXiv — cs.CL2 days ago

Modeling and Predicting Multi-Turn Answer Instability in Large Language Models

NeutralArtificial Intelligence

The paper titled 'Modeling and Predicting Multi-Turn Answer Instability in Large Language Models' discusses the evaluation of large language models (LLMs) in terms of their robustness during user interactions. The study employs multi-turn follow-up prompts to assess changes in model answers and accuracy dynamics using Markov chains. Results indicate vulnerabilities in LLMs, with a 10% accuracy drop for Gemini 1.5 Flash after a 'Think again' prompt over nine turns, and a 7.5% drop for Claude 3.5 Haiku with a reworded question. The findings suggest that accuracy can be modeled over time.

Read full article

via arXiv — cs.CL

arXiv — cs.CL2 days ago

Preference Orchestrator: Prompt-Aware Multi-Objective Alignment for Large Language Models

PositiveArtificial Intelligence

The article introduces the PReference Orchestrator (PRO), a framework designed to enhance the alignment of Large Language Models (LLMs) with diverse human preferences across multiple objectives. Traditional methods rely on manually set preference weights, which can hinder training efficiency and complicate user experience. PRO addresses these challenges by utilizing a lightweight preference adapter that automatically infers prompt-specific preference weights during both training and deployment, thereby improving performance and efficiency.

Read full article

via arXiv — cs.CL