AI evaluates texts without bias—until the source is revealed

Tech Xplore — AI & MLMonday, November 10, 2025 at 4:20:01 PM
AI evaluates texts without bias—until the source is revealed
Large language models (LLMs) are increasingly utilized to evaluate various forms of text, including grading essays, moderating social media content, summarizing reports, and screening job applications. While these AI systems are designed to operate without bias, research indicates that biases may emerge once the source of the text is disclosed. This raises important questions about the reliability and fairness of AI evaluations, particularly in sensitive applications where the source's identity could influence outcomes. Understanding these dynamics is crucial as reliance on AI in decision-making processes grows.
— via World Pulse Now AI Editorial System

Was this article worth reading? Share it

Recommended apps based on your readingExplore all apps
Continue Readings
Whose Facts Win? LLM Source Preferences under Knowledge Conflicts
NeutralArtificial Intelligence
A recent study examined the preferences of large language models (LLMs) in resolving knowledge conflicts, revealing a tendency to favor information from credible sources like government and newspaper outlets over social media. This research utilized a novel framework to analyze how these source preferences influence LLM outputs.
MLLM-VADStory: Domain Knowledge-Driven Multimodal LLMs for Video Ad Storyline Insights
PositiveArtificial Intelligence
The MLLM-VADStory framework has been introduced to enhance the understanding of video ad storylines by systematically quantifying and generating insights based on domain knowledge. This innovative approach segments ads into functional units and classifies their roles, ultimately improving video retention through story-based creatives.
Explaining Generalization of AI-Generated Text Detectors Through Linguistic Analysis
NeutralArtificial Intelligence
A recent study published on arXiv investigates the generalization capabilities of AI-generated text detectors, revealing that while these detectors perform well on in-domain benchmarks, they often fail to generalize across various generation conditions, such as unseen prompts and different model families. The research employs a comprehensive benchmark involving multiple prompting strategies and large language models to analyze performance variance through linguistic features.
Calibration Is Not Enough: Evaluating Confidence Estimation Under Language Variations
NeutralArtificial Intelligence
A recent study titled 'Calibration Is Not Enough: Evaluating Confidence Estimation Under Language Variations' highlights the limitations of current confidence estimation methods for large language models (LLMs), emphasizing the need for evaluations that account for language variations and semantic differences. The research proposes a new framework that assesses confidence quality based on robustness, stability, and sensitivity to variations in prompts and answers.
BenchOverflow: Measuring Overflow in Large Language Models via Plain-Text Prompts
NeutralArtificial Intelligence
A recent study titled 'BenchOverflow' investigates a failure mode in large language models (LLMs) where plain-text prompts lead to excessive outputs, termed Overflow. This phenomenon can increase operational costs, latency, and degrade performance across users, particularly in high-demand environments.
Nationality and Region Prediction from Names: A Comparative Study of Neural Models and Large Language Models
NeutralArtificial Intelligence
A recent study published on arXiv compares the effectiveness of neural models and large language models (LLMs) in predicting nationality and region from personal names. The research evaluates six neural models and six LLM prompting strategies across three levels of granularity, revealing that LLMs consistently outperform traditional models in accuracy.
Semantic Gravity Wells: Why Negative Constraints Backfire
NeutralArtificial Intelligence
A recent study published on arXiv investigates the phenomenon of negative constraints in large language models, revealing that such instructions often lead to unexpected failures. The research introduces the concept of semantic pressure, which quantitatively measures the likelihood of generating forbidden tokens, and establishes a logistic relationship between violation probability and semantic pressure.
What If TSF: A Benchmark for Reframing Forecasting as Scenario-Guided Multimodal Forecasting
NeutralArtificial Intelligence
The introduction of What If TSF (WIT) marks a significant advancement in time series forecasting by establishing a benchmark for scenario-guided multimodal forecasting. This new framework aims to evaluate the ability of models to condition forecasts on contextual text, particularly future scenarios, moving beyond traditional unimodal approaches that rely solely on historical data.

Ready to build your own newsroom?

Subscribe to unlock a personalised feed, podcasts, newsletters, and notifications tailored to the topics you actually care about