Are they lovers or friends? Evaluating LLMs' Social Reasoning in English and Korean Dialogues

arXiv — cs.CLTuesday, October 28, 2025 at 4:00:00 AM
A new dataset called SCRIPTS has been introduced to evaluate the social reasoning abilities of large language models (LLMs) in understanding interpersonal relationships in dialogues. This dataset, featuring 1,000 dialogues in English and Korean sourced from movie scripts, is significant as it helps researchers assess how well AI can interpret complex social cues, which is crucial for improving human-AI interactions. By analyzing relationships like friends or lovers, this initiative could enhance the effectiveness of AI in real-world applications.
— Curated by the World Pulse Now AI Editorial System

Was this article worth reading? Share it

Recommended Readings
Unleash the Power of LLMs in Rust with Helios Engine
PositiveArtificial Intelligence
If you're a Rust developer looking to harness the capabilities of Large Language Models, the Helios Engine is here to help. This innovative framework simplifies the process of creating intelligent applications, whether it's a chatbot or a local model-powered tool. By providing a robust foundation, Helios Engine empowers developers to bring their creative ideas to life, making it an exciting development in the tech world.
The hottest new programming language is English
PositiveArtificial Intelligence
A new trend is emerging in the tech world as English is being recognized as the hottest programming language. This shift highlights the importance of clear communication in coding and software development, making it easier for developers to collaborate across different backgrounds. As the tech industry continues to evolve, embracing English as a programming language could streamline processes and enhance productivity, ultimately benefiting businesses and developers alike.
In a First, AI Models Analyze Language As Well As a Human Expert
PositiveArtificial Intelligence
Recent advancements in artificial intelligence have led to large language models demonstrating metalinguistic abilities, allowing them to analyze language with a proficiency comparable to human experts. This breakthrough is significant as it challenges our understanding of language and cognition, highlighting the potential of AI to enhance communication and understanding in various fields. As these models continue to evolve, they could revolutionize how we interact with technology and each other.
I Built an AI Prompt That Turns Podcast Ideas into Professional Scripts—And It Actually Work
PositiveArtificial Intelligence
A new AI prompt has been developed that transforms podcast ideas into professional scripts, showcasing the potential of technology to enhance creativity in content creation. This innovation not only streamlines the scriptwriting process but also empowers creators to focus on their unique voices and ideas, making it easier for them to produce high-quality podcasts. As the podcasting industry continues to grow, tools like this could revolutionize how creators approach their work.
Data-Efficient RLVR via Off-Policy Influence Guidance
PositiveArtificial Intelligence
A new approach to data selection in Reinforcement Learning with Verifiable Rewards (RLVR) has been proposed, which uses influence functions to better estimate how each data point contributes to learning. This method aims to improve the reasoning capabilities of large language models, moving beyond current heuristic-based techniques that lack theoretical backing. This advancement is significant as it could lead to more reliable and efficient learning processes in AI, enhancing the overall performance of language models.
LASTIST: LArge-Scale Target-Independent STance dataset
PositiveArtificial Intelligence
The introduction of the LASTIST dataset marks a significant advancement in stance detection research, particularly in artificial intelligence. This new dataset is designed to be target-independent, allowing researchers to explore stances without being limited to specific targets. This is crucial for developing models in low-resource languages like Korean, where existing datasets are scarce. By broadening the scope of stance detection, LASTIST opens up new opportunities for understanding public opinion and sentiment across diverse languages and contexts.
Towards Global Retrieval Augmented Generation: A Benchmark for Corpus-Level Reasoning
PositiveArtificial Intelligence
A new benchmark for retrieval-augmented generation (RAG) has been introduced, aiming to enhance the capabilities of large language models by addressing their tendency to produce hallucinations. Unlike existing benchmarks that focus on localized understanding, this new approach emphasizes global reasoning, which is crucial for real-world applications. This development is significant as it could lead to more accurate and reliable AI systems, ultimately improving how we interact with technology.
Bayesian Network Fusion of Large Language Models for Sentiment Analysis
PositiveArtificial Intelligence
A new study introduces a Bayesian network approach to enhance large language models (LLMs) for sentiment analysis. This method aims to tackle common issues such as lack of transparency, high costs for fine-tuning, and environmental concerns due to computational demands. By improving the explainability and consistency of LLMs, this research could significantly benefit various industries relying on accurate sentiment analysis, making it a noteworthy advancement in the field.
Latest from Artificial Intelligence
Graph RAG vs SQL RAG
NeutralArtificial Intelligence
The article discusses the evaluation of RAGs (Retrieval-Augmented Generation) on graph and SQL databases, highlighting the differences and potential applications of each approach. Understanding these distinctions is crucial for developers and data scientists as they choose the right database technology for their projects, ensuring optimal performance and efficiency.
Meet the robots cleaning parks, fighting fires, and mowing lawns in US cities
PositiveArtificial Intelligence
In an exciting development for urban living, robots are increasingly being deployed in US cities to clean parks, fight fires, and mow lawns. This innovation not only enhances the efficiency of municipal services but also addresses labor shortages in these sectors. Experts like Peter Stone from the University of Texas highlight that while budget constraints have slowed adoption, the potential benefits for communities are significant. As cities embrace these technologies, we can expect cleaner environments and improved public safety, making our urban spaces more enjoyable for everyone.
Build Your Own AI Chatbot Like ChatGPT — A Practical Guide with Code
PositiveArtificial Intelligence
Rajni, an AI developer, shares her journey of building a ChatGPT-like AI using free tools and open-source models. After a challenging experience trying to create a love poem in Hindi, she learned valuable lessons that she now imparts in a practical guide. This article is significant as it empowers aspiring developers to create their own AI chatbots without needing expensive resources, making AI more accessible to everyone.
How To Make Emoticons With Your Keyboard
PositiveArtificial Intelligence
This article provides a fun and straightforward guide on how to create emoticons using your keyboard, perfect for anyone looking to express themselves quickly in digital conversations. It emphasizes the simplicity of typing these symbols, making it accessible for all users, regardless of their tech-savviness. Understanding how to use emoticons can enhance online communication, adding a personal touch to messages.
How to Install Gemini CLI
PositiveArtificial Intelligence
This article provides a straightforward guide on how to install the Gemini CLI using Node.js, which is essential for developers looking to leverage Google's generative AI tools. By following the steps outlined, users can easily set up the CLI and start utilizing its features, making it a valuable resource for enhancing productivity and accessing advanced AI capabilities.
Hello DEV — My First Post!
PositiveArtificial Intelligence
A new member has joined the DEV community, excited to share their journey and insights. With experience in JavaScript, Python, and TypeScript, they are eager to contribute to discussions and explore AI tools. This is a great addition to the community, as fresh perspectives can inspire innovation and collaboration among developers.