Survey and Experiments on Mental Disorder Detection via Social Media: From Large Language Models and RAG to Agents

A recent empirical study on Large Language Models (LLMs) has revealed that the effectiveness of many-shot prompting for code translation may be overstated. Analyzing over 90,000 translations, researchers found that while more examples can improve static similarity metrics, functional correctness peaks with fewer examples, indicating a 'many-shot paradox'.

A new method called RARO (Relativistic Adversarial Reasoning Optimization) has been introduced to enhance the reasoning capabilities of Large Language Models (LLMs) by utilizing expert demonstrations through Inverse Reinforcement Learning, rather than relying on task-specific verifiers. This approach sets up an adversarial game between a policy and a critic, enabling robust learning and significantly outperforming traditional verifier-free models in various evaluation tasks.

A novel reward mechanism named COMPASS has been introduced to enhance test-time reinforcement learning (RL) for large language models (LLMs). This mechanism allows models to autonomously learn from unlabeled data, addressing the scalability challenges faced by traditional RL methods that rely heavily on human-curated data for reward modeling.

Recent research has explored the reasoning capabilities of Large Language Models (LLMs) in the context of abstractive summarization, revealing that while reasoning strategies can enhance summary fluency, they may compromise factual accuracy. A systematic study assessed various reasoning strategies across multiple datasets, highlighting the nuanced effectiveness of reasoning in summarization tasks.

Bench4KE has been introduced as an extensible API-based benchmarking system aimed at standardizing the evaluation of tools that automatically generate Competency Questions (CQs) for Knowledge Engineering (KE). This initiative addresses the current lack of methodological rigor in evaluating such tools, which has hindered the replication and comparison of results in the field.

A recent study has introduced ScamAgent, an AI-driven agent utilizing Large Language Models (LLMs) to create realistic scam call scripts that can adapt to user responses over multiple interactions. This development highlights the potential misuse of advanced AI technologies in simulating human-like conversations for fraudulent purposes.

A new framework named ProgRAG has been proposed to enhance the capabilities of Large Language Models (LLMs) by addressing hallucination and reasoning failures through multi-hop knowledge graph question answering. This approach aims to improve the accuracy of evidence retrieval and reasoning processes, particularly in complex tasks that require extensive knowledge integration.

Compactor has been introduced as a training-free, query-agnostic key-value (KV) cache compression strategy for large language models (LLMs), utilizing approximate leverage scores to assess token importance. This method allows for a reduction of 20% in token retention while maintaining performance across various tasks, achieving a 68% reduction in KV memory burden on average.