How Well Do LLMs Understand Tunisian Arabic?

Pennylane, a French startup specializing in accounting software, is reportedly in discussions for a new funding round that could value the company at $4.25 billion, nearly double its previous valuation from just seven months ago.

A novel learning framework utilizing Large Language Models (LLMs) has been introduced to enhance the generalization capabilities of Neural Combinatorial Optimization (NCO) for Vehicle Routing Problems (VRPs). This approach addresses the significant performance drop observed when NCO models trained on small-scale instances are applied to larger scenarios, primarily due to distributional shifts between training and testing data.

A recent study on multilingual large language models (LLMs) reveals that language information is distinctly organized within their internal representation space, particularly showing significant separation in the first transformer block. This comprehensive probing study analyzed six multilingual LLMs across all 268 transformer layers, utilizing both linear and nonlinear probes alongside a new Token-Language Alignment analysis.

A recent evaluation of large language models (LLMs) in academic library reference services examined their ability to provide equitable support across diverse user demographics, including sex, race, and institutional roles. The study found no significant differentiation in responses based on race or ethnicity, with only minor evidence of bias against women in one model. LLMs showed nuanced responses tailored to users' institutional roles, reflecting professional norms.

A novel approach called Vision-align-to-Language integrated Knowledge Graph (VaLiK) has been proposed to enhance reasoning in Large Language Models (LLMs) by constructing Multimodal Knowledge Graphs (MMKGs) without the need for manual annotations. This method aims to address challenges such as incomplete knowledge and hallucination artifacts that LLMs face due to the limitations of traditional Knowledge Graphs (KGs).

A new benchmark named MUCH has been introduced to assess Claim-level Uncertainty Quantification (UQ) in Large Language Models (LLMs). This benchmark includes 4,873 samples in English, French, Spanish, and German, and provides 24 generation logits per token, enhancing the evaluation of UQ methods under realistic conditions.

LangMark has been introduced as a new multilingual dataset aimed at enhancing automatic post-editing (APE) for machine-translated texts, featuring 206,983 triplets across seven languages including Brazilian Portuguese, French, and Japanese. This dataset is human-annotated by expert linguists to improve translation quality and reduce reliance on human intervention.

A new framework called Aspect-Based Causal Abstention (ABCA) has been introduced to enhance the reliability of Large Language Models (LLMs) by enabling early abstention from generating potentially incorrect responses. This approach analyzes the internal diversity of LLM knowledge through causal inference, allowing models to assess the reliability of their knowledge before generating answers.