Towards Alignment-Centric Paradigm: A Survey of Instruction Tuning in Large Language Models

The paper presents StreamingTalker, an autoregressive diffusion model designed for speech-driven 3D facial animation. This model addresses the limitations of previous methods that process audio sequences in a single pass, which can lead to poor performance with longer inputs and increased latency. By processing audio in a streaming manner, StreamingTalker offers flexibility with varying audio lengths and reduces latency, enhancing the realism and synchronization of facial animations.

ProRAC (Progression-based Reasoning about Actions and Change) is a neuro-symbolic framework that utilizes large language models (LLMs) to address reasoning about actions and changes (RAC) problems. The framework extracts essential elements from RAC problems, executes actions progressively to determine the final state, and evaluates queries against this state. Evaluations on various RAC benchmarks indicate that ProRAC demonstrates strong performance across diverse tasks and domains.

The paper presents a novel physical adversarial attack targeting stereo matching models used in autonomous driving. Unlike traditional attacks that utilize 2D patches, this approach employs a 3D physical adversarial example (PAE) with global camouflage texture, enhancing visual consistency across various viewpoints. Additionally, a new 3D stereo matching rendering module is introduced to align the PAE with real-world positions in binocular vision, addressing the disparity effects of stereo cameras.

The paper introduces a novel task called code-to-style image generation, which aims to create images with unique and consistent visual styles based solely on numerical style codes. This approach addresses challenges faced by existing generative methods that rely on extensive textual prompts or reference images. The authors present CoTyle, the first open-source method for this task, filling a gap in academic research on visual stylization, which has been largely dominated by industry players like Midjourney.

Large Language Models (LLMs) are advanced linguistic tools that can produce outputs that may sound plausible but are often factually incorrect, a phenomenon known as hallucination. This study introduces a mathematical framework to analyze, quantify, and mitigate these hallucinations. It employs probabilistic modeling and Bayesian uncertainty estimation to develop refined metrics and strategies, including contrastive decoding and retrieval-augmented grounding, aimed at enhancing the reliability of LLMs.

This paper presents a tractable algorithm for estimating an unknown Lipschitz function from noisy observations, establishing an upper bound on its convergence rate. The approach extends max-affine methods from convex shape-restricted regression to a broader Lipschitz setting. A key component is a nonlinear feature expansion that maps max-affine functions into delta-convex functions, achieving the minimax convergence rate under squared loss and subgaussian distributions.

MedBench v4 introduces a comprehensive benchmarking framework for evaluating Chinese medical language models, multimodal models, and intelligent agents. This cloud-based infrastructure features over 700,000 expert-curated tasks across various medical specialties. The evaluation process includes multi-stage refinement and clinician reviews, with results indicating that while base LLMs score an average of 54.1/100, safety and ethics ratings remain low at 18.4/100.

This research explores retrieval augmented generation as a method for automatic context discovery in context-aware Automatic Speech Recognition (ASR) systems, aiming to enhance transcription accuracy, especially with rare or out-of-vocabulary terms. The study introduces an embedding-based retrieval approach and evaluates its effectiveness against large language model alternatives. Experiments show a reduction in word error rate (WER) by up to 17% compared to no-context, with oracle context achieving a 24.1% reduction.