The Tokenization Bottleneck: How Vocabulary Extension Improves Chemistry Representation Learning in Pretrained Language Models

Self-Examining Reinforcement Learning (SERL) is a proposed framework that addresses challenges in applying Reinforcement Learning (RL) to open-domain tasks. Traditional methods face issues with subjectivity and reliance on external rewards. SERL innovatively positions large language models (LLMs) as both Actor and Judge, utilizing internal reward mechanisms. It employs Copeland-style pairwise comparisons to enhance the Actor's capabilities and introduces a self-consistency reward to improve the Judge's reliability, aiming to advance RL applications in open domains.

The study explores the scaling laws of deep neural networks in medical anatomical segmentation, revealing that larger training datasets lead to improved performance across various semantic tasks and imaging modalities. It highlights the significance of deformation-guided augmentation strategies, such as random elastic deformation and registration-guided deformation, in enhancing segmentation outcomes. The research aims to address the underexplored area of data scaling in medical imaging, proposing a novel image augmentation approach to generate diffeomorphic mappings.

The paper discusses Zero-shot coordination (ZSC), a significant challenge in multi-agent game theory, particularly in evolving games. It emphasizes the need for agents to coordinate with previously unseen partners without fine-tuning. The study introduces Scalable Population Training (ScaPT), an efficient reinforcement learning framework that enhances zero-shot coordination by utilizing a meta-agent to manage a diverse pool of agents, addressing limitations of existing methods that focus on small populations and computational constraints.

MMaDA-Parallel is a new multimodal diffusion framework aimed at enhancing thinking-aware generation in AI models. It addresses performance degradation caused by error propagation in existing autoregressive approaches. The framework introduces ParaBench, a benchmark for evaluating text and image outputs, revealing that misalignment between reasoning and generated images contributes to performance issues. MMaDA-Parallel employs supervised finetuning and Parallel Reinforcement Learning to improve interaction between text and images throughout the denoising process.

As embodied agents navigate complex environments, the ability to perceive and track individual objects over time is crucial, particularly for tasks involving similar objects. In non-Markovian contexts, decision-making relies on object-specific histories rather than the immediate scene. Without a persistent memory of past interactions, robotic policies may falter or repeat actions unnecessarily. To address this, LIBERO-Mem is introduced as a task suite designed to test robotic manipulation under conditions of partial observability at the object level.

The integration of Large Language Models (LLMs) with 3D vision is revolutionizing robotic perception and autonomy. This approach enhances robotic sensing technologies, allowing machines to understand and interact with complex environments using natural language and spatial awareness. The review discusses the foundational principles of LLMs and 3D data, examines critical 3D sensing technologies, and highlights advancements in scene understanding, text-to-3D generation, and embodied agents, while addressing the challenges faced in this evolving field.

Recent research highlights a new class of attacks in federated learning that compromise model interpretability without impacting accuracy. The study reveals that adversarial clients can apply small color perturbations, shifting a model's saliency maps from meaningful regions while maintaining predictions. This method, termed the Chromatic Perturbation Module, systematically creates adversarial examples by altering color contrasts, leading to persistent poisoning of the model's internal feature attributions, challenging assumptions about model reliability.

The paper presents a novel approach called Zero-Training Task-Specific Model Synthesis (ZS-TMS) for few-shot medical image classification. This method addresses the challenge of limited annotated datasets in medical imaging by utilizing a pre-trained generative engine to synthesize parameters for a task-specific classifier. By requiring minimal input, such as a single example image, ZS-TMS aims to enhance the efficiency of medical image analysis, particularly for rare diseases where data is scarce.