Speech Recognition Model Improves Text-to-Speech Synthesis using Fine-Grained Reward

Cornell Tech has secured a $7 million investment from NASA and Schmidt Sciences aimed at modernizing arXiv, a preprint repository for scientific papers. This funding will facilitate the migration of arXiv to cloud infrastructure, upgrade its outdated codebase, and develop new tools to enhance the discovery of relevant preprints for researchers.

A new framework named Specification-Guided Moderation (SGM) has been introduced to enhance content moderation filters for large language models (LLMs). This framework allows for the automation of training data generation based on user-defined specifications, addressing the limitations of traditional safety-focused filters. SGM aims to provide scalable and application-specific alignment goals for LLMs.

A new study introduces an innovative pipeline for transforming public Zoom recordings into speaker-attributed transcripts, enhancing the realism of civic simulations using large language models (LLMs). This method incorporates persona profiles and action tags, significantly improving the modeling of multi-party deliberation in local government settings such as Appellate Court hearings and School Board meetings.

A new framework named Reading Comprehension Exercise Generation (RCEG) has been proposed to leverage large language models (LLMs) for automatically generating personalized English reading comprehension exercises. This framework utilizes fine-tuned LLMs to create content candidates, which are then evaluated by a discriminator to select the highest quality output, significantly enhancing the educational content generation process.

A novel framework named SWAN has been introduced to address the memory challenges faced by Large Language Models (LLMs) during autoregressive inference, specifically targeting the Key-Value (KV) cache's substantial memory usage. SWAN employs an offline orthogonal matrix to efficiently rotate and prune the KV-cache, allowing for direct use in attention computation without requiring decompression steps.

Cross-lingual information retrieval (CLIR) is being systematically evaluated through various approaches, including document translation and multilingual dense retrieval with pretrained encoders. This research highlights the challenges posed by disparities in resources and weak semantic alignment in embedding models, revealing that dense retrieval models specifically trained for CLIR outperform traditional methods.

A recent position paper emphasizes the need for literary scholars to engage with research on large language model (LLM) interpretability, suggesting that the red team could serve as a platform for this ideological struggle. The paper argues that current interpretability standards are insufficient for evaluating LLMs.

Recent research has introduced the concept of representational stability in large language models (LLMs), focusing on how these models encode distinctions between true, false, and neither-true-nor-false content. The study assesses this stability by training a linear probe on LLM activations to differentiate true from not-true statements and measuring shifts in decision boundaries under label changes.