arXiv:2510.21829v1 Announce Type: new 
Abstract: In recent years, multimodal medical data-based survival analysis has attracted much attention. However, real-world datasets often suffer from the problem of incomplete modality, where some patient modality information is missing due to acquisition limitations or system failures. Existing methods typically infer missing modalities directly from observed ones using deep neural networks, but they often ignore the distributional discrepancy across modalities, resulting in inconsistent and unreliable modality reconstruction. To address these challenges, we propose a novel framework that combines a low-rank Transformer with a flow-based generative model for robust and flexible multimodal survival prediction. Specifically, we first formulate the concerned problem as incomplete multimodal survival analysis using the multi-instance representation of whole slide images (WSIs) and genomic profiles. To realize incomplete multimodal survival analysis, we propose a class-specific flow for cross-modal distribution alignment. Under the condition of class labels, we model and transform the cross-modal distribution. By virtue of the reversible structure and accurate density modeling capabilities of the normalizing flow model, the model can effectively construct a distribution-consistent latent space of the missing modality, thereby improving the consistency between the reconstructed data and the true distribution. Finally, we design a lightweight Transformer architecture to model intra-modal dependencies while alleviating the overfitting problem in high-dimensional modality fusion by virtue of the low-rank Transformer. Extensive experiments have demonstrated that our method not only achieves state-of-the-art performance under complete modality settings, but also maintains robust and superior accuracy under the incomplete modalities scenario.

تقدم دراسة جديدة نموذج تدفق يستخدم المحولات منخفضة الرتبة لمواجهة تحديات تحليل البقاء متعدد الأنماط غير المكتمل في البيانات الطبية. هذه الأبحاث مهمة لأنها تتناول المشكلة الشائعة المتمثلة في نقص معلومات الأنماط لدى المرضى، والتي قد تنشأ بسبب قيود مختلفة. من خلال تحسين كيفية تحليلنا لمجموعات البيانات غير المكتملة، يمكن أن يعزز هذا النموذج دقة توقعات البقاء، مما يعود بالنفع في النهاية على رعاية المرضى واستراتيجيات العلاج.

Un nuevo estudio presenta un modelo de flujo que utiliza transformadores de bajo rango para abordar los desafíos del análisis de supervivencia multimodal incompleto en datos médicos. Esta investigación es significativa ya que aborda el problema común de la información de modalidad faltante en los pacientes, que puede surgir por diversas limitaciones. Al mejorar la forma en que analizamos conjuntos de datos incompletos, este modelo podría aumentar la precisión de las predicciones de supervivencia, beneficiando en última instancia la atención y las estrategias de tratamiento de los pacientes.

Une nouvelle étude présente un modèle de flux utilisant des transformateurs à faible rang pour relever les défis de l'analyse de survie multimodale incomplète dans les données médicales. Cette recherche est importante car elle aborde le problème courant des informations de modalité manquantes chez les patients, qui peuvent survenir en raison de diverses limitations. En améliorant notre façon d'analyser les ensembles de données incomplètes, ce modèle pourrait améliorer la précision des prédictions de survie, bénéficiant ainsi aux soins et aux stratégies de traitement des patients.

A new study introduces a flow model utilizing low-rank transformers to tackle the challenges of incomplete multimodal survival analysis in medical data. This research is significant as it addresses the common issue of missing patient modality information, which can arise from various limitations. By improving how we analyze incomplete datasets, this model could enhance the accuracy of survival predictions, ultimately benefiting patient care and treatment strategies.

A Flow Model with Low-Rank Transformers for Incomplete Multimodal Survival Analysis

arXiv:2601.08100v1 Announce Type: new 
Abstract: Understanding the generalization behavior of deep neural networks remains a fundamental challenge in modern statistical learning theory. Among existing approaches, PAC-Bayesian norm-based bounds have demonstrated particular promise due to their data-dependent nature and their ability to capture algorithmic and geometric properties of learned models. However, most existing results rely on isotropic Gaussian posteriors, heavy use of spectral-norm concentration for weight perturbations, and largely architecture-agnostic analyses, which together limit both the tightness and practical relevance of the resulting bounds. To address these limitations, in this work, we propose a unified framework for PAC-Bayesian norm-based generalization by reformulating the derivation of generalization bounds as a stochastic optimization problem over anisotropic Gaussian posteriors. The key to our approach is a sensitivity matrix that quantifies the network outputs with respect to structured weight perturbations, enabling the explicit incorporation of heterogeneous parameter sensitivities and architectural structures. By imposing different structural assumptions on this sensitivity matrix, we derive a family of generalization bounds that recover several existing PAC-Bayesian results as special cases, while yielding bounds that are comparable to or tighter than state-of-the-art approaches. Such a unified framework provides a principled and flexible way for geometry-/structure-aware and interpretable generalization analysis in deep learning.

تشير دراسة جديدة إلى إطار موحد لـ PAC-Bayes للحدود العامة المعتمدة على المعايير، حيث تتناول التحديات المتعلقة بفهم سلوك التعميم في الشبكات العصبية العميقة. تعيد هذه الدراسة صياغة اشتقاق هذه الحدود كمشكلة تحسين عشوائي على توزيعات غاوسية غير متساوية، بهدف تعزيز الصلة العملية للنتائج.

Un nuevo estudio propone un marco PAC-Bayes unificado para los límites de generalización basados en normas, abordando los desafíos de comprender el comportamiento de generalización de las redes neuronales profundas. La investigación reformula la derivación de estos límites como un problema de optimización estocástica sobre posteriors gaussianos anisotrópicos, con el objetivo de mejorar la relevancia práctica de los resultados.

Une nouvelle étude propose un cadre PAC-Bayésien unifié pour les bornes de généralisation basées sur les normes, abordant les défis de la compréhension du comportement de généralisation des réseaux de neurones profonds. La recherche reformule la dérivation de ces bornes comme un problème d'optimisation stochastique sur des postérieurs gaussiens anisotropes, visant à améliorer la pertinence pratique des résultats.

A new study proposes a unified PAC-Bayesian framework for norm-based generalization bounds, addressing the challenges of understanding deep neural networks' generalization behavior. The research reformulates the derivation of these bounds as a stochastic optimization problem over anisotropic Gaussian posteriors, aiming to enhance the practical relevance of the results.

Towards A Unified PAC-Bayesian Framework for Norm-based Generalization Bounds

arXiv:2601.07944v1 Announce Type: new 
Abstract: Since the turn of the century, approximate Bayesian inference has steadily evolved as new computational techniques have been incorporated to handle increasingly complex and large-scale predictive problems. The recent success of deep neural networks and foundation models has now given rise to a new paradigm in statistical modeling, in which Bayesian inference can be amortized through large-scale learned predictors. In amortized inference, substantial computation is invested upfront to train a neural network that can subsequently produce approximate posterior or predictions at negligible marginal cost across a wide range of tasks. At deployment, amortized inference offers substantial computational savings compared with traditional Bayesian procedures, which generally require repeated likelihood evaluations or Monte Carlo simulations for predictions for each new dataset.
  Despite the growing popularity of amortized inference, its statistical interpretation and its role within Bayesian inference remain poorly understood. This paper presents statistical perspectives on the working principles of several major neural architectures, including feedforward networks, Deep Sets, and Transformers, and examines how these architectures naturally support amortized Bayesian inference. We discuss how these models perform structured approximation and probabilistic reasoning in ways that yield controlled generalization error across a wide range of deployment scenarios, and how these properties can be harnessed for Bayesian computation. Through simulation studies, we evaluate the accuracy, robustness, and uncertainty quantification of amortized inference under varying signal-to-noise ratios and distributional shifts, highlighting both its strengths and its limitations.

أظهرت دراسة حديثة فعالية الاستدلال المدعوم في الإحصاءات البايزية، خاصة تحت تغيرات نسبة الإشارة إلى الضوضاء وتحولات التوزيع. تستخدم هذه الطريقة الشبكات العصبية العميقة لتبسيط عملية الاستدلال، مما يسمح بتوفير كبير في الحوسبة مقارنة بالأساليب البايزية التقليدية التي تتطلب تقييمات واسعة لاحتمالية.

Un estudio reciente ha evaluado la efectividad de la inferencia amortizada en estadísticas bayesianas, particularmente bajo variaciones en la relación señal-ruido y cambios en la distribución. Este método aprovecha redes neuronales profundas para agilizar el proceso de inferencia, permitiendo ahorros computacionales significativos en comparación con los enfoques bayesianos tradicionales que requieren evaluaciones extensas de verosimilitud.

Une étude récente a évalué l'efficacité de l'inférence amortie dans les statistiques bayésiennes, en particulier sous des variations de rapport signal-bruit et des changements de distribution. Cette méthode utilise des réseaux de neurones profonds pour rationaliser le processus d'inférence, permettant des économies computationnelles significatives par rapport aux approches bayésiennes traditionnelles qui nécessitent des évaluations de vraisemblance étendues.

A recent study has assessed the effectiveness of amortized inference in Bayesian statistics, particularly under varying signal-to-noise ratios and distribution shifts. This method leverages deep neural networks to streamline the inference process, allowing for significant computational savings compared to traditional Bayesian approaches that require extensive likelihood evaluations.

A Statistical Assessment of Amortized Inference Under Signal-to-Noise Variation and Distribution Shift

One More Thing in AI – Your Shortcut to AI Mastery

A Flow Model with Low-Rank Transformers for Incomplete Multimodal Survival Analysis

Was this article worth reading? Share it

One More Thing in AI

LucidQuery AI

Https

Twofold Health

Octofy

AIPortalX

Ready to build your own newsroom?