arXiv:2512.08012v1 Announce Type: new 
Abstract: In critical care settings such as the Intensive Care Unit, clinicians face the complex challenge of balancing conflicting objectives, primarily maximizing patient survival while minimizing resource utilization (e.g., length of stay). Single-objective Reinforcement Learning approaches typically address this by optimizing a fixed scalarized reward function, resulting in rigid policies that fail to adapt to varying clinical priorities. Multi-objective Reinforcement Learning (MORL) offers a solution by learning a set of optimal policies along the Pareto Frontier, allowing for dynamic preference selection at test time. However, applying MORL in healthcare necessitates strict offline learning from historical data.
  In this paper, we benchmark three offline MORL algorithms, Conditioned Conservative Pareto Q-Learning (CPQL), Adaptive CPQL, and a modified Pareto Efficient Decision Agent (PEDA) Decision Transformer (PEDA DT), against three scalarized single-objective baselines (BC, CQL, and DDQN) on the MIMIC-IV dataset. Using Off-Policy Evaluation (OPE) metrics, we demonstrate that PEDA DT algorithm offers superior flexibility compared to static scalarized baselines. Notably, our results extend previous findings on single-objective Decision Transformers in healthcare, confirming that sequence modeling architectures remain robust and effective when scaled to multi-objective conditioned generation. These findings suggest that offline MORL is a promising framework for enabling personalized, adjustable decision-making in critical care without the need for retraining.

دراسة حديثة تقيم ثلاثة خوارزميات للتعلم المعزز متعدد الأهداف (MORL) خارج الخط: Conditioned Conservative Pareto Q-Learning وAdaptive CPQL ووكيل القرار Pareto الفعال المعدل، في بيئات الرعاية الحرجة، وخاصة في وحدة العناية المركزة. تهدف هذه الأبحاث إلى معالجة تعقيدات تحقيق التوازن بين بقاء المرضى واستخدام الموارد من خلال التكيف الديناميكي للسياسات بناءً على البيانات التاريخية.

Un estudio reciente evalúa tres algoritmos de Aprendizaje por Refuerzo Multi-Objetivo (MORL) fuera de línea: Conditioned Conservative Pareto Q-Learning, Adaptive CPQL y un Agente de Decisión Pareto Eficiente modificado, en entornos de cuidados críticos, especialmente en la Unidad de Cuidados Intensivos. Esta investigación busca abordar las complejidades de equilibrar la supervivencia del paciente con la utilización de recursos mediante la adaptación dinámica de políticas basada en datos históricos.

Une étude récente évalue trois algorithmes de renforcement multi-objectifs hors ligne (MORL) : Conditioned Conservative Pareto Q-Learning, Adaptive CPQL et un agent de décision modifié Pareto Efficient Decision Transformer, dans des contextes de soins critiques, notamment l'unité de soins intensifs. Cette recherche vise à résoudre les complexités de l'équilibre entre la survie des patients et l'utilisation des ressources grâce à une adaptation dynamique des politiques basée sur des données historiques.

A recent study benchmarks three offline Multi-Objective Reinforcement Learning (MORL) algorithms—Conditioned Conservative Pareto Q-Learning, Adaptive CPQL, and a modified Pareto Efficient Decision Agent Decision Transformer—in critical care settings, particularly the Intensive Care Unit. This research aims to address the complexities of balancing patient survival with resource utilization through dynamic policy adaptation based on historical data.

Benchmarking Offline Multi-Objective Reinforcement Learning in Critical Care

arXiv:2512.07856v1 Announce Type: new 
Abstract: Accurate disease detection is of paramount importance for effective medical treatment and patient care. However, the process of disease detection is often associated with extensive medical testing and considerable costs, making it impractical to perform all possible medical tests on a patient to diagnose or predict hundreds or thousands of diseases. In this work, we propose Collaborative Learning for Disease Detection (CLDD), a novel graph-based deep learning model that formulates disease detection as a collaborative learning task by exploiting associations among diseases and similarities among patients adaptively. CLDD integrates patient-disease interactions and demographic features from electronic health records to detect hundreds or thousands of diseases for every patient, with little to no reliance on the corresponding medical tests. Extensive experiments on a processed version of the MIMIC-IV dataset comprising 61,191 patients and 2,000 diseases demonstrate that CLDD consistently outperforms representative baselines across multiple metrics, achieving a 6.33\% improvement in recall and 7.63\% improvement in precision. Furthermore, case studies on individual patients illustrate that CLDD can successfully recover masked diseases within its top-ranked predictions, demonstrating both interpretability and reliability in disease prediction. By reducing diagnostic costs and improving accessibility, CLDD holds promise for large-scale disease screening and social health security.

تم تقديم نهج جديد يسمى Collaborative Learning for Disease Detection (CLDD)، والذي يستخدم نموذج تعلم عميق قائم على الرسوم البيانية للكشف عن الأمراض دون الحاجة إلى اختبارات طبية موسعة. تستفيد هذه الطريقة من التفاعلات بين المرضى والأمراض والبيانات الديموغرافية من السجلات الصحية الإلكترونية، بهدف تحديد مجموعة واسعة من الأمراض بكفاءة.

Se ha introducido un nuevo enfoque llamado Collaborative Learning for Disease Detection (CLDD), que utiliza un modelo de aprendizaje profundo basado en grafos para detectar enfermedades sin pruebas médicas extensas. Este método aprovecha las interacciones entre pacientes y enfermedades, así como los datos demográficos de los registros de salud electrónicos, con el objetivo de identificar eficientemente una amplia gama de enfermedades.

Une nouvelle approche appelée Collaborative Learning for Disease Detection (CLDD) a été introduite, utilisant un modèle d'apprentissage profond basé sur des graphes pour détecter des maladies sans tests médicaux étendus. Cette méthode exploite les interactions patient-maladie et les données démographiques des dossiers de santé électroniques, visant à identifier efficacement un large éventail de maladies.

A novel approach called Collaborative Learning for Disease Detection (CLDD) has been introduced, utilizing a graph-based deep learning model to detect diseases without extensive medical testing. This method leverages patient-disease interactions and demographic data from electronic health records, aiming to identify a wide range of diseases efficiently.

Benchmarking Offline Multi-Objective Reinforcement Learning in Critical Care

Was this article worth reading? Share it

LucidQuery AI

Cogent

AIvilization