Data Fusion-Enhanced Decision Transformer for Stable Cross-Domain Generalization
PositiveArtificial Intelligence
The introduction of the Data Fusion-Enhanced Decision Transformer (DFDT) marks a significant advancement in addressing the challenges posed by cross-domain shifts in decision transformer (DT) policies. Traditional adaptation methods often relied on simplistic filtering criteria, leading to misalignment and discontinuity in data, which compromised the effectiveness of DTs. DFDT overcomes these limitations by employing a two-level data filter that fuses scarce target data with selectively trusted source fragments. It utilizes maximum mean discrepancy (MMD) for aligning state structures and optimal transport (OT) for ensuring action feasibility. Furthermore, by replacing return-to-go (RTG) tokens with advantage-conditioned tokens, DFDT enhances the continuity of the token sequence, thereby improving inference capabilities. The theoretical contributions of DFDT provide bounds linking state value and policy performance gaps to MMD and OT measures, reinforcing its potential effectiveness. Th…
— via World Pulse Now AI Editorial System
