arXiv:2509.25228v2 Announce Type: replace 
Abstract: We introduce Random Projection Flows (RPFs), a principled framework for injective normalizing flows that leverages tools from random matrix theory and the geometry of random projections. RPFs employ random semi-orthogonal matrices, drawn from Haar-distributed orthogonal ensembles via QR decomposition of Gaussian matrices, to project data into lower-dimensional latent spaces for the base distribution. Unlike PCA-based flows or learned injective maps, RPFs are plug-and-play, efficient, and yield closed-form expressions for the Riemannian volume correction term. We demonstrate that RPFs are both theoretically grounded and practically effective, providing a strong baseline for generative modeling and a bridge between random projection theory and normalizing flows.

تم تقديم تدفقات الإسقاط العشوائي (RPFs) كإطار جديد لتدفقات التطبيع القابلة للحقن، باستخدام نظرية المصفوفات العشوائية والهندسة لإسقاط البيانات في فضاءات ذات أبعاد أقل. تستخدم هذه الطريقة مصفوفات شبه متعامدة عشوائية مستمدة من المصفوفات الغاوسية، مما يوفر نهجًا أكثر كفاءة وقائمًا على الأسس النظرية مقارنة بالتدفقات التقليدية المعتمدة على PCA.

Se han introducido los Random Projection Flows (RPFs) como un nuevo marco para los flujos normalizantes inyectivos, utilizando la teoría de matrices aleatorias y la geometría para proyectar datos en espacios de menor dimensión. Este método emplea matrices semi-ortogonales aleatorias derivadas de matrices gaussianas, ofreciendo un enfoque más eficiente y teóricamente fundamentado en comparación con los flujos basados en PCA tradicionales.

Les Random Projection Flows (RPFs) ont été introduits comme un nouveau cadre pour les flux normalisants injectifs, utilisant la théorie des matrices aléatoires et la géométrie pour projeter les données dans des espaces de dimension inférieure. Cette méthode emploie des matrices semi-orthogonales aléatoires dérivées de matrices gaussiennes, offrant une approche plus efficace et théoriquement fondée par rapport aux flux basés sur PCA traditionnels.

Random Projection Flows (RPFs) have been introduced as a new framework for injective normalizing flows, utilizing random matrix theory and geometry to project data into lower-dimensional spaces. This method employs random semi-orthogonal matrices derived from Gaussian matrices, offering a more efficient and theoretically grounded approach compared to traditional PCA-based flows.

Simple, Fast and Efficient Injective Manifold Density Estimation with Random Projections

arXiv:2408.10901v4 Announce Type: replace 
Abstract: Recent advancements in Latent Diffusion Models (LDMs) have revolutionized image synthesis and manipulation, raising significant concerns about data misappropriation and intellectual property infringement. While adversarial attacks have been extensively explored as a protective measure against such misuse of generative AI, current approaches are severely limited by their heavy reliance on model-specific knowledge and substantial computational costs. Drawing inspiration from the posterior collapse phenomenon observed in VAE training, we propose the Posterior Collapse Attack (PCA), a novel framework for protecting images from unauthorized manipulation. Through comprehensive theoretical analysis and empirical validation, we identify two distinct collapse phenomena during VAE inference: diffusion collapse and concentration collapse. Based on this discovery, we design a unified loss function that can flexibly achieve both types of collapse through parameter adjustment, each corresponding to different protection objectives in preventing image manipulation. Our method significantly reduces dependence on model-specific knowledge by requiring access to only the VAE encoder, which constitutes less than 4\% of LDM parameters. Notably, PCA achieves prompt-invariant protection by operating on the VAE encoder before text conditioning occurs, eliminating the need for empty prompt optimization required by existing methods. This minimal requirement enables PCA to maintain adequate transferability across various VAE-based LDM architectures while effectively preventing unauthorized image editing. Extensive experiments show PCA outperforms existing techniques in protection effectiveness, computational efficiency (runtime and VRAM), and generalization across VAE-based LDM variants. Our code is available at https://github.com/ZhongliangGuo/PosteriorCollapseAttack.

أدت التطورات الأخيرة في نماذج الانتشار الكامنة (LDM) إلى تقديم هجوم الانهيار اللاحق (PCA)، وهو إطار مبتكر يهدف إلى حماية الصور من التلاعب غير المصرح به. تستند هذه الطريقة إلى ظاهرة الانهيار اللاحق التي لوحظت في تدريب المشفرات التلقائية المتغيرة (VAE)، مما يبرز نوعين متميزين من الانهيار: انهيار الانتشار والانهيار المركّز.

Los recientes avances en los Modelos de Difusión Latente (LDM) han llevado a la introducción del Ataque de Colapso Posterior (PCA), un marco novedoso destinado a proteger las imágenes de manipulaciones no autorizadas. Este enfoque se basa en el fenómeno de colapso posterior observado en el entrenamiento de Autoencoders Variacionales (VAE), destacando dos tipos de colapso distintos: colapso de difusión y colapso de concentración.

Les avancées récentes dans les modèles de diffusion latente (LDM) ont conduit à l'introduction de l'attaque de collapse postérieur (PCA), un cadre novateur visant à protéger les images contre la manipulation non autorisée. Cette approche s'inspire du phénomène de collapse postérieur observé dans l'entraînement des autoencodeurs variationnels (VAE), mettant en évidence deux types de collapse distincts : le collapse de diffusion et le collapse de concentration.

Recent advancements in Latent Diffusion Models (LDMs) have prompted the introduction of the Posterior Collapse Attack (PCA), a novel framework aimed at protecting images from unauthorized manipulation. This approach draws on the posterior collapse phenomenon observed in Variational Autoencoder (VAE) training, highlighting two distinct collapse types: diffusion collapse and concentration collapse.

Simple, Fast and Efficient Injective Manifold Density Estimation with Random Projections

Was this article worth reading? Share it

CreativePixel

Supametas.AI

Pixo.art