arXiv:2601.07833v2 Announce Type: replace 
Abstract: We present RefVFX, a new framework that transfers complex temporal effects from a reference video onto a target video or image in a feed-forward manner. While existing methods excel at prompt-based or keyframe-conditioned editing, they struggle with dynamic temporal effects such as dynamic lighting changes or character transformations, which are difficult to describe via text or static conditions. Transferring a video effect is challenging, as the model must integrate the new temporal dynamics with the input video's existing motion and appearance. % To address this, we introduce a large-scale dataset of triplets, where each triplet consists of a reference effect video, an input image or video, and a corresponding output video depicting the transferred effect. Creating this data is non-trivial, especially the video-to-video effect triplets, which do not exist naturally. To generate these, we propose a scalable automated pipeline that creates high-quality paired videos designed to preserve the input's motion and structure while transforming it based on some fixed, repeatable effect. We then augment this data with image-to-video effects derived from LoRA adapters and code-based temporal effects generated through programmatic composition. Building on our new dataset, we train our reference-conditioned model using recent text-to-video backbones. Experimental results demonstrate that RefVFX produces visually consistent and temporally coherent edits, generalizes across unseen effect categories, and outperforms prompt-only baselines in both quantitative metrics and human preference. See our website https://tuningfreevisualeffects-maker.github.io/Tuning-free-Visual-Effect-Transfer-across-Videos-Project-Page/

تم تقديم إطار جديد يسمى RefVFX، مما يتيح نقل التأثيرات الزمنية المعقدة من فيديو مرجعي إلى فيديو أو صورة مستهدفة بطريقة مباشرة. تعالج هذه الابتكار التحديات المتعلقة بالتأثيرات الزمنية الديناميكية، مثل تغييرات الإضاءة وتحولات الشخصيات، والتي يصعب التعبير عنها من خلال النص أو الشروط الثابتة.

Se ha presentado un nuevo marco llamado RefVFX que permite la transferencia de efectos temporales complejos de un video de referencia a un video o imagen objetivo de manera directa. Esta innovación aborda los desafíos de los efectos temporales dinámicos, como los cambios de iluminación y las transformaciones de personajes, que son difíciles de describir a través de texto o condiciones estáticas.

Un nouveau cadre nommé RefVFX a été introduit, permettant le transfert d'effets temporels complexes d'une vidéo de référence vers une vidéo ou une image cible de manière directe. Cette innovation répond aux défis des effets temporels dynamiques, tels que les changements d'éclairage et les transformations de personnages, qui sont difficiles à exprimer par le texte ou des conditions statiques.

A new framework named RefVFX has been introduced, enabling the transfer of complex temporal effects from a reference video to a target video or image in a feed-forward manner. This innovation addresses challenges in dynamic temporal effects, such as lighting changes and character transformations, which are difficult to articulate through text or static conditions.

Tuning-free Visual Effect Transfer across Videos

Was this article worth reading? Share it

Capte

Typevis

Videotok

SuperMotion

LipSync

The Visualizer

Ready to build your own newsroom?