arXiv:2310.04566v3 Announce Type: replace-cross 
Abstract: For robots to truly collaborate and assist humans, they must understand not only logic and instructions, but also the subtle emotions, aesthetics, and feelings that define our humanity. Human art and aesthetics are among the most elusive concepts-often difficult even for people to articulate-and without grasping these fundamentals, robots will be unable to help in many spheres of daily life. Consider the long-promised robotic butler: automating domestic chores demands more than motion planning. It requires an internal model of cleanliness and tidiness-a challenge largely unexplored by AI. To bridge this gap, we propose an approach that equips domestic robots to perform simple tidying tasks via knolling, the practice of arranging scattered items into neat, space-efficient layouts. Unlike the uniformity of industrial settings, household environments feature diverse objects and highly subjective notions of tidiness. Drawing inspiration from NLP, we treat knolling as a sequential prediction problem and employ a transformer based model to forecast each object's placement. Our method learns a generalizable concept of tidiness, generates diverse solutions adaptable to varying object sets, and incorporates human preferences for personalized arrangements. This work represents a step forward in building robots that internalize human aesthetic sense and can genuinely co-create in our living spaces.

مشروع Knolling Bot هو مبادرة رائدة تهدف إلى تعليم الروبوتات مفهوم النظافة البشري، الذي يتجاوز المنطق والتعليمات البسيطة. من خلال فهم المشاعر والجماليات التي تحدد إنسانيتنا، يمكن أن تصبح هذه الروبوتات متعاونين أكثر فعالية في حياتنا اليومية. هذا التطور مهم لأنه يمهد الطريق لمساعدين روبوتيين متقدمين يمكنهم الاندماج حقًا في البيئات البشرية، مما يعزز تفاعلاتنا ودعمنا في مهام متنوعة.

El proyecto Knolling Bot es una iniciativa innovadora que busca enseñar a los robots el concepto humano de orden, que va más allá de la lógica y las instrucciones. Al comprender las emociones y la estética que definen nuestra humanidad, estos robots podrían convertirse en colaboradores más efectivos en nuestra vida diaria. Este desarrollo es significativo, ya que allana el camino para asistentes robóticos avanzados que pueden integrarse verdaderamente en los entornos humanos, mejorando nuestras interacciones y apoyo en diversas tareas.

Le projet Knolling Bot est une initiative révolutionnaire visant à enseigner aux robots le concept humain de propreté, qui va au-delà de la simple logique et des instructions. En comprenant les émotions et l'esthétique qui définissent notre humanité, ces robots pourraient devenir des collaborateurs plus efficaces dans notre vie quotidienne. Ce développement est important car il ouvre la voie à des assistants robotiques avancés capables de s'intégrer véritablement dans les environnements humains, améliorant ainsi nos interactions et notre soutien dans diverses tâches.

The Knolling Bot project is a groundbreaking initiative aimed at teaching robots the human concept of tidiness, which goes beyond mere logic and instructions. By understanding the emotions and aesthetics that define our humanity, these robots could become more effective collaborators in our daily lives. This development is significant as it paves the way for advanced robotic assistants that can truly integrate into human environments, enhancing our interactions and support in various tasks.

Knolling Bot: Teaching Robots the Human Notion of Tidiness

Almost half of our attention during face-to-face conversation focuses on lip motion. Yet, robots still struggle to move their lips correctly. Even the most advanced humanoids make little more than muppet mouth gestures—if they have a face at all.

تعلم روبوت كيفية مزامنة الشفاه من خلال مشاهدة مقاطع الفيديو على يوتيوب، مما يعالج تحديًا كبيرًا في مجال الروبوتات حيث تكافح الروبوتات الشبيهة بالبشر غالبًا لتحريك شفاهها بشكل واقعي أثناء المحادثات. يسلط هذا التقدم الضوء على أهمية حركة الشفاه في التفاعل البشري، والتي تشكل ما يقرب من نصف الانتباه أثناء التواصل وجهًا لوجه.

Un robot ha aprendido a sincronizar los labios observando videos de YouTube, abordando un desafío significativo en la robótica donde los humanoides a menudo luchan por realizar movimientos realistas de los labios durante las conversaciones. Este avance destaca la importancia del movimiento de los labios en la interacción humana, que constituye casi la mitad de la atención durante la comunicación cara a cara.

Un robot a appris à synchroniser ses lèvres en observant des vidéos sur YouTube, ce qui répond à un défi majeur en robotique où les humanoïdes ont souvent du mal à reproduire des mouvements réalistes des lèvres lors des conversations. Cette avancée souligne l'importance du mouvement des lèvres dans l'interaction humaine, qui représente près de la moitié de l'attention lors des échanges en face à face.

A robot has learned to lip sync by observing YouTube videos, addressing a significant challenge in robotics where humanoids often struggle with realistic lip movements during conversations. This advancement highlights the importance of lip motion in human interaction, which constitutes nearly half of the attention during face-to-face communication.

Robot learns to lip sync by watching YouTube

arXiv:2601.06874v2 Announce Type: replace 
Abstract: Most existing 3D referring expression segmentation (3DRES) methods rely on dense, high-quality point clouds, while real-world agents such as robots and mobile phones operate with only a few sparse RGB views and strict latency constraints. We introduce Multi-view 3D Referring Expression Segmentation (MV-3DRES), where the model must recover scene structure and segment the referred object directly from sparse multi-view images. Traditional two-stage pipelines, which first reconstruct a point cloud and then perform segmentation, often yield low-quality geometry, produce coarse or degraded target regions, and run slowly. We propose the Multimodal Visual Geometry Grounded Transformer (MVGGT), an efficient end-to-end framework that integrates language information into sparse-view geometric reasoning through a dual-branch design. Training in this setting exposes a critical optimization barrier, termed Foreground Gradient Dilution (FGD), where sparse 3D signals lead to weak supervision. To resolve this, we introduce Per-view No-target Suppression Optimization (PVSO), which provides stronger and more balanced gradients across views, enabling stable and efficient learning. To support consistent evaluation, we build MVRefer, a benchmark that defines standardized settings and metrics for MV-3DRES. Experiments show that MVGGT establishes the first strong baseline and achieves both high accuracy and fast inference, outperforming existing alternatives. Code and models are publicly available at https://mvggt.github.io.

تم تقديم المحول متعدد الوسائط للجيوميتري البصرية (MVGGT) كإطار جديد لتجزئة التعبير المرجعي ثلاثي الأبعاد متعدد المناظر (MV-3DRES)، حيث يعالج القيود المفروضة على الأساليب الحالية التي تعتمد على سحب النقاط الكثيفة. يسمح MVGGT بالتجزئة مباشرة من الصور متعددة المناظر النادرة، مما يعزز الكفاءة والأداء في التطبيقات الواقعية.

Se ha presentado el Transformador Multimodal de Geometría Visual (MVGGT) como un nuevo marco para la Segmentación de Expresión Referencial 3D Multivista (MV-3DRES), abordando las limitaciones de los métodos existentes que dependen de nubes de puntos densas. MVGGT permite la segmentación directamente a partir de imágenes multivista escasas, mejorando la eficiencia y el rendimiento en aplicaciones del mundo real.

Le Transformateur Multimodal de Géométrie Visuelle (MVGGT) a été introduit comme un cadre novateur pour la Segmentation d'Expression Référentielle 3D Multivue (MV-3DRES), répondant aux limitations des méthodes existantes qui dépendent de nuages de points denses. MVGGT permet la segmentation directement à partir d'images multivues éparses, améliorant l'efficacité et la performance dans des applications réelles.

The Multimodal Visual Geometry Grounded Transformer (MVGGT) has been introduced as a novel framework for Multiview 3D Referring Expression Segmentation (MV-3DRES), addressing the limitations of existing methods that depend on dense point clouds. MVGGT enables segmentation directly from sparse multi-view images, enhancing efficiency and performance in real-world applications.

MVGGT: Multimodal Visual Geometry Grounded Transformer for Multiview 3D Referring Expression Segmentation

One More Thing in AI – Your Shortcut to AI Mastery

Knolling Bot: Teaching Robots the Human Notion of Tidiness

Was this article worth reading? Share it

One More Thing in AI

Humanize AI

Grubby.AI

Owlbot AI

Blunge

AI Humanizer

Ready to build your own newsroom?