Nvidia's Nemotron 3 swaps pure Transformers for a Mamba hybrid to run AI agents efficiently

Rivian has announced the replacement of Nvidia with its own AI chip, named RAP1, as part of its strategy to achieve Level 4 autonomy in its vehicles. This decision coincides with a partnership with Volkswagen, indicating a significant shift in Rivian's approach to autonomous driving technology.

Nvidia is reportedly considering a production cut of 30 to 40% for its GeForce RTX 50 series GPUs in the first half of 2026, primarily due to ongoing memory shortages. This decision, based on unconfirmed reports from Board Channels, suggests that availability of these graphics cards may become as challenging as it was at their initial launch.

A new neural architecture named SigMA has been introduced, integrating path signatures with multi-head self-attention for parameter learning in stochastic differential equations (SDEs) driven by fractional Brownian motion (fBm). This approach addresses the challenges posed by non-Markovian processes, which complicate traditional parameter estimation techniques.

A recent study has characterized the selective memory of Mamba's state space models (SSMs) using auto-encoders, revealing the types of tokens and sequences that are frequently forgotten during long sequence processing. This research addresses a critical knowledge gap in understanding the information loss associated with SSMs in language modeling.

A new training framework called Model Agnostic Preference Optimization (MAPO) has been introduced for medical image segmentation, which utilizes Dropout-driven stochastic segmentation hypotheses to create preference-consistent gradients without relying on direct ground-truth supervision. This model-agnostic approach supports various architectures, including 2D/3D CNNs and Transformers.

The introduction of MS-Temba, a Multi-Scale Temporal Mamba model, addresses significant challenges in Temporal Action Detection (TAD) for untrimmed videos, particularly in Activities of Daily Living (ADL). This model enhances the ability to process long-duration videos, capture temporal variations, and detect overlapping actions effectively through the use of dilated State-space Models (SSMs).

An empirical investigation has revealed that incorporating phase information significantly enhances fault diagnosis in rotating machinery. The study introduces two innovative phase-aware preprocessing strategies that effectively address random phase variations in multi-axis vibration data, demonstrating improvements across various deep learning architectures.

The recent interactions between Silicon Valley executives and British politicians highlight a growing trend where former political leaders, such as George Osborne, Nick Clegg, and Tony Blair, are taking on roles in tech firms. This shift was exemplified by Nvidia CEO Jensen Huang's event in London during Donald Trump's state visit, where he promoted AI's potential and announced significant investments in the UK.