AI Research Breakthroughs from NVIDIA Research (Hosted by Karoly of Two Minute Papers) | NVIDIA GTC

Reinforcement Learning as Pre-training

Yejin Choi introduced RLP, which injects exploration and reasoning into the pre-training phase rather than limiting it to post-training RLHF, allowing models to think before predicting tokens instead of merely imitating internet data.

Era of Explorative Learning

This approach hybridizes training stages and enables continual learning where models adapt during deployment time, blurring the line between training and testing to push AI frontiers beyond static imitation.

Alpamayo Open Platform Release

Marco Pavone announced the fully open-source Alpamayo ecosystem including Alpamayo-1.5, a 10-billion-parameter chain-of-thought visual-language-action model available on Hugging Face with post-training scripts for customization.

Reasoning-Action Alignment

The team solved embodiment misalignment through post-training coupling to ensure the model's explicit English reasoning traces faithfully reflect its physical driving actions, providing safety signals and trustworthy explainability.

Real-Time Generative Simulation

Alpamayo Dreams enables real-time, interactive simulation of multiple cameras from text prompts, allowing developers to edit weather, add objects like falling mattresses, and test policies in closed-loop generative environments.

Omniverse Neural Reconstruction

Sanja Fidler detailed NewRec's shift from slow graphics engines to 3D Gaussian splatting, converting real driving videos into photorealistic digital environments that run 2 million tests daily for AV validation.

Data-Driven Simulation Future

World models like COSMOS learn simulation from massive visual data, eliminating the scalability ceiling of human-authored content and enabling generation of novel scenarios like pedestrians reacting realistically to near-misses never explicitly programmed.

Neural Robot Dynamics

Yashraj Narang presented NeRD, which simulates 1,024 simultaneous nut-and-bolt contact interactions in real time on a single GPU by learning physics in robot-centric frames, enabling massive parallel reinforcement learning.

Zero-Shot Real World Deployment

Policies trained purely in NeRD transfer zero-shot to physical tasks including assembling NVIDIA GB300 superchips and managing cables, extending to industrial assembly and autonomous scientific lab automation.