Particle.news

Caterpillar and Nvidia Expand AI Partnership With In‑Cab Assistant, Edge Pilots at CES

The CES demos signal a pilot‑phase push to put real‑time, on‑machine AI with voice assistance into heavy equipment using Nvidia’s stack.

Overview

  • Caterpillar formalized an expanded collaboration with Nvidia to integrate AI across machines, jobsites, and factories, using Jetson Thor for on‑board inference and Riva for voice.
  • The new Cat AI Assistant was demonstrated as a conversational tool that answers operator questions, guides maintenance and troubleshooting, and offers contextual safety tips.
  • A pilot on the Cat 306 CR Mini Excavator showcased in‑cab voice control and safety features such as setting boom height limits to avoid power lines and recognizing people on site.
  • Caterpillar is building digital twins with Nvidia Omniverse and applying an NVIDIA AI Factory to forecasting and scheduling, leveraging machine telemetry reported at roughly 2,000 messages per second.
  • Framed by decades of autonomous mining experience and a large deployed fleet, Caterpillar also pledged $25 million for workforce education to support scaling digital and autonomous capabilities.