Learning Autonomous Driving Behaviors with LLMs & RL

About

While the potential of reinforcement learning (RL) in automated driving systems is immense, it's not without its challenges. One of the major hurdles is creating precise reward functions that ensure safe, efficient, and human-like driving behavior. Despite this, RL's ability to adapt to various traffic conditions makes it a promising tool for developing intelligent driving systems.

Using large language models (LLMs) as a stand-in for reward signals introduces a novel approach. LLMs can intuitively steer RL agents toward desired outcomes by interpreting user goals into reward signals through natural language. This innovative method holds potential across multiple applications, such as automated driving and dynamic traffic management.

Key Takeaways:

  • Learning to prompt using open-source LLM APIs.
  • Leveraging RL for achieving autonomous navigation.
  • Challenges in designing suitable reward functions for RL.
  • Using LLMs to generate reward signals for RL.
  • Achieving human-like behavior in learning automation policies.
  • Hands-on implementation of LLMs & RL combined reward.

Speaker

Book Tickets
Stay informed about DHS 2025

Download agenda

We use cookies essential for this site to function well. Please click to help us improve its usefulness with additional cookies. Learn about our use of cookies in our Privacy Policy & Cookies Policy.

Show details