Roadmap to Sample-Efficient Real-World Reinforcement Learning

What’s Standing Between Us and Real-World Deployment?

CoRL 2026 Workshop Austin, TX Nov 9, 2026

Overview

Reinforcement learning (RL) has long promised autonomous, self-improving robots, yet a stubborn gap separates impressive simulation results from reliable real-world deployment. At the heart of that gap is sample efficiency: every trial on physical hardware requires both human supervision and wall-clock time. This workshop asks the community one focused question to address this challenge: What problems preclude making RL algorithms sample-efficient enough for real-world deployment and what should we focus on over the next few years to solve them?

What makes this workshop unique?

Call for Papers

Topics of Interest

We welcome submissions on sample-efficient real-world RL, especially work that identifies practical bottlenecks, reports lessons learned from real-robot experiments, or proposes methods that reduce the cost of learning on hardware. Topics of interest include, but are not limited to:

  • Supervision and Reward Cost: Methods for obtaining useful learning signals cheaply, including learned reward models, human feedback, human-in-the-loop interventions, and strategies for avoiding supervision as the bottleneck.
  • Exploration and Safety on Hardware: Algorithms and systems for efficient exploration under safety constraints, reset-free or autonomous RL, safe online adaptation, and approaches that improve wall-clock efficiency during real-world training.
  • Leveraging Priors for Real-World RL: Approaches that use pretrained policies, VLAs, offline datasets, world models, or sim-to-real transfer to reduce the number of required on-robot interactions.
  • Post-Deployment Adaptation: Methods for finetuning deployed policies, improving robustness to distribution shift, learning new behaviors from experience, and adapting generalist policies without catastrophic forgetting.
  • Long-Horizon and Contact-Rich RL: Techniques for improving sample efficiency in long-horizon manipulation, dexterous control, contact-rich tasks, and settings with delayed rewards, compounding errors, or difficult exploration.
  • Benchmarks, Metrics, and Lessons Learned: Benchmarks, evaluation protocols, shared platforms, negative results, system-level insights, and analysis of what worked, what failed, and why in real-world RL experiments.

Submission Guidelines

  • Submission portal: all papers must be submitted through our OpenReview portal.
  • Page limit: submissions should be 4–8 pages, excluding references and appendix.
  • Format: submissions must follow the official CoRL paper template and style, and must be properly anonymized for double-blind review.
  • Dual submission policy: we disallow work already accepted to the main CoRL 2026 conference. Accepted workshop papers will be listed on the website but are non-archival and will not appear in formal proceedings.

Spotlight Talks

All accepted papers will be presented at an in-person poster session. A small number of selected papers will additionally give a 5-minute spotlight talk. Camera-ready versions of all accepted papers will be made available on the workshop website.

Workshop Schedule (Tentative)

Location: TBD, Austin, TX

Date: Monday, November 9, 2026

8:30 - 8:40 Opening, Central Question, and Problem-board Framing
8:40 - 9:50 Keynote Talks
9:50 - 10:00 Problem-board Voting
10:00 - 10:30 Oral Spotlights of Key Contributed Papers
10:30 - 11:00 Poster Session + Coffee Break
11:00 - 11:50 Breakout Sessions on Top-voted Problems
11:50 - 12:20 Panel Discussion with Speakers and Audience Volunteers
12:20 - 12:30 Synthesis, Roadmap, and Whitepaper Next Steps

Speakers

Speaker 1
Zhanyi Sun
Stanford University
Speaker 2
Kun Lei
Tsinghua University
Speaker 3
Kay Ke
Physical Intelligence (π)
Speaker 4
Zhiyuan "Paul" Zhou
UC Berkeley

Breakout Session Leads

Note: All speakers will also participate in the breakout sessions as leads and facilitators.

Breakout Session Lead 1
Rickmer Krohn
TU Darmstadt
Breakout Session Lead 2
Tobias Jülg
University of Technology Nuremberg

Organizers

Contact Us

Contact us at: r2rl.workshop.corl2026@gmail.com