1 Create a FREE account.
2 Sign in with your user.
3 Follow the guided tutorial.

If you still have problems, please let us know, by sending an email to . Thank you!


P: +34 687 672 123
Mon-Fri 9:00AM - 6:00PM
Sat - 9:00AM-5:00PM
Sundays by appointment only!

OpenAI Gym for ROS Based Robots 101

Learn how to use OpenAI-Gym through environments defined for Gazebo Simulator

About the Course

Learn what you need to use the Open AI-Gym in your next robotics project with ROS based robots.

The objective of this course is to teach how to use OpenAI-Gym through environments defined for Gazebo Simulator.

This means that although the examples in this course will be exclusively in Gazebo Simulator, the knowledge acquired will be applicable to any system. You will be able to define environments for Gazebo, but also for other simulators or even other systems.

What You Will Learn

At the end of this OpenAI Gazebo-Gym Course, the following topics will have been addressed:

1. Basics of OpenAI-Gym
2. Definition of environment files for openai-gym, centered in gazebo-ROS simulations.
3. Importing of environments and communication with Gazebo Simulations through ROS
4. Registering of learning results and data plot
5. Create your own environment through a hands on example with a drone in Gazebo

6 hours

Robots used in this course:

- Turtlebot Simulation
- Parrot AR-Drone Simulation

Learning Path
Unit 1

Introduction OpenAI-gym

What is OpenAI-Gym
 (00:05 Hands on training)

What's in this OpenAI Gazebo-Gym Course
 (00:02 Hands on training)

How you will learn all that
 (00:02 Hands on training)

Minimum requirements for this course
 (00:02 Hands on training)

Special Thanks
 (00:02 Hands on training)

Unit 2

Running an environment

Make the robot learn how to move
(00:15 Hands on training)

Select the environment
(00:05 Hands on training)

Start up the monitoring
(00:40 Hands on training)

Unit 3

Environment file configuration

Where to find the environment files
(00:20 Hands on training)

(00:40 Hands on training)

Unit 4

Plot results

Plot Results from Monitor
(00:50 Hands on training)

(01:00 Hands on training)

Upload Results from Monitor
(00:10 Hands on training)

Unit 5

Micro Project

Know your environment
(00:15 Hands on training)

What you have to edit and create
(00:45 Hands on training)

Use the Environment just created to learn
(01:00 Hands on training)

Unit 6

Final Observations

Keep Learning
(00:10 Hands on training)