Trusted by learners at thousands of top companies and universities:
Course Overview
Full Course for Beginners
Perception is probably one of the most important things when we talk about autonomy. In this course, you will learn how perception is performed by robots using the ROS Framework.
You will learn how to:
1. Use OpenCV with ROS
2. Track objects by their color blobs
3. Navigate following floor lines with only a RGB camera
4. Detect human faces and track them
5. Recognize different faces
6. Track a person through a 3D environment
7. Recognize flat surfaces like tables where an object might be placed
8. Recognize objects and track them in 3D space with PointCloudSensors
Robots Used in This Course
Learn ROS through hands-on exercises from day one!
Mira robot
Aibo
TurtleBot 2
Fetch
You ROS_Perception Learning Path
We guide you through each step!
Learning Path
Unit 1
Perception with ROS Intro
Working Example: Mira Robot Follows the Ball (00:30 Hands on training)
Overview (00:10 Hands on training)
Unit 2
Vision Basics - Blob Tracking
Roll , Pitch, and Yaw (00:30 Hands on training)
Blob tracking with OpenCV and Python part 1: Color encoding (01:00 Hands on training)
Blob tracking with OpenCV and Python part 2: Start blob tracking with cmvision (01:00 Hands on training)
Exercises (02:00 Hands on training)
Unit 3
Vision Basics - Follow Line
Get Images from a ROS topic and show them with OpenCV (01:30 Hands on training)
Apply Filters To the Image (01:30 Hands on training)
Move the TurtleBot based on the position of the Centroid (01:30 Hands on training)
Additional Step: Follow Multiple Centroids (01:30 Hands on training)
PID controller with perception (01:30 Hands on training)
Unit 4
Surface and Object Recognition
Table Top Detector (01:30 Hands on training)
2D and 3D Object Finder (01:30 Hands on training)
Move and Spawn objects (01:30 Hands on training)
3D Object Detection (01:30 Hands on training)
Unit 5
Face Detection and Tracking
Face Detector in ROS (01:30 Hands on training)
Face Detector Client (01:00 Hands on training)
Visualize the Face Detections (01:00 Hands on training)
Unit 6
Facial Recognition
Starting the Facial Recognition package (01:30 Hands on training)
Multiple Face Detections at the same time (03:00 Hands on training)
Unit 7
People Tracking
ROS Package for Tracking People (00:30 Hands on training)
Leg Detector (01:00 Hands on training)
Detect Upper Body (01:00 Hands on training)
Pedestrian detector (01:00 Hands on training)
Putting it all together (02:00 Hands on training)
Unit 8
Aibo Perception Project
Your Own Simplified Aibo ERS7 (01:00 Hands on training)
RGB, Depth, and Point Cloud (00:45 Hands on training)
The Camera-Optic frame problem (00:15 Hands on training)
Elements of the Simulated World (00:30 Hands on training)
