777789 - REEF BOT-101: Robotic Sensing with Jetson Orin & Depth Camera

Course Description

This short course is the first in the REEF BOT series and covers essential skills for autonomous systems development. Starting with Jetson Orin Nano setup, it progresses through sensor fundamentals, focusing on cameras and LiDARs. Participants will learn Qt and OpenCV basics, developing camera applications, and exploring various image processing techniques. The curriculum delves into advanced topics like feature detection, camera pose estimation, and background modeling. Finally, it culminates in practical object detection and tracking using state-of-the-art YOLO V5 technology, providing a solid foundation for computer vision and robotics applications.

Learner Outcomes

By the end of this short course, students should be able to:

· Configure the Hardware and Jetson Orin Nano Development Kit

• Load Software and SDKs
• Learn Qt Basics
• Create Camera Capture and Display Applications
• Understand OpenCV Data Structures & File IO

· Implement Performance Enhancements

• Implement Multi-threading
• Understand CUDA Basics
• Perform Transforms
• Implement Feature Types: SIFT, SURF, ORB
• Implement Feature Matching

· Implement Advanced Techniques

• Homography
• Image Alignment
• Camera Pose Estimation
• Background Modeling
• Image Segmentation
• Scale Space

· Understand Convolutional Neural Network Basics

• You Only Look Once (YOLO) V5 Introduction
• Perception with YOLO V5
• Object Detection
• Object Tracking

Testimonials